00000400:00080000:2.0F:1784047178.382961:0:83734:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1784047178.83336 00010000:02000000:3.0F:1784047178.383075:0:83336:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:06, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:0.0F:1784047178.404282:0:83336:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc9147dabe10 00100000:10000000:0.0:1784047178.404309:0:83336:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784047178.405222:0:83324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:0.0:1784047178.405269:0:83324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83324:1870705709141888:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784047178.405339:0:83324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047178.405379:0:83324:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6e0e000 going to sleep for 20 seconds 00000100:00100000:1.0F:1784047178.405432:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709141888 00000100:00100000:1.0:1784047178.405446:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709141888 00000004:00080000:2.0:1784047178.405485:0:83322:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:2.0:1784047178.405517:0:83322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83322:1870705709142016:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784047178.405524:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923 00000100:00100000:1.0:1784047178.405533:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83324:x1870705709141888:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1784047178.405540:0:13594:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784047178.405545:0:83322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047178.405562:0:83322:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73900 going to sleep for 20 seconds 00002000:00080000:1.0:1784047178.405567:0:13594:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -31 00002000:02000040:1.0:1784047178.405572:0:13594:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1729) 00000100:00100000:2.0:1784047178.405575:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142016 00000100:00100000:2.0:1784047178.405578:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142016 00000100:00100000:2.0:1784047178.405601:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4924 00000100:00100000:2.0:1784047178.405653:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83322:x1870705709142016:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:2.0:1784047178.405657:0:26185:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1784047178.405668:0:26185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -529 00002000:02000040:2.0:1784047178.405672:0:26185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1729) 00000100:00080000:0.0:1784047178.405760:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047178.405764:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1784047178.412301:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.412314:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412333:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.412338:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.412344:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412360:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412372:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412380:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412443:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047178.412561:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.412567:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412590:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.412594:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.412599:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412639:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412648:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.412656:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.418730:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784047178.418875:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.418884:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.418903:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.418907:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.418914:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.418929:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.418958:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.418965:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.418983:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784047178.418994:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047178.419000:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419007:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6cc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.419012:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419020:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419037:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419045:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c77370d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419066:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047178.419076:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419083:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6dc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.419087:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419096:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419107:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419114:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c773714 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419127:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.419130:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419137:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.419141:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419148:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419171:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.419178:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c77371b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419315:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.419398:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.419405:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419413:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.419416:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.419421:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419431:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419440:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419447:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419463:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.419471:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.419482:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419489:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.419505:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419513:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419524:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419531:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafcb75c/0x4426598c0c773722 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419547:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.419549:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.419551:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.419595:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.419601:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419628:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.419631:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.419635:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419657:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419666:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419674:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419689:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.419697:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.419701:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419708:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.419711:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419719:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419730:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419737:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085b2f88c/0x4426598c0c773729 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419757:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.419759:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.419761:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.419807:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.419813:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419820:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.419823:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.419826:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419835:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419842:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419850:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419860:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047178.419897:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.419903:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419921:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.419924:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.419929:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419939:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419947:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419955:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419968:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047178.419976:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047178.419980:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419987:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.419991:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.419998:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420019:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420026:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1f6bcd2/0x4426598c0c773730 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420040:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.420043:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420050:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.420053:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420060:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420071:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420078:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b3752a4/0x4426598c0c773737 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420090:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420091:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420098:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.420140:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.420146:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420154:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.420157:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.420161:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420170:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420178:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420185:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420219:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.420225:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.420228:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420235:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.420239:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420257:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420268:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420276:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d505f0/0x4426598c0c77373e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420289:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420290:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420292:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.420333:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.420337:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420345:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.420348:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.420352:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420361:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420369:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420383:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420395:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.420402:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.420405:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420412:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.420415:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420423:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420433:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420441:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a389d17e/0x4426598c0c773745 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420453:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420455:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420457:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.420509:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.420520:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420528:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.420531:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.420535:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420544:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420553:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420560:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420572:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.420579:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.420582:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420589:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.420593:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420600:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420640:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420647:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2888778/0x4426598c0c77374c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420661:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420663:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420665:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.420713:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.420718:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420726:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.420729:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.420734:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420742:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420750:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420757:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420781:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.420789:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.420793:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420800:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.420804:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420811:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420822:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420829:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb29f20e/0x4426598c0c773753 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420842:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420843:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.420845:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.420886:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.420891:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420899:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.420908:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.420913:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420923:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420932:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420939:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420951:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.420958:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.420962:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420969:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.420973:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420981:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.420991:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421009:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30e17a3/0x4426598c0c77375a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421021:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421022:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421024:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.421067:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.421072:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421081:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.421084:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.421088:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421097:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421106:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421113:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421125:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.421139:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.421143:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421150:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.421154:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421162:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421173:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421181:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2e811a5/0x4426598c0c773761 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421193:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421194:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421196:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.421234:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.421239:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421247:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.421250:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.421254:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421272:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421280:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421287:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421299:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.421305:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.421308:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421315:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.421319:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421326:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421336:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421343:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36b27c3/0x4426598c0c773768 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421362:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421364:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421366:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.421407:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.421412:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421420:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.421423:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.421427:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421436:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421444:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421451:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421463:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.421469:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.421472:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421489:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.421505:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421513:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421524:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421531:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c77376f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421543:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421545:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421546:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.421588:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.421594:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421602:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.421623:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.421628:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421637:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421651:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421659:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421672:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.421678:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.421682:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421688:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.421691:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421698:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421709:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421717:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a570514e/0x4426598c0c773776 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421729:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421736:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421738:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.421780:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.421785:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421793:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.421796:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.421800:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421809:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421816:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421823:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421835:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.421841:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.421845:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421851:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.421855:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421873:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421884:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421891:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4fe21c8/0x4426598c0c77377d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421904:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421906:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.421907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.421948:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.421954:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421962:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.421965:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.421969:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421978:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421986:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.421999:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422012:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.422018:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.422021:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422028:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.422032:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422039:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422051:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422058:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058415d9d/0x4426598c0c773784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422071:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.422074:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.422075:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.422120:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.422130:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422138:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.422141:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.422145:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422154:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422161:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422168:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422180:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.422186:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.422189:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422196:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.422200:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422207:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422222:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422230:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b72505/0x4426598c0c77378b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422242:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.422243:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.422245:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.422280:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.422285:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422293:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.422296:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.422300:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422309:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422317:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422324:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422346:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047178.422352:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.422355:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422362:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.422365:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422373:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422384:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422391:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b10770/0x4426598c0c773792 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422403:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.422404:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.422406:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.422446:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.422452:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422459:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.422467:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.422472:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422480:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.422488:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.425652:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.425659:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.425663:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047178.425890:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047178.425896:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.427048:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.427136:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047178.428476:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.428485:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.428513:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.428518:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.428524:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.428539:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.428548:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.428571:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428849:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047178.428858:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428867:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.428872:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428881:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428899:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428907:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e830ddc/0x4426598c0c773799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428940:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.428943:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428950:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.428953:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428961:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428970:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.428977:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.428979:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.428980:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.429018:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.429024:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429033:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.429036:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.429040:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429065:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429075:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429083:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429110:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047178.429183:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.429188:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.429302:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.429310:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.429317:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.429321:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.429329:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.429341:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.429347:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c7737a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.429373:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.429375:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.429377:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.429468:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.429471:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.429476:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429485:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429503:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429522:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429545:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047178.429591:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.429596:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429603:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.429687:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.429691:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429772:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429781:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429788:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429844:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784047178.429889:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.429894:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429909:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.429912:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.429917:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429926:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429935:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429942:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.429959:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784047178.429997:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.430003:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430011:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.430014:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.430018:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430027:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430046:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430053:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430066:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784047178.430073:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047178.430077:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430084:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24bc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.430088:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430096:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430108:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430115:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c512cfe/0x4426598c0c7737ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430129:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047178.430137:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430143:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24aa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.430146:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430154:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430163:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430170:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000712ae91d/0x4426598c0c7737b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430181:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047178.430184:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430267:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.430272:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430280:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430304:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430312:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c7737bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430324:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.430328:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430334:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.430337:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430345:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430354:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430361:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a17c67/0x4426598c0c7737c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.430372:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.430374:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.430382:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.431506:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047178.431518:0:13594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de42f3dc/0x4426598c0c7737a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.431646:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.431652:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431665:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.431670:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.431676:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431688:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431698:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431706:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431749:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047178.431794:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.431799:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431824:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.431827:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.431831:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431841:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431849:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431857:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431866:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047178.431902:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.431907:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431915:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.431925:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.431929:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431938:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431947:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431954:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.431964:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047178.432172:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.432178:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432186:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.432189:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.432193:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432201:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432209:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432223:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432233:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784047178.432270:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.432275:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432283:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.432286:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.432290:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432298:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432306:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432313:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432322:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1784047178.432361:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.432366:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432379:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.432382:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.432386:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432395:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432403:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432410:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432418:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784047178.432457:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.432462:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432469:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.432472:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.432475:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.432483:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433112:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433119:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433130:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1784047178.433185:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.433190:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433198:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.433201:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.433205:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433214:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433221:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433229:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433249:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1784047178.433288:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.433293:0:13594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433301:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.433304:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.433308:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433317:0:13594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433326:0:13594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433334:0:13594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.433343:0:13594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00080000:0.0:1784047178.433443:0:13594:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00000100:00100000:0.0:1784047178.433558:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83324:x1870705709141888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 28021us (28215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047178.433569:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923 00000100:00100000:0.0:1784047178.433689:0:83324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83324:1870705709141888:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784047178.433712:0:83324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:0.0:1784047178.433781:0:83324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83324:1870705709142272:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1784047178.433849:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1784047178.433858:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433867:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.433872:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047178.433874:0:83324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047178.433881:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047178.433898:0:83324:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3e05300 going to sleep for 20 seconds 00010000:00010000:1.0:1784047178.433899:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433906:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c7737ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047178.433919:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142272 00000100:00100000:0.0:1784047178.433925:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142272 00010000:00010000:1.0:1784047178.433928:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1784047178.433931:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433937:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.433940:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433947:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433964:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433971:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7421cb/0x4426598c0c7737d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433986:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1784047178.433989:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.433997:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434000:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434007:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434015:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434021:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc0c3db4/0x4426598c0c7737d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434034:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784047178.434036:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434049:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434052:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434060:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047178.434066:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925 00010000:00010000:1.0:1784047178.434070:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047178.434075:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83324:x1870705709142272:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1784047178.434077:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b1b55f8/0x4426598c0c7737df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1784047178.434082:0:8824:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1784047178.434094:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784047178.434097:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434104:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434107:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434113:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784047178.434115:0:8824:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00010000:00010000:1.0:1784047178.434122:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434133:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7737e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434145:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047178.434149:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434155:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434158:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434166:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434175:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434183:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7737ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434194:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047178.434198:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434204:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434212:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434220:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434229:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434236:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c7737f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434249:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047178.434252:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434258:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434262:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434270:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434278:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434285:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7737fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434303:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.434306:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434313:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434316:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434323:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434332:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434338:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c773802 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434348:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434350:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434351:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.434453:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.434459:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434470:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.434479:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.434485:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434510:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434518:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434524:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434538:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.434545:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.434548:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434555:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434558:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434566:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434576:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434594:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba49776d/0x4426598c0c773809 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434627:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434629:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434631:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.434681:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.434686:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434694:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.434697:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.434702:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434712:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434720:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434727:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434739:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.434751:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.434755:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434761:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434765:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434773:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434784:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434792:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3a8d8e/0x4426598c0c773810 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434806:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434808:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434809:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.434849:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.434854:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434863:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.434866:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.434871:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434892:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434901:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434908:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434922:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.434928:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.434932:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434939:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.434942:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434951:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434961:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434970:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026fadd67/0x4426598c0c773817 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.434990:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434991:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.434993:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.435034:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.435039:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435047:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.435050:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.435054:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435064:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435071:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435079:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435090:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.435097:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.435101:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435118:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ae00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.435122:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435129:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435140:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435148:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d38d8fcc/0x4426598c0c77381e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435162:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.435164:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.435166:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.435203:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.435208:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435216:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.435219:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.435223:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435232:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435246:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435254:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435267:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.435274:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.435278:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435284:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.435288:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435296:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435307:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435316:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000926aeab3/0x4426598c0c773825 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435329:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.435336:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.435338:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047178.435400:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047178.435405:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435413:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:1.0:1784047178.435416:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.435419:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435428:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435436:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435443:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435455:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.435462:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.435465:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.435471:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.435475:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047178.435674:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709142144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047178.435739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047178.435775:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:83324:x1870705709142272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1700us (1899us total) trans 4294968747 rc 0/0 00000100:00100000:0.0:1784047178.435783:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925 00000100:00100000:2.0:1784047178.435802:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142144 00000100:00100000:2.0:1784047178.435808:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142144 00000100:00100000:0.0:1784047178.435823:0:83324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83324:1870705709142272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784047178.435835:0:83324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00000100:00100000:2.0:1784047178.435838:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1784047178.435845:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709142144:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1784047178.435851:0:39444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1784047178.435866:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047178.435899:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709142144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047178.435906:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00002000:00010000:0.0:1784047178.435908:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.435912:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.435921:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.435924:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.435928:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.435937:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.435951:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047178.435952:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709142144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784047178.435958:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.435966:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.435969:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.435972:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.435979:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.435983:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.435990:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436014:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436021:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9317aa/0x4426598c0c773833 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436036:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.436038:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.436040:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.436046:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.436062:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.436083:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436088:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436097:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436101:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.436104:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436113:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436121:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436128:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436161:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047178.436199:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436204:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436212:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436216:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.436221:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436228:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436235:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436241:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436253:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047178.436288:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436292:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436299:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436308:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.436312:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436320:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436328:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436333:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436343:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047178.436384:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436389:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436460:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784047178.436465:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436473:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.436477:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436478:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436481:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047178.436485:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436486:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436504:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436512:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436516:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436525:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c77383a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436526:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436534:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784047178.436544:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784047178.436548:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436554:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.436557:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436565:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.436571:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047178.436575:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436576:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436583:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a983f6/0x4426598c0c773841 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436584:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436587:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.436591:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436595:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047178.436597:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436600:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436631:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436636:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.436639:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436640:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436648:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047178.436658:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436668:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436675:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773848 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.436681:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436685:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436687:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047178.436691:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436698:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436701:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.436705:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436710:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.436713:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436715:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436722:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436723:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436731:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436732:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436739:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c77384f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436740:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047178.436762:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047178.436765:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436772:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02045400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.436775:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.436775:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436780:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436783:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436788:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436790:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047178.436793:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436794:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436801:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a173ef0/0x4426598c0c773856 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436804:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436818:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.436821:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436825:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436828:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02045600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.436831:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436833:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436840:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.436847:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436857:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436864:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d1fcae7/0x4426598c0c77385d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.436874:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047178.436875:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.436879:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436880:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436886:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02044800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.436888:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:2.0:1784047178.436890:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436890:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.436895:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436898:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436904:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436907:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436911:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436915:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077fbb11f/0x4426598c0c773864 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436919:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436934:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.436945:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.436948:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436954:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02044200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.436957:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436964:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.436965:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.436970:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436974:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436977:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.436981:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047178.436982:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c50a1bfc/0x4426598c0c77386b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.436985:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.436993:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.436995:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.436997:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.437004:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.437008:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.437070:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437079:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437086:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437109:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047178.437149:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.437154:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437161:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437169:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.437174:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437182:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437188:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437195:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437207:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047178.437245:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.437250:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437257:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437260:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.437264:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437272:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437279:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437294:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437304:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047178.437340:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.437345:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437351:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784047178.437352:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437355:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047178.437356:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437359:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437368:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437375:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02045e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.437376:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437378:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437385:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437387:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437398:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437405:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ddb487/0x4426598c0c773872 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437419:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047178.437423:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437429:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02045000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.437432:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437434:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047178.437440:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437449:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437461:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d684d95/0x4426598c0c773879 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.437469:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.437473:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437475:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047178.437478:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437485:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.437486:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:2.0:1784047178.437488:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437489:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.437506:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437509:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437516:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437519:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437524:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437527:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773880 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437531:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437538:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.437539:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.437541:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437546:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.437555:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437563:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437572:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.437574:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.437579:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437580:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773887 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437586:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437589:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047178.437593:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047178.437593:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437596:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437602:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437603:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.437627:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437635:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437640:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437644:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437647:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437652:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c77388e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437655:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.437668:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.437672:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437678:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbcc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.437681:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437687:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.437690:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.437695:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437701:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437704:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.437708:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437717:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437724:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437731:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437749:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.437761:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437768:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437780:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.437783:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.437786:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047178.437789:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047178.437791:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437793:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437799:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437801:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.437806:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437811:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437814:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437822:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437822:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437831:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9543aeb/0x4426598c0c77389c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437831:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437839:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047178.437842:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.437844:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437850:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.437852:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437860:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.437868:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047178.437869:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437873:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437876:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c7738a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.437880:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.437888:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.437893:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437897:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.437898:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.437900:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.437902:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437908:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.437909:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.437912:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.437916:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438042:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438055:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438063:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c77382c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438076:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047178.438077:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047178.438080:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438087:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047178.438090:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438097:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438107:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438114:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c7738aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047178.438117:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.438122:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438130:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.438133:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047178.438137:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.438137:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047178.438139:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.438146:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438154:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438165:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438324:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.438330:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438337:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbce00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.438340:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438350:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438361:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438368:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.438369:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.438371:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047178.438413:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047178.438435:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047178.438444:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047178.438449:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c7738b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438460:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047178.438510:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.438515:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438523:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.438526:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.438530:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438539:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438546:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438553:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438585:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047178.438641:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047178.438646:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438654:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=3276s v=(0 0) 00010000:00010000:0.0:1784047178.438657:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047178.438661:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438669:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438676:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438682:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047178.438701:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047178.438798:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047178.438804:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438823:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbdc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.438826:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438835:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438846:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438853:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebedc5ab/0x4426598c0c7738b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438867:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047178.438871:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438877:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbda00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047178.438880:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438887:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438898:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438910:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c7738bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047178.438923:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.438925:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047178.438927:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047178.438977:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784047178.441790:0:26185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:0.0:1784047178.441899:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83322:x1870705709142016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 36287us (36347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047178.441911:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4924 00000100:00100000:1.0:1784047178.442009:0:83322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83322:1870705709142016:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784047178.442024:0:83322:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:1.0:1784047178.442095:0:83322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83322:1870705709142528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784047178.442097:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047178.442113:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709142400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047178.442130:0:83322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047178.442137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047178.442155:0:83322:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc488d780 going to sleep for 20 seconds 00000100:00100000:1.0:1784047178.442170:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142528 00000100:00100000:0.0:1784047178.442170:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142400 00000100:00100000:1.0:1784047178.442175:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142528 00000100:00100000:0.0:1784047178.442175:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142400 00000100:00100000:0.0:1784047178.442212:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:1.0:1784047178.442217:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926 00000100:00100000:0.0:1784047178.442220:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709142400:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047178.442223:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:83322:x1870705709142528:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1784047178.442226:0:26187:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:0.0:1784047178.442227:0:12054:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784047178.442248:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00002000:00080000:1.0:1784047178.442251:0:26187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00000100:00100000:0.0:1784047178.442281:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709142400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047178.442288:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:0.0:1784047178.442319:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709142400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047178.444456:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:83322:x1870705709142528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2226us (2318us total) trans 4294968748 rc 0/0 00000100:00100000:0.0:1784047178.444467:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926 00000100:00100000:1.0:1784047178.446189:0:83322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83322:1870705709142528:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784047178.446206:0:83322:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00010000:00010000:3.0:1784047178.963346:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047179.028554:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709142656:0@lo:400:kworker.0 00000100:00100000:0.0:1784047179.028650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.028937:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709142784:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.028980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.029034:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142784 00000100:00100000:3.0:1784047179.029042:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142784 00000100:00100000:3.0:1784047179.029104:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1784047179.029116:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709142784:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.029123:0:66221:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.029253:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709142784:12345-0@lo:400:kworker.0 Request processed in 134us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.029260:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00080000:3.0:1784047179.029287:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047179.029323:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709142784:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.029376:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047179.029383:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709142912:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.029406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.029430:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142912 00000100:00100000:3.0:1784047179.029433:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142912 00000100:00100000:3.0:1784047179.029459:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1784047179.029465:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709142912:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.029470:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.029512:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709142912:12345-0@lo:400:kworker.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.029519:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:3.0:1784047179.029546:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047179.029562:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709142912:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.029590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709143040:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.029632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.029660:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143040 00000100:00100000:3.0:1784047179.029664:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143040 00000100:00100000:3.0:1784047179.029701:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1784047179.029708:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709143040:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.029712:0:66220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.029752:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709143040:12345-0@lo:400:kworker.0 Request processed in 44us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.029930:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00080000:3.0:1784047179.029951:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047179.030121:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709143040:0@lo:400:kworker.0 00000100:00080000:3.0:1784047179.030370:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047179.030375:0:45180:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1784047179.030381:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047179.030388:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709143168:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.030416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.030443:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143168 00000100:00100000:3.0:1784047179.030447:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143168 00000100:00100000:3.0:1784047179.030478:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1784047179.030496:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709143168:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.030501:0:68026:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.030536:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709143168:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.030555:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00080000:3.0:1784047179.030571:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047179.030590:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709143168:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.030647:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709143296:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.030673:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.030718:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047179.030723:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709143424:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.030747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.030803:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709143552:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.031152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.031175:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143552 00000100:00100000:3.0:1784047179.031178:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143552 00000100:00100000:3.0:1784047179.031203:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1784047179.031210:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709143552:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.031215:0:66219:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.031248:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709143552:12345-0@lo:400:kworker.0 Request processed in 39us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.031255:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1784047179.031284:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709143552:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.031318:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047179.031324:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709143680:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.031408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047179.031418:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709142656 00000100:00100000:0.0:1784047179.031423:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709142656 00000100:00100000:3.0:1784047179.031449:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709143808:0@lo:400:kworker.0 00000100:00100000:0.0:1784047179.031455:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784047179.031461:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709142656:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047179.031466:0:83311:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.031470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047179.031511:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709142656:12345-0@lo:400:kworker.0 Request processed in 50us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047179.031517:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784047179.031534:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047179.031540:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709143936:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.031563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.031629:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709144064:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.031653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047179.031677:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144064 00000100:00100000:3.0:1784047179.031680:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144064 00000100:00100000:3.0:1784047179.031703:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1784047179.031709:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709144064:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.031713:0:66221:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.031744:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709144064:12345-0@lo:400:kworker.0 Request processed in 35us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.031751:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1784047179.031916:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709144064:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.031967:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143296 00000100:00100000:0.0:1784047179.031967:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143680 00000100:00100000:3.0:1784047179.031971:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143296 00000100:00100000:0.0:1784047179.031971:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143680 00000100:00100000:3.0:1784047179.031997:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143424 00000100:00100000:3.0:1784047179.032000:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143424 00000100:00100000:0.0:1784047179.032000:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:0.0:1784047179.032005:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709143680:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047179.032010:0:8442:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.032016:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143808 00000100:00100000:3.0:1784047179.032018:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143808 00000100:00100000:3.0:1784047179.032031:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1784047179.032036:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709143296:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.032040:0:26192:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047179.032046:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709143680:12345-0@lo:400:kworker.0 Request processed in 41us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047179.032053:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00000100:00100000:3.0:1784047179.032070:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709143296:12345-0@lo:400:kworker.0 Request processed in 34us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.032076:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1784047179.032080:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709142656:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.032085:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709143936 00000100:00100000:3.0:1784047179.032087:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709143936 00000100:00100000:0.0:1784047179.032105:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709143680:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.032113:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:3.0:1784047179.032118:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709143424:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.032122:0:26192:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047179.032130:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:0.0:1784047179.032136:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709143808:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047179.032140:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.032149:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709143424:12345-0@lo:400:kworker.0 Request processed in 30us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.032155:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1784047179.032162:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709143808:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.032165:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:0.0:1784047179.032168:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:3.0:1784047179.032170:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709143936:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047179.032173:0:26192:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047179.032197:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709143936:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.032204:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00080000:0.0:1784047179.032218:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047179.032222:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047179.032227:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709143936:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.032237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709143808:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.032245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709143424:0@lo:400:kworker.0 00000100:00100000:3.0:1784047179.032255:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709143296:0@lo:400:kworker.0 00010000:00080000:3.0:1784047179.091898:0:8441:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99ccfeb80700 x1870705709140608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1784047188 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047179.092031:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709140608:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1036756us (1037364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.092042:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663 00000100:00080000:1.0:1784047179.092187:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784047179.092197:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99ccfeb82d80 x1870705709140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047208 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047179.092205:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99ccfeb82d80 x1870705709140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047208 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047179.092211:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784047179.092231:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784047179.092252:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cb33439e): req@ffff99ccfdd31180 x1870705709056256/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784046994 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047179.092277:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709140608:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1784047179.092389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047179.092760:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709144192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047179.092799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047179.100451:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709056256 00000100:00100000:1.0:1784047179.100470:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709056256 00000100:00100000:1.0:1784047179.100556:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144192 00000100:00100000:1.0:1784047179.100561:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144192 00000100:00100000:1.0:1784047179.100589:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1784047179.100600:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709056256:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1784047179.100622:0:23872:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1784047179.100660:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444999168 avail 1298759680 00000100:00100000:3.0:1784047179.100702:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:3.0:1784047179.100713:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709144192:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1784047179.100733:0:83733:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1784047179.100745:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444999168 avail 1298759680 00000100:00100000:1.0:1784047179.100758:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709056256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (8366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047179.100767:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:3.0:1784047179.100795:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709144192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (7994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047179.100802:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:3.0:1784047179.100853:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709056256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047179.105329:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709144192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784047179.986838:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047180.051201:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047180.051227:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709144320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047180.051315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047180.051416:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144320 00000100:00100000:1.0:1784047180.051423:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144320 00000100:00100000:1.0:1784047180.051480:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:1.0:1784047180.051490:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709144320:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1784047180.051497:0:39444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1784047180.051525:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047180.051574:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709144320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047180.051582:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:2.0:1784047180.051681:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709144320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047180.052471:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047180.052486:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709144448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047180.052529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047180.052895:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144448 00000100:00100000:0.0:1784047180.052902:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144448 00000100:00100000:0.0:1784047180.052946:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1784047180.052956:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709144448:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1784047180.052962:0:12054:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784047180.052984:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047180.053037:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709144448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047180.053044:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:3.0:1784047180.053176:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709144448:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784047181.012807:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047181.075069:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709144576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047181.075187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047181.081594:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144576 00000100:00100000:0.0:1784047181.081667:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144576 00000100:00100000:1.0:1784047181.081783:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:1.0:1784047181.081805:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709144576:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1784047181.081815:0:23872:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1784047181.081873:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047181.082002:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709144576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 205us (6814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047181.082010:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:3.0:1784047181.082324:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709144576:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784047182.035060:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047183.061005:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047183.061812:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709144704:0@lo:400:kworker.0 00000100:00100000:0.0:1784047183.061926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047183.062080:0:83309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144704 00000100:00100000:1.0:1784047183.062092:0:83309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144704 00000100:00100000:1.0:1784047183.062191:0:83309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784047183.062203:0:83309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709144704:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784047183.062211:0:83309:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047183.062457:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709145088:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.062537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047183.062629:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145088 00000100:00100000:3.0:1784047183.062636:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145088 00000100:00100000:3.0:1784047183.062708:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1784047183.062718:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709145088:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047183.062724:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047183.062776:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709145088:12345-0@lo:400:kworker.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.062784:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1784047183.062829:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709145088:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.062949:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcd7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709144832:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.062978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047183.063000:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047183.063006:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709144960:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.063029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047183.063056:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144832 00000100:00100000:3.0:1784047183.063062:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144832 00000100:00100000:3.0:1784047183.063088:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709144960 00000100:00100000:3.0:1784047183.063091:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709144960 00000100:00100000:3.0:1784047183.063109:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1784047183.063114:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709144832:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047183.063118:0:66220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047183.063152:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709144832:12345-0@lo:400:kworker.0 Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.063160:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1784047183.063172:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1784047183.063178:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709144960:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047183.063181:0:66220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047183.063210:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709144960:12345-0@lo:400:kworker.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.063216:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1784047183.066724:0:83309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709144704:12345-0@lo:400:kworker.0 Request processed in 4508us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.066745:0:83309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1784047183.066858:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047183.066867:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047183.067453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709144960:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.067497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcd7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709144832:0@lo:400:kworker.0 00000100:00100000:0.0:1784047183.068063:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709144704:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.082060:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047183.082093:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709145344:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.082193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.082293:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709145472:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.082326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.082383:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047183.082390:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709145856:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.082427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.082463:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145344 00000100:00100000:2.0:1784047183.082494:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145344 00000100:00100000:2.0:1784047183.082549:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145856 00000100:00100000:2.0:1784047183.082553:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145856 00000100:00100000:2.0:1784047183.082580:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:2.0:1784047183.082591:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709145344:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784047183.082599:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047183.082680:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:2.0:1784047183.082690:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709145344:12345-0@lo:400:kworker.0 Request processed in 100us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.082692:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709145856:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784047183.082696:0:83733:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047183.082732:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709145856:12345-0@lo:400:kworker.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047183.082963:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:2.0:1784047183.083030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709145856:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.083041:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709145344:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.083094:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709145984:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.083122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.083152:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145472 00000100:00100000:2.0:1784047183.083157:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145472 00000100:00100000:2.0:1784047183.083197:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145984 00000100:00100000:2.0:1784047183.083200:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145984 00000100:00100000:2.0:1784047183.083223:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:2.0:1784047183.083230:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709145472:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784047183.083235:0:26188:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784047183.083272:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709145472:12345-0@lo:400:kworker.0 Request processed in 43us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.083452:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00100000:1.0:1784047183.083512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709145216:0@lo:400:kworker.0 00000100:00100000:1.0:1784047183.083552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047183.083572:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce495a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709145728:0@lo:400:kworker.0 00000100:00100000:1.0:1784047183.083594:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047183.083984:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047183.083994:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709145600:0@lo:400:kworker.0 00000100:00100000:1.0:1784047183.084024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.084148:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:2.0:1784047183.084165:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145600 00000100:00100000:2.0:1784047183.084170:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145600 00000100:00100000:2.0:1784047183.084205:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:2.0:1784047183.084214:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709145984:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784047183.084228:0:26188:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784047183.084270:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709145984:12345-0@lo:400:kworker.0 Request processed in 57us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047183.085336:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:0.0:1784047183.085358:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709145600:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047183.085366:0:26181:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047183.085456:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709145600:12345-0@lo:400:kworker.0 Request processed in 109us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047183.085464:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:3.0:1784047183.085502:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145216 00000100:00100000:2.0:1784047183.085508:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00100000:3.0:1784047183.085519:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145216 00000100:00080000:2.0:1784047183.085553:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047183.085562:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047183.085565:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047183.085599:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709145728 00000100:00100000:2.0:1784047183.085647:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709145984:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.085659:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709145728 00000100:00100000:2.0:1784047183.085669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709145472:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.085711:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1784047183.085724:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709145216:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047183.085733:0:66219:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047183.085832:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709145216:12345-0@lo:400:kworker.0 Request processed in 108us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.085843:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1784047183.085865:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1784047183.085873:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709145728:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047183.085878:0:66219:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784047183.085901:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709146112:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.085910:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709145728:12345-0@lo:400:kworker.0 Request processed in 36us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.085917:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1784047183.086076:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709146240:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.086124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.086170:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709145600:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.086183:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709145216:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.086196:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce495a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709145728:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.086238:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146240 00000100:00100000:2.0:1784047183.086244:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146240 00000100:00100000:2.0:1784047183.086423:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1784047183.086433:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709146240:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784047183.086439:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784047183.086483:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709146240:12345-0@lo:400:kworker.0 Request processed in 51us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047183.086491:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1784047183.086521:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709146240:0@lo:400:kworker.0 00000100:00100000:3.0:1784047183.092586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.093069:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146112 00000100:00100000:2.0:1784047183.093081:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146112 00000100:00100000:2.0:1784047183.093165:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1784047183.093177:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709146112:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784047183.093185:0:13594:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784047183.093268:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709146112:12345-0@lo:400:kworker.0 Request processed in 93us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047183.093276:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00080000:1.0:1784047183.093499:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047183.093597:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709146112:0@lo:400:kworker.0 00000100:00100000:2.0:1784047183.506031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047183.506091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047183.506139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047183.506247:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689385856 00000100:00100000:1.0:1784047183.506258:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689385856 00000100:00100000:1.0:1784047183.506343:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2329 00000100:00100000:1.0:1784047183.506355:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689385856:12345-192.168.204.40@tcp:400:kworker.0 00000020:02000000:1.0:1784047183.506363:0:26183:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047183.506452:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689385856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.506460:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2329 00000100:00080000:2.0:1784047183.506757:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047183.506865:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689385728 00000100:00100000:3.0:1784047183.506870:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689385728 00000100:00100000:3.0:1784047183.506928:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 996 00000100:00100000:3.0:1784047183.506936:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689385728:12345-192.168.204.40@tcp:400:kworker.0 00000020:02000000:3.0:1784047183.506941:0:66219:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047183.506980:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689385728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 45us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.506987:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 996 00000100:00080000:2.0:1784047183.507043:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047183.507118:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689385472 00000100:00100000:0.0:1784047183.507123:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689385472 00000100:00100000:0.0:1784047183.507167:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 153 00000100:00100000:0.0:1784047183.507175:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689385472:12345-192.168.204.40@tcp:400:kworker.0 00000020:02000000:0.0:1784047183.507180:0:83311:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047183.507208:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689385472:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047183.507214:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 153 00000100:00100000:2.0:1784047183.508573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047183.508792:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689385600 00000100:00100000:3.0:1784047183.508800:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689385600 00000100:00100000:3.0:1784047183.508843:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1022 00000100:00100000:3.0:1784047183.508851:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689385600:12345-192.168.204.40@tcp:38:kworker.0 00000020:02000000:3.0:1784047183.508872:0:66221:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1784047183.508900:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t94489280513 exp 0000000000000000 cur 3281 last 0 00000020:00000080:3.0:1784047183.508950:0:66221:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c7738c6 00000004:00100000:3.0:1784047183.508979:0:66221:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784047183.509079:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047183.509146:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689385600:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 293us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047183.509154:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1022 00000100:00100000:1.0:1784047183.564049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047183.564208:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689385984 00000100:00100000:2.0:1784047183.564219:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689385984 00000100:00100000:2.0:1784047183.564291:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1023 00000100:00100000:2.0:1784047183.564303:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:64042:x1870705689385984:12345-192.168.204.40@tcp:41:lfs.0 00000020:02000000:2.0:1784047183.564310:0:66220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784047183.564350:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047183.564437:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:64042:x1870705689385984:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 136us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047183.564445:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1023 00000100:00100000:0.0:1784047183.578983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047183.579147:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386112 00000100:00100000:1.0:1784047183.579161:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386112 00000100:00100000:1.0:1784047183.579212:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4927 00000100:00100000:1.0:1784047183.579229:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2398:x1870705689386112:12345-192.168.204.40@tcp:8:lfs.0 00000020:02000000:1.0:1784047183.579239:0:26187:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1784047183.579274:0:26187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3281 last 0 00000020:00000080:1.0:1784047183.579312:0:26187:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c7738cd 00002000:00100000:1.0:1784047183.579325:0:26187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99cbcd4b6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784047183.579343:0:26187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784047183.579444:0:26187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784047183.579473:0:26187:0:(import.c:65:import_set_state_nolock()) ffff99cbcd4b2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047183.579563:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689386112:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 339us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.579571:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4927 00000001:00100000:3.0:1784047183.583637:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:3.0:1784047183.583653:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968748 is committed 00000100:00100000:0.0:1784047183.585645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047183.586063:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386240 00000100:00100000:1.0:1784047183.586076:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386240 00000100:00100000:1.0:1784047183.586150:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1892 00000100:00100000:1.0:1784047183.586190:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64042:x1870705689386240:12345-192.168.204.40@tcp:13:lfs.0 00000020:02000000:1.0:1784047183.586199:0:39444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1784047183.586233:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047183.586322:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64042:x1870705689386240:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 145us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.586330:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1892 00000100:00100000:3.0:1784047183.590988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047183.591100:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386368 00000100:00100000:0.0:1784047183.591111:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386368 00000100:00100000:0.0:1784047183.591172:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1893 00000100:00100000:0.0:1784047183.591190:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:64042:x1870705689386368:12345-192.168.204.40@tcp:13:lfs.0 00000020:02000000:0.0:1784047183.591197:0:12054:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784047183.591326:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047183.591449:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:64042:x1870705689386368:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 260us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047183.591459:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1893 00000100:00100000:0.0:1784047183.641010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047183.641044:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047183.641126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047183.641234:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146368 00000100:00100000:1.0:1784047183.641243:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146368 00000100:00100000:1.0:1784047183.641310:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1784047183.641319:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709146368:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1784047183.641326:0:39444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1784047183.641350:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047183.641408:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709146368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047183.641415:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1784047183.642401:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047183.642902:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709146496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047183.642949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047183.643206:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146496 00000100:00100000:2.0:1784047183.643213:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146496 00000100:00100000:2.0:1784047183.643266:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:2.0:1784047183.643276:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709146496:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:2.0:1784047183.643297:0:12054:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1784047183.643315:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047183.643361:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709146496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047183.643369:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:0.0:1784047183.644561:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 2 00000100:00100000:0.0:1784047183.644592:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709146496:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1784047183.664263:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968747 is committed 00010000:00010000:3.0:1784047184.083739:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047184.147356:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047184.147395:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709146624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047184.147481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047184.148642:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146624 00000100:00100000:0.0:1784047184.148653:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146624 00000100:00100000:0.0:1784047184.148729:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:0.0:1784047184.148740:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709146624:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1784047184.148749:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1784047184.148794:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047184.148876:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709146624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047184.148883:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:2.0:1784047184.149041:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709146624:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1784047184.661065:0:83304:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00010000:00010000:1.0:1784047185.107083:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047185.171975:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047185.172000:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709146752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047185.172069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047185.172664:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146752 00000100:00100000:0.0:1784047185.172673:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146752 00000100:00100000:0.0:1784047185.172743:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1784047185.172755:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709146752:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1784047185.172762:0:39444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784047185.172789:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047185.172866:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709146752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047185.172873:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1784047185.172922:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709146752:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784047185.173003:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047185.173638:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709146880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047185.173692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047185.173777:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709146880 00000100:00100000:3.0:1784047185.173783:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709146880 00000100:00100000:3.0:1784047185.173831:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:3.0:1784047185.173840:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709146880:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1784047185.173844:0:12054:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784047185.173861:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047185.173897:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709146880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047185.173903:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00080000:2.0:1784047185.174118:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047185.174155:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709146880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047185.873870:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047185.873961:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386496 00000100:00100000:1.0:1784047185.873971:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386496 00000100:00100000:1.0:1784047185.874029:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1024 00000100:00100000:1.0:1784047185.874039:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+5:64135:x1870705689386496:12345-192.168.204.40@tcp:101:lfs.0 00000020:02000000:1.0:1784047185.874047:0:68026:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1784047185.874064:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047185.874086:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7738d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae0d8 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047185.875574:0:68026:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1441us 00010000:00010000:3.0:1784047185.924419:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7738db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.924457:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7738db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.924472:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7738db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047185.924527:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047185.924532:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1784047185.924573:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7738db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.924632:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7738d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0d8 expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.924652:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7738db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0d8 expref: 6 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.924662:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:3.0:1784047185.924665:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047185.924669:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46a00, rc 0) 00000100:00100000:3.0:1784047185.924754:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689386496:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 50715us (50894us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047185.924764:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1024 00000100:00100000:3.0:1784047185.939805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047185.939961:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386624 00000100:00100000:0.0:1784047185.939971:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386624 00000100:00100000:0.0:1784047185.940036:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1025 00000100:00100000:0.0:1784047185.940048:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689386624:12345-192.168.204.40@tcp:41:lfs.0 00000020:02000000:0.0:1784047185.940055:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1784047185.940093:0:67153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047185.940172:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689386624:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 127us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047185.940179:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1025 00000100:00100000:0.0:1784047185.943060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047185.943173:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386752 00000100:00100000:3.0:1784047185.943185:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386752 00000100:00100000:3.0:1784047185.943280:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1026 00000100:00100000:3.0:1784047185.943295:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689386752:12345-192.168.204.40@tcp:41:lfs.0 00000020:02000000:3.0:1784047185.943326:0:66219:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1784047185.943389:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00080000:2.0:1784047185.943494:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047185.943502:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689386752:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 208us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047185.943514:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1026 00000100:00100000:0.0:1784047185.959285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047185.960901:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689386880 00000100:00100000:1.0:1784047185.960939:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689386880 00000100:00100000:1.0:1784047185.961026:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1898 00000100:00100000:1.0:1784047185.961041:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64135:x1870705689386880:12345-192.168.204.40@tcp:13:lfs.0 00000020:02000000:1.0:1784047185.961050:0:39444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1784047185.961084:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047185.961189:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64135:x1870705689386880:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 151us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047185.961198:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1898 00000100:00100000:2.0:1784047185.967699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047185.967764:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387008 00000100:00100000:3.0:1784047185.967780:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387008 00000100:00100000:3.0:1784047185.967925:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1899 00000100:00100000:3.0:1784047185.967935:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689387008:12345-192.168.204.40@tcp:13:lfs.0 00000020:02000000:3.0:1784047185.967948:0:12054:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784047185.967984:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047185.968087:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:64135:x1870705689387008:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047185.968096:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1899 00000100:00080000:2.0:1784047185.968731:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047185.991712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047185.992092:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387136 00000100:00100000:3.0:1784047185.992108:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387136 00000100:00100000:3.0:1784047185.992194:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1027 00000100:00100000:3.0:1784047185.992208:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:63650:x1870705689387136:12345-192.168.204.40@tcp:101:multiop.0 00000020:02000000:3.0:1784047185.992217:0:68026:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1784047185.992242:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047185.992271:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c7738e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae0df expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.992385:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.992413:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.992440:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.992460:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.992467:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047185.992475:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994226:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994250:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994263:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047185.994310:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:2.0:1784047185.994328:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1784047185.994404:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994420:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994432:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994439:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994446:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994454:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994460:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047185.994465:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994473:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994489:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:2.0:1784047185.994492:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047185.994497:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994504:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c7738e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994536:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994543:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994550:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994565:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047185.994569:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994575:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.994585:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff99ccd2342700) 00010000:00010000:2.0:1784047185.994587:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047185.994591:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.995182:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7738f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.995246:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c7738e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0df expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.995265:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0df expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047185.995290:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99cce7f99900) 00010000:00010000:2.0:1784047185.995292:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047185.995295:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1200, rc 0) 00000100:00100000:0.0:1784047185.997144:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:63650:x1870705689387136:12345-192.168.204.40@tcp:101:multiop.0 Request processed in 4921us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047185.997158:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1027 00010000:00010000:2.0:1784047186.137161:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047186.195201:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709147008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047186.195305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047186.196918:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147008 00000100:00100000:0.0:1784047186.196934:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147008 00000100:00100000:0.0:1784047186.197018:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:0.0:1784047186.197031:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709147008:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1784047186.197041:0:8442:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1784047186.197084:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047186.197185:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709147008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047186.197215:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:3.0:1784047186.197436:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709147008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784047187.159499:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047188.182744:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047188.263109:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709147136:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.263396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047188.263505:0:83314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147136 00000100:00100000:1.0:1784047188.263524:0:83314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147136 00000100:00100000:1.0:1784047188.263602:0:83314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784047188.263640:0:83314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709147136:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784047188.263649:0:83314:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047188.264434:0:83314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709147136:12345-0@lo:400:kworker.0 Request processed in 797us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047188.264444:0:83314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784047188.264723:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709147264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.264766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047188.264879:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147264 00000100:00100000:1.0:1784047188.264885:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147264 00000100:00100000:1.0:1784047188.264957:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1784047188.264967:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709147264:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784047188.264972:0:66220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047188.265023:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709147264:12345-0@lo:400:kworker.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047188.265029:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1784047188.265064:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709147264:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.265380:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709147136:0@lo:400:kworker.0 00000100:00100000:1.0:1784047188.268027:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709147392:0@lo:400:kworker.0 00000100:00100000:1.0:1784047188.268129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047188.270469:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147392 00000100:00100000:0.0:1784047188.270484:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147392 00000100:00080000:3.0:1784047188.270689:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047188.270694:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047188.270718:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709147520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.270784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.270835:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147520 00000100:00100000:3.0:1784047188.270839:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147520 00000100:00100000:3.0:1784047188.270889:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1784047188.270899:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709147520:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047188.270907:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047188.270961:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709147520:12345-0@lo:400:kworker.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047188.270969:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1784047188.271041:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709147520:0@lo:400:kworker.0 00000100:00080000:3.0:1784047188.271063:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047188.274784:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1784047188.274805:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709147392:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047188.274813:0:66221:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047188.283493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709148032:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283664:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709148544:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283710:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784047188.283716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709147904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283748:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709148416:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283794:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709147648:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283834:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709148160:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283864:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709148672:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283895:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784047188.283900:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709147776:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.283936:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709148288:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.283953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047188.284576:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147648 00000100:00100000:3.0:1784047188.284587:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147648 00000100:00100000:3.0:1784047188.284664:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148160 00000100:00100000:3.0:1784047188.284679:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148160 00000100:00100000:3.0:1784047188.284693:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148672 00000100:00100000:3.0:1784047188.284695:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148672 00000100:00100000:3.0:1784047188.284708:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1784047188.284716:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd8977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709147648:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047188.284723:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047188.284784:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd8977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709147648:12345-0@lo:400:kworker.0 Request processed in 69us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047188.284791:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1784047188.284805:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1784047188.284810:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709148160:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047188.284813:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047188.284835:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709148160:12345-0@lo:400:kworker.0 Request processed in 25us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047188.284841:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1784047188.284850:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:3.0:1784047188.284855:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709148672:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784047188.284858:0:67153:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784047188.284877:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709148672:12345-0@lo:400:kworker.0 Request processed in 22us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047188.284882:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:3.0:1784047188.284901:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047188.284929:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709147648:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.284937:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709148160:0@lo:400:kworker.0 00000100:00100000:3.0:1784047188.284945:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709148672:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.290130:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709147392:12345-0@lo:400:kworker.0 Request processed in 15320us (21988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.290157:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1784047188.290209:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148032 00000100:00100000:0.0:1784047188.290217:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148032 00000100:00100000:0.0:1784047188.290266:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148544 00000100:00100000:0.0:1784047188.290269:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148544 00000100:00100000:0.0:1784047188.290286:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147904 00000100:00100000:0.0:1784047188.290288:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147904 00000100:00100000:0.0:1784047188.290315:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148416 00000100:00100000:0.0:1784047188.290318:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148416 00000100:00100000:0.0:1784047188.290340:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1784047188.290348:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709148032:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047188.290355:0:26193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047188.290425:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709148032:12345-0@lo:400:kworker.0 Request processed in 76us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.290431:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1784047188.290444:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:0.0:1784047188.290458:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709148544:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047188.290462:0:26193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047188.290493:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709148544:12345-0@lo:400:kworker.0 Request processed in 36us (6806us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.290498:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00100000:0.0:1784047188.290515:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1784047188.290521:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709147904:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047188.290525:0:26193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047188.290557:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709147904:12345-0@lo:400:kworker.0 Request processed in 36us (6822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.290563:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1784047188.290575:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1784047188.290581:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd8974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709148416:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047188.290586:0:26193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047188.290587:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709147392:0@lo:400:kworker.0 00000100:00100000:1.0:1784047188.290667:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709147776 00000100:00100000:1.0:1784047188.290672:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709147776 00000100:00100000:0.0:1784047188.290679:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd8974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709148416:12345-0@lo:400:kworker.0 Request processed in 97us (6907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.290687:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:1.0:1784047188.290708:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148288 00000100:00100000:1.0:1784047188.290713:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148288 00000100:00100000:0.0:1784047188.290729:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:1.0:1784047188.290737:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:0.0:1784047188.290742:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709147776:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784047188.290748:0:8441:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784047188.290751:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709148288:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784047188.290757:0:83733:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784047188.290790:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709147776:12345-0@lo:400:kworker.0 Request processed in 53us (6867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.290796:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000100:00100000:1.0:1784047188.290973:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709148288:12345-0@lo:400:kworker.0 Request processed in 226us (7017us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047188.291049:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709147904:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.291063:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709148416:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.291084:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709148032:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.291094:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968747 gen 2 00000100:00100000:0.0:1784047188.291107:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709148544:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.291144:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc6dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709147776:0@lo:400:kworker.0 00000100:00100000:0.0:1784047188.291154:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709148288:0@lo:400:kworker.0 00000100:00100000:1.0:1784047188.291386:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000100:00080000:2.0:1784047188.291733:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047188.291738:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047188.615453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047188.615505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047188.615536:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047188.615570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047188.615666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047188.615676:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387520 00000100:00100000:0.0:1784047188.615711:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387392 00000100:00100000:3.0:1784047188.615716:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387520 00000100:00100000:0.0:1784047188.615724:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387392 00000100:00100000:0.0:1784047188.615796:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1003 00000100:00100000:3.0:1784047188.615810:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1004 00000100:00100000:3.0:1784047188.615826:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689387520:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047188.615829:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689387392:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047188.615949:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689387392:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 138us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047188.615950:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689387520:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 127us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047188.615976:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1004 00000100:00080000:3.0:1784047188.616018:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047188.616025:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387776 00000100:00100000:2.0:1784047188.616031:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387264 00000100:00100000:1.0:1784047188.616033:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387776 00000100:00100000:2.0:1784047188.616038:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387264 00000100:00100000:2.0:1784047188.616087:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 155 00000100:00100000:2.0:1784047188.616098:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689387264:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047188.616104:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689387648 00000100:00100000:1.0:1784047188.616108:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689387648 00000100:00100000:1.0:1784047188.616136:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2334 00000100:00100000:2.0:1784047188.616138:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689387264:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 41us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047188.616148:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689387776:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047188.616149:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 155 00000100:00100000:1.0:1784047188.616184:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689387776:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 39us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047188.616192:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2334 00000100:00100000:1.0:1784047188.616210:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2335 00000100:00100000:1.0:1784047188.616218:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689387648:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047188.616243:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689387648:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047188.616249:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2335 00000100:00080000:3.0:1784047188.616579:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047188.616753:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1003 00000100:00100000:2.0:1784047188.757412:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709148800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047188.757490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047188.757555:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148800 00000100:00100000:2.0:1784047188.757564:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148800 00000100:00100000:2.0:1784047188.757641:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1784047188.757651:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709148800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047188.757698:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047188.757751:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709148800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047188.757986:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1784047188.758043:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709148800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047188.758639:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047188.758652:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709148928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047188.759162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047188.759642:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709148928 00000100:00100000:2.0:1784047188.759652:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709148928 00000100:00100000:2.0:1784047188.759925:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:2.0:1784047188.759934:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709148928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047188.759963:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047188.760029:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709148928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047188.760036:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1784047188.760128:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709148928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784047189.202959:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047189.267317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709149056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047189.267396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047189.267535:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149056 00000100:00100000:0.0:1784047189.267545:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149056 00000100:00100000:0.0:1784047189.267628:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:0.0:1784047189.267640:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709149056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047189.267711:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047189.267972:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709149056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 334us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047189.267981:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00000100:00100000:3.0:1784047189.270860:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709149056:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784047190.227337:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047190.291523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709149184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047190.291648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047190.294044:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149184 00000100:00100000:0.0:1784047190.294065:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149184 00000100:00100000:0.0:1784047190.294158:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1784047190.294174:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709149184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047190.294212:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047190.295983:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709149312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047190.296091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047190.296476:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149312 00000100:00100000:2.0:1784047190.296487:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149312 00000100:00100000:2.0:1784047190.296558:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1784047190.296570:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709149312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047190.296601:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047190.296700:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709149312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047190.296709:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1784047190.296892:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709149312:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784047190.297762:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047190.297770:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047190.299446:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709149184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5265us (7786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047190.299465:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1784047190.299568:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709149184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047190.475005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047190.475166:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388032 00000100:00100000:0.0:1784047190.475179:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388032 00000100:00100000:0.0:1784047190.475287:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1028 00000100:00100000:0.0:1784047190.475304:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:64253:x1870705689388032:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:0.0:1784047190.475384:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784047190.475421:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c7738f7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0df expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475449:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99cce7f99900) 00010000:00010000:0.0:1784047190.475481:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7738db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0d8 expref: 6 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475492:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:0.0:1784047190.475501:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047190.475551:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475569:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475582:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475598:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475627:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475635:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475759:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475768:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.475775:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784047190.476365:0:66220:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].2, 64 off8320 00000004:00080000:0.0:1784047190.476390:0:66220:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3288728781897ns, next at 3289728778904ns, rc = 0 00010000:00010000:0.0:1784047190.476471:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.476483:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.476493:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.476502:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.476510:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.476516:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477257:0:66220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047190.477328:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477337:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477345:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477352:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbcc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047190.477358:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477387:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477402:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99ccec9b6900) 00010000:00010000:0.0:1784047190.477405:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784047190.477409:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477414:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c77390c lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477441:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477447:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477453:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477459:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477464:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047190.477467:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477474:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477481:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6b00) 00010000:00010000:0.0:1784047190.477488:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047190.477492:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.477498:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7738fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047190.477515:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000548fb3c3 reply state 000000007303b57a transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047190.477522:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047190.477530:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047190.477537:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047190.477541:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047190.477558:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047190.477567:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff99ccec9b6900) 00010000:00010000:2.0:1784047190.477569:0:16469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784047190.477572:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047190.477578:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c773913 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047190.477592:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047190.477593:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047190.477596:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784047190.478022:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784047190.479204:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047190.479233:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff99ccec9b6700) 00010000:00010000:0.0:1784047190.479237:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047190.479243:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047190.479424:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:64253:x1870705689388032:12345-192.168.204.40@tcp:36:rm.0 Request processed in 4119us (4438us total) trans 98784247809 rc 0/0 00000100:00100000:0.0:1784047190.479437:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1028 00010000:00010000:2.0:1784047191.251127:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047191.314883:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047191.314918:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709149440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047191.315019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047191.315107:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149440 00000100:00100000:3.0:1784047191.315117:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149440 00000100:00100000:3.0:1784047191.315189:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:3.0:1784047191.315199:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709149440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047191.315243:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047191.315312:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709149440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047191.315343:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00100000:3.0:1784047191.315418:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709149440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784047192.291361:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047193.333262:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047193.375560:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709149568:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.375692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047193.384014:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709149952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.384122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047193.384379:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149952 00000100:00100000:1.0:1784047193.384391:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149952 00000100:00100000:0.0:1784047193.384399:0:83314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149568 00000100:00100000:0.0:1784047193.384406:0:83314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149568 00000100:00100000:1.0:1784047193.384475:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1784047193.384476:0:83314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784047193.384491:0:83314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709149568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.384498:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709149952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.384563:0:83314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709149568:12345-0@lo:400:kworker.0 Request processed in 76us (8871us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047193.384574:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709149952:12345-0@lo:400:kworker.0 Request processed in 86us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047193.384589:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1784047193.384592:0:83314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784047193.384647:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709149696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.384684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047193.384691:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709149952:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.384715:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047193.384725:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709149824:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.384742:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149696 00000100:00100000:0.0:1784047193.384747:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149696 00000100:00100000:1.0:1784047193.384760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047193.384846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047193.384884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709149568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.384964:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047193.384972:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709150208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.385029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047193.385064:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150208 00000100:00100000:3.0:1784047193.385068:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150208 00000100:00100000:3.0:1784047193.385109:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:3.0:1784047193.385116:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709150208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.385407:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709149824 00000100:00100000:0.0:1784047193.385411:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709149824 00000100:00100000:0.0:1784047193.385435:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1784047193.385442:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709149696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.385454:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1784047193.385467:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.388820:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709149696:12345-0@lo:400:kworker.0 Request processed in 3361us (4117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047193.388829:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709149824:12345-0@lo:400:kworker.0 Request processed in 3362us (4065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047193.388845:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1784047193.388852:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1784047193.388914:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047193.388960:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709149824:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.388977:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709149696:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.390364:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709150592:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.390439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047193.390477:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150592 00000100:00100000:0.0:1784047193.390485:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150592 00000100:00100000:0.0:1784047193.390545:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1784047193.390555:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709150592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.390640:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709150592:12345-0@lo:400:kworker.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047193.390648:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1784047193.390694:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709150592:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.390701:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709151104:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.390726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047193.390759:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784047193.390775:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709150464:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.390806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047193.390833:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150464 00000100:00100000:0.0:1784047193.390837:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150464 00000100:00100000:0.0:1784047193.390883:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:0.0:1784047193.390890:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709150464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391050:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709150208:12345-0@lo:400:kworker.0 Request processed in 5932us (6018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.391063:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000100:00080000:3.0:1784047193.391094:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047193.391100:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047193.391121:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709150336:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047193.391308:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709150848:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047193.391365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709150208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047193.391385:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709150720:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047193.391454:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150336 00000100:00100000:3.0:1784047193.391458:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150336 00000100:00100000:3.0:1784047193.391495:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150848 00000100:00100000:3.0:1784047193.391499:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150848 00000100:00100000:3.0:1784047193.391523:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:3.0:1784047193.391530:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709150336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391570:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709150336:12345-0@lo:400:kworker.0 Request processed in 40us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.391576:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:3.0:1784047193.391588:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:3.0:1784047193.391594:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709150848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391641:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709150848:12345-0@lo:400:kworker.0 Request processed in 47us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.391648:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:3.0:1784047193.391671:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150720 00000100:00100000:3.0:1784047193.391675:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150720 00000100:00100000:3.0:1784047193.391701:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:3.0:1784047193.391707:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709150720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391740:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709150720:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.391747:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00000100:00080000:3.0:1784047193.391761:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047193.391783:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709150720:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391793:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709150336:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391801:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709150848:0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.391892:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709150080:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.392052:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151104 00000100:00100000:1.0:1784047193.392057:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151104 00000100:00100000:1.0:1784047193.392096:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1784047193.392104:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709151104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.392278:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709151104:12345-0@lo:400:kworker.0 Request processed in 175us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047193.392285:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1784047193.393108:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709150464:12345-0@lo:400:kworker.0 Request processed in 2212us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047193.393122:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00100000:3.0:1784047193.393316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047193.394953:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709150464:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.394975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709150976:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.395053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047193.395108:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709151104:0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.395396:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150080 00000100:00100000:0.0:1784047193.395407:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150080 00000100:00100000:0.0:1784047193.395491:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1784047193.395502:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709150080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047193.395567:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709150080:12345-0@lo:400:kworker.0 Request processed in 67us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047193.395574:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1784047193.395713:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709150976 00000100:00100000:3.0:1784047193.395719:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709150976 00000100:00100000:3.0:1784047193.395772:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1784047193.395780:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709150976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047193.395824:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709150976:12345-0@lo:400:kworker.0 Request processed in 46us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.395831:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00080000:3.0:1784047193.395852:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047193.395857:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047193.395885:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709150080:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.396490:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709150976:0@lo:400:kworker.0 00000100:00100000:1.0:1784047193.736354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047193.736417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047193.736453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047193.737119:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388288 00000100:00100000:3.0:1784047193.737145:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388288 00000100:00100000:3.0:1784047193.737250:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1011 00000100:00100000:3.0:1784047193.737264:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689388288:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047193.737380:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689388288:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 118us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.737389:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1011 00000100:00080000:3.0:1784047193.737422:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047193.743978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047193.744087:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388160 00000100:00100000:2.0:1784047193.744102:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388160 00000100:00100000:2.0:1784047193.744217:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 157 00000100:00100000:2.0:1784047193.744230:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689388160:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047193.744345:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689388160:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 117us (7889us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047193.744355:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 157 00000100:00100000:1.0:1784047193.744908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047193.744949:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388544 00000100:00100000:1.0:1784047193.744956:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388544 00000100:00100000:3.0:1784047193.745108:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388672 00000100:00100000:3.0:1784047193.745113:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388672 00000100:00100000:3.0:1784047193.745175:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2340 00000100:00100000:3.0:1784047193.745185:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689388672:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047193.745251:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689388672:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047193.745278:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2340 00000100:00080000:3.0:1784047193.745306:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047193.745311:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047193.745629:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2341 00000100:00100000:1.0:1784047193.745639:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689388544:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047193.745679:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689388544:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 43us (9261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047193.745686:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2341 00000100:00100000:2.0:1784047193.746328:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388416 00000100:00100000:2.0:1784047193.746336:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388416 00000100:00100000:2.0:1784047193.746403:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1012 00000100:00100000:2.0:1784047193.746412:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689388416:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047193.746456:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689388416:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 45us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047193.746475:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1012 00000100:00080000:3.0:1784047193.746923:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1784047193.875599:0:83324:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3292127988778ns, next at 3293127984986ns, rc = 0 00000100:00100000:0.0:1784047193.875664:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709151232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047193.875752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047193.876036:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151232 00000100:00100000:2.0:1784047193.876046:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151232 00000100:00100000:2.0:1784047193.876118:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1784047193.876130:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709151232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047193.876184:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047193.876265:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709151232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047193.876273:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1784047193.876332:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709151232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047193.878912:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047193.879141:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709151360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047193.879258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047193.879510:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151360 00000100:00100000:1.0:1784047193.879521:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151360 00000100:00100000:1.0:1784047193.879593:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:1.0:1784047193.879624:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709151360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047193.879684:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047193.879750:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709151360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047193.879758:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:2.0:1784047193.880778:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709151360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784047194.387010:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047194.387020:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709151488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047194.387121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047194.387303:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151488 00000100:00100000:0.0:1784047194.387314:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151488 00000100:00100000:0.0:1784047194.387393:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:0.0:1784047194.387405:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709151488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047194.387554:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047194.387651:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709151488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 247us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047194.387675:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:3.0:1784047194.388400:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709151488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047195.414101:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047195.414135:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709151616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047195.414247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047195.414325:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151616 00000100:00100000:1.0:1784047195.414337:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151616 00000100:00100000:1.0:1784047195.414431:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1784047195.414456:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709151616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047195.414495:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047195.414552:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709151616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047195.414561:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00080000:1.0:1784047195.414586:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047195.414671:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709151616:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047195.416247:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047195.419810:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709151744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047195.419912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047195.420193:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151744 00000100:00100000:2.0:1784047195.420205:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151744 00000100:00100000:2.0:1784047195.420293:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:2.0:1784047195.420307:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709151744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047195.420335:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047195.420406:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709151744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047195.420770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709151744:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047195.420868:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047195.421525:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00010000:00010000:2.0:1784047196.436849:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047196.448782:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047196.448816:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709151872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047196.448907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047196.449182:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709151872 00000100:00100000:0.0:1784047196.449202:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709151872 00000100:00100000:0.0:1784047196.449601:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:0.0:1784047196.449663:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709151872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047196.449713:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047196.449784:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709151872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047196.449792:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1784047196.449886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709151872:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1784047196.958867:0:83304:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1784047196.958932:0:83304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:1.0:1784047196.958940:0:83304:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1784047196.958975:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.958990:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.959013:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.959020:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047196.959026:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.959036:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.959063:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff99ccec9b6700) 00010000:00010000:1.0:1784047196.959066:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047196.959072:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.959080:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c773905 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047196.961820:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709152000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784047196.961926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047196.963529:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152000 00000100:00100000:3.0:1784047196.963547:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152000 00000100:00100000:3.0:1784047196.963666:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:3.0:1784047196.963682:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709152000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784047196.963728:0:26189:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1698 count 1 00010000:00010000:3.0:1784047196.963763:0:26189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047196.963795:0:26189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 5 pid: 26187 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047196.963820:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=221s v=(0 0) 00010000:00010000:3.0:1784047196.963825:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047196.963832:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047196.963882:0:26189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 5 pid: 26187 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047196.963900:0:26189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 5 pid: 26187 timeout: 3395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047196.963918:0:26189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:26189:1870705709152128:192.168.204.40@tcp:104: 00000100:00100000:3.0:1784047196.964029:0:26189:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8000 going to sleep for 11 seconds 00000100:00080000:3.0:1784047196.964045:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047196.967300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047196.976851:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388800 00000100:00100000:2.0:1784047196.976872:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388800 00010000:00010000:2.0:1784047196.976968:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 6 pid: 26187 timeout: 3395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047196.977030:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2530 00000100:00100000:2.0:1784047196.977043:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689388800:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784047196.977064:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047196.977071:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 6 pid: 26187 timeout: 3395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.977089:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 6 pid: 26187 timeout: 3395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.977146:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047196.977152:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047196.977160:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.977171:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.977201:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047196.982670:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689388800:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 5609us (15362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047196.982691:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2530 00010000:00010000:2.0:1784047196.982807:0:26189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c7734ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0b5 expref: 5 pid: 26187 timeout: 3395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047196.982849:0:26189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:26189:1870705709152128:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047196.982883:0:26189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.982897:0:26189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.982905:0:26189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.982919:0:26189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.982929:0:26189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047196.982953:0:26189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784047196.983246:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709152000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19568us (21318us total) trans 4294968748 rc 0/0 00000100:00100000:2.0:1784047196.983257:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00010000:00010000:1.0:1784047196.997548:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047196.997592:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.997632:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047196.997639:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.997659:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047196.997908:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ccf2c15c00/2, rc 0, transno 4294968748 00000100:00100000:3.0:1784047196.997924:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709152000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784047196.998036:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.998045:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c77391a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047196.998074:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047196.998076:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047196.998079:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047196.998726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784047197.459600:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047198.482994:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047198.483406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709152384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.483582:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709152640:0@lo:400:kworker.0 00000100:00100000:1.0:1784047198.483637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047198.483663:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709152512:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.483778:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709152256:0@lo:400:kworker.0 00000100:00100000:2.0:1784047198.483816:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152384 00000100:00100000:2.0:1784047198.483826:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152384 00000100:00100000:2.0:1784047198.483910:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1784047198.483922:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709152384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.484052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047198.484095:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709153024:0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.484135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047198.484167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709153536:0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.484193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047198.484233:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152512 00000100:00100000:3.0:1784047198.484237:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152512 00000100:00100000:3.0:1784047198.484272:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1784047198.484279:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709152512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.484320:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709152512:12345-0@lo:400:kworker.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047198.484328:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1784047198.484363:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153024 00000100:00100000:0.0:1784047198.486988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.487057:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709152768:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.487151:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709153280:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.487193:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709153792:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.487275:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153536 00000100:00100000:0.0:1784047198.487285:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153536 00000100:00100000:0.0:1784047198.487364:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:0.0:1784047198.487378:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709153536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487443:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709153536:12345-0@lo:400:kworker.0 Request processed in 69us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.487450:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:0.0:1784047198.487507:0:83314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152256 00000100:00100000:0.0:1784047198.487511:0:83314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152256 00000100:00100000:0.0:1784047198.487540:0:83314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784047198.487545:0:83314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709152256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487581:0:83314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709152256:12345-0@lo:400:kworker.0 Request processed in 36us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.487587:0:83314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784047198.487638:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152768 00000100:00100000:0.0:1784047198.487642:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152768 00000100:00100000:0.0:1784047198.487665:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153280 00000100:00100000:0.0:1784047198.487668:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153280 00000100:00100000:0.0:1784047198.487692:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153792 00000100:00100000:0.0:1784047198.487695:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153792 00000100:00100000:0.0:1784047198.487709:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1784047198.487716:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709152768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487749:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709152768:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.487755:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1784047198.487766:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1784047198.487773:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709153280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487798:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709153280:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.487804:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1784047198.487815:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1784047198.487820:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709153792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487845:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709153792:12345-0@lo:400:kworker.0 Request processed in 25us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.487861:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1784047198.487923:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709152256:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487938:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709152768:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487946:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709153280:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.487954:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709153792:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.488077:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709153152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.488139:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709153664:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.488192:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153152 00000100:00100000:0.0:1784047198.488197:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153152 00000100:00100000:0.0:1784047198.488234:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153664 00000100:00100000:0.0:1784047198.488237:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153664 00000100:00100000:0.0:1784047198.488256:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:0.0:1784047198.488262:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709153152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488301:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709153152:12345-0@lo:400:kworker.0 Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.488307:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:0.0:1784047198.488317:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1784047198.488323:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709153664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488351:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709153664:12345-0@lo:400:kworker.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.488357:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1784047198.488393:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709153152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488403:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709153664:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488421:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152640 00000100:00100000:0.0:1784047198.488424:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152640 00000100:00100000:0.0:1784047198.488450:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1784047198.488456:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709152640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488489:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709152640:12345-0@lo:400:kworker.0 Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.488497:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1784047198.488522:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709152640:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488580:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709152512:0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.488596:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709153536:0@lo:400:kworker.0 00000100:00080000:0.0:1784047198.488655:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047198.488661:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047198.488665:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047198.488668:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047198.489503:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153024 00000100:00080000:3.0:1784047198.489556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047198.489618:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:3.0:1784047198.489628:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709153024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.489698:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709153024:12345-0@lo:400:kworker.0 Request processed in 72us (5562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047198.489705:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000100:00100000:3.0:1784047198.489756:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709153024:0@lo:400:kworker.0 00000100:00100000:2.0:1784047198.490246:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709152384:12345-0@lo:400:kworker.0 Request processed in 6325us (6606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047198.490259:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1784047198.494538:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709152384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.494563:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709152896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.494675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047198.494720:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709153408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047198.494744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047198.495137:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709152896 00000100:00100000:0.0:1784047198.495147:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709152896 00000100:00100000:0.0:1784047198.495213:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153408 00000100:00100000:0.0:1784047198.495216:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153408 00000100:00100000:0.0:1784047198.495241:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:0.0:1784047198.495251:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709152896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.495595:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709152896:12345-0@lo:400:kworker.0 Request processed in 344us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.495604:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00100000:0.0:1784047198.495650:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:0.0:1784047198.495665:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709153408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047198.495714:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709153408:12345-0@lo:400:kworker.0 Request processed in 50us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.495721:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:2.0:1784047198.495882:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709152896:0@lo:400:kworker.0 00000100:00100000:2.0:1784047198.495895:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709153408:0@lo:400:kworker.0 00000100:00100000:1.0:1784047198.854974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047198.855028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047198.855059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047198.855085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047198.855128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047198.855165:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389440 00000100:00100000:1.0:1784047198.855177:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389440 00000100:00100000:1.0:1784047198.855287:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389312 00000100:00100000:1.0:1784047198.855291:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389312 00000100:00100000:1.0:1784047198.855871:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2346 00000100:00100000:1.0:1784047198.855889:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689389440:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047198.855991:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689389440:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 107us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047198.855999:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2346 00000100:00100000:1.0:1784047198.856031:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2347 00000100:00100000:1.0:1784047198.856039:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689389312:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047198.856069:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689389312:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047198.856076:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2347 00000100:00100000:0.0:1784047198.856135:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689388928 00000100:00100000:0.0:1784047198.856141:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689388928 00000100:00100000:0.0:1784047198.856196:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 159 00000100:00100000:0.0:1784047198.856204:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689388928:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047198.856234:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689388928:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.856241:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 159 00000100:00100000:0.0:1784047198.856283:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389184 00000100:00100000:0.0:1784047198.856287:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389184 00000100:00100000:0.0:1784047198.856333:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389056 00000100:00100000:0.0:1784047198.856337:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389056 00000100:00100000:0.0:1784047198.856365:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1019 00000100:00100000:0.0:1784047198.856371:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689389184:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047198.856412:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689389184:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.856419:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1019 00000100:00100000:0.0:1784047198.856431:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1020 00000100:00100000:0.0:1784047198.856438:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689389056:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047198.856461:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689389056:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047198.856467:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1020 00000100:00080000:0.0:1784047198.856532:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047198.856537:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047198.856540:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047198.856542:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047198.995038:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047198.995074:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709153920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047198.995188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047198.995233:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709153920 00000100:00100000:2.0:1784047198.995235:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709154048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047198.995244:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709153920 00000100:00100000:2.0:1784047198.995266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047198.995419:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154048 00000100:00100000:2.0:1784047198.995424:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154048 00000100:00100000:1.0:1784047198.995434:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:1.0:1784047198.995450:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709153920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047198.995503:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047198.995520:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1784047198.995529:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709154048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047198.995551:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047198.995572:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709153920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047198.995581:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1784047198.995594:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709154048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047198.995602:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1784047199.002176:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709154048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047199.002209:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709153920:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1784047199.038496:0:84033:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 12:39:56 (1784047196) 00000100:00100000:1.0:1784047199.507055:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709154176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047199.507179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047199.507737:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047199.507809:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154176 00000100:00100000:0.0:1784047199.507821:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154176 00000100:00100000:0.0:1784047199.507941:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1784047199.507955:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709154176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047199.508011:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047199.508082:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709154176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047199.508104:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:1.0:1784047199.508201:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709154176:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1784047200.129143:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968748 is committed 00000100:00100000:1.0:1784047200.241498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047200.244322:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389568 00000100:00100000:2.0:1784047200.244344:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389568 00000100:00100000:2.0:1784047200.244461:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1029 00000100:00100000:2.0:1784047200.244497:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+5:64842:x1870705689389568:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047200.244526:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047200.244557:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae0e6 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.244666:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.244685:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.244701:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047200.244765:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047200.244770:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1784047200.244801:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.244833:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0e6 expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.244854:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0e6 expref: 6 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.244864:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce7f99300) 00010000:00010000:2.0:1784047200.244867:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047200.244872:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1e00, rc 0) 00000100:00080000:3.0:1784047200.245057:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047200.245181:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:64842:x1870705689389568:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 688us (3695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047200.245190:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1029 00000100:00100000:2.0:1784047200.249523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047200.249734:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389696 00000100:00100000:3.0:1784047200.249766:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389696 00000100:00100000:3.0:1784047200.249838:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1030 00000100:00100000:3.0:1784047200.249852:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64842:x1870705689389696:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047200.249911:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:3.0:1784047200.250015:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64842:x1870705689389696:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 165us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047200.250023:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1030 00000100:00100000:3.0:1784047200.257060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047200.259018:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389824 00000100:00100000:0.0:1784047200.259039:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389824 00000100:00100000:0.0:1784047200.259155:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1031 00000100:00100000:0.0:1784047200.259172:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:64842:x1870705689389824:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047200.259249:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047200.259370:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:64842:x1870705689389824:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 202us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047200.259379:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1031 00000100:00080000:3.0:1784047200.259516:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047200.264563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047200.264790:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689389952 00000100:00100000:3.0:1784047200.264803:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689389952 00000100:00100000:3.0:1784047200.264896:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1910 00000100:00100000:3.0:1784047200.264909:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64842:x1870705689389952:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047200.264944:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047200.265042:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64842:x1870705689389952:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 134us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047200.265050:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1910 00000100:00080000:1.0:1784047200.265709:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047200.274522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047200.274744:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390080 00000100:00100000:2.0:1784047200.274768:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390080 00000100:00100000:2.0:1784047200.274844:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1911 00000100:00100000:2.0:1784047200.274857:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64842:x1870705689390080:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047200.274894:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047200.274982:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:64842:x1870705689390080:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 127us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047200.274991:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1911 00000100:00080000:2.0:1784047200.275017:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047200.379313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047200.382266:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390208 00000100:00100000:0.0:1784047200.383197:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390208 00000100:00100000:1.0:1784047200.383407:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1784047200.383437:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64849:x1870705689390208:12345-192.168.204.40@tcp:700:mcreate.0 00000100:00100000:1.0:1784047200.383667:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64849:x1870705689390208:12345-192.168.204.40@tcp:700:mcreate.0 Request processed in 246us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047200.383676:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:3.0:1784047200.403341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047200.403436:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390464 00000100:00100000:3.0:1784047200.403449:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390464 00000100:00100000:3.0:1784047200.403521:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1032 00000100:00100000:3.0:1784047200.403548:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:64849:x1870705689390464:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00010000:3.0:1784047200.403647:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047200.403686:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0e6 expref: 6 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.403725:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce7f99300) 00010000:00010000:3.0:1784047200.403741:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047200.403830:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.403848:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.403860:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.403874:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.403882:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.403888:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405884:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405906:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405914:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405924:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405947:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047200.405953:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405962:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405982:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cceca13800) 00010000:00010000:3.0:1784047200.405986:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047200.405991:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.405998:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77392f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047200.406021:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009cbb6574 reply state 00000000ff0bd2b3 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.406037:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.406044:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13700) 00010000:00010000:3.0:1784047200.406047:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047200.406050:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047200.406775:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:64849:x1870705689390464:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 3233us (3440us total) trans 98784247810 rc 0/0 00000100:00100000:3.0:1784047200.406787:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1032 00000100:00100000:3.0:1784047200.443958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047200.444118:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390592 00000100:00100000:1.0:1784047200.444130:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390592 00000100:00100000:1.0:1784047200.444241:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1033 00000100:00100000:1.0:1784047200.444254:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:64852:x1870705689390592:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047200.444292:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047200.444325:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77393d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae0ed expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.444417:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c773944 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.444435:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c773944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.444451:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c773944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047200.444521:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047200.444525:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1784047200.444560:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c773944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.445952:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77393d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0ed expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.445987:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c773944 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0ed expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.445997:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa900) 00010000:00010000:1.0:1784047200.446000:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047200.446003:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a400, rc 0) 00000100:00100000:1.0:1784047200.447561:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:64852:x1870705689390592:12345-192.168.204.40@tcp:101:rm.0 Request processed in 3293us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047200.447576:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1033 00000100:00100000:3.0:1784047200.450976:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047200.451083:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390720 00000100:00100000:1.0:1784047200.451098:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390720 00000100:00100000:1.0:1784047200.451198:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1034 00000100:00100000:1.0:1784047200.451214:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:64852:x1870705689390720:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047200.451243:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047200.451273:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c77394b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae0f4 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451370:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451389:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451403:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451436:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451445:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451453:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451583:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451594:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451601:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047200.451705:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:1.0:1784047200.451711:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1784047200.451737:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451751:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451762:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451769:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451787:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451794:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451801:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047200.451806:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451814:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451828:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa900) 00010000:00010000:1.0:1784047200.451832:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047200.451838:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451845:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c773952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451862:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451869:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451875:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451880:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047200.451890:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451897:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451905:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13700) 00010000:00010000:1.0:1784047200.451908:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047200.451910:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.451916:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c773959 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.452284:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c77394b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0f4 expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.452300:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0f4 expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047200.452307:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99ccc12aaf00) 00010000:00010000:1.0:1784047200.452310:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047200.452312:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b000, rc 0) 00000100:00100000:0.0:1784047200.455481:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:64852:x1870705689390720:12345-192.168.204.40@tcp:101:rm.0 Request processed in 4249us (4499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047200.455499:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1034 00000100:00100000:2.0:1784047200.459586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047200.459848:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390976 00000100:00100000:3.0:1784047200.459879:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390976 00000100:00100000:3.0:1784047200.459959:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1035 00000100:00100000:3.0:1784047200.459972:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ba2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:64852:x1870705689390976:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:3.0:1784047200.460044:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784047200.460093:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773960 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0f4 expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460122:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99ccc12aaf00) 00010000:00010000:3.0:1784047200.460141:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c773944 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0ed expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460152:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa900) 00010000:00010000:3.0:1784047200.460158:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047200.460356:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460373:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460385:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460398:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460406:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460413:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460532:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460541:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.460548:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461070:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461094:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461104:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461112:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461120:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461127:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461153:0:66219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047200.461190:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461198:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461213:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461220:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047200.461225:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461234:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461246:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99cceca13600) 00010000:00010000:3.0:1784047200.461249:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784047200.461254:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461261:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47400/0x4426598c0c773975 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461294:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461300:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461306:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461313:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461318:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047200.461328:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461335:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461344:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cceca13800) 00010000:00010000:3.0:1784047200.461346:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047200.461349:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461355:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c773967 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047200.461370:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000735e8b49 reply state 00000000b5fcc149 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461382:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047200.461387:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13700) 00010000:00010000:3.0:1784047200.461389:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047200.461392:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047200.461509:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ba2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:64852:x1870705689390976:12345-192.168.204.40@tcp:36:rm.0 Request processed in 1535us (1935us total) trans 98784247811 rc 0/0 00000100:00100000:3.0:1784047200.461519:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1035 00010000:00010000:2.0:1784047200.465749:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047200.465773:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.465789:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047200.465794:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.465806:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.465831:0:15071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99cceca13600) 00010000:00010000:2.0:1784047200.465835:0:15071:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784047200.465840:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.465847:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c77397c lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047200.465891:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047200.465893:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047200.465922:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047200.531753:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709154304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047200.531877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047200.532056:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154304 00000100:00100000:1.0:1784047200.532068:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154304 00000100:00100000:1.0:1784047200.532312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1784047200.532328:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709154304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047200.532360:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047200.532418:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709154304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047200.532445:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1784047200.532512:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709154304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047200.532989:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709154432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047200.533038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047200.533093:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154432 00000100:00100000:2.0:1784047200.533101:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154432 00000100:00100000:2.0:1784047200.533353:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:2.0:1784047200.533360:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709154432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047200.533378:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047200.533417:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709154432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047200.533424:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:2.0:1784047200.533463:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709154432:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784047200.533978:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784047200.534040:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047200.534047:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047201.555282:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709154560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047201.555400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047201.555556:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154560 00000100:00100000:2.0:1784047201.555564:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154560 00000100:00100000:2.0:1784047201.555652:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1784047201.555663:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709154560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047201.555712:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047201.555781:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709154560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047201.555789:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:3.0:1784047201.555884:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709154560:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784047201.556674:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047202.586460:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047203.605901:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047203.614250:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709154688:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614415:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709155200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614469:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709155712:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614516:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784047203.614523:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709154816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709155328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614647:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709155840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709154944:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709155456:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.614961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.614981:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709155968:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.615000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.615031:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784047203.615037:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709155072:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.615059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.615096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709155584:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.615118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.615274:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709156096:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.615303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047203.615350:0:83314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154688 00000100:00100000:3.0:1784047203.615359:0:83314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154688 00000100:00100000:3.0:1784047203.615425:0:83314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784047203.615435:0:83314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709154688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.615496:0:83314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709154688:12345-0@lo:400:kworker.0 Request processed in 61us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047203.615505:0:83314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784047203.615816:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047203.615828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709156224:0@lo:400:kworker.0 00000100:00100000:2.0:1784047203.615988:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155200 00000100:00100000:2.0:1784047203.615995:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155200 00000100:00100000:2.0:1784047203.616054:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155712 00000100:00100000:2.0:1784047203.616058:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155712 00000100:00100000:2.0:1784047203.616098:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154816 00000100:00100000:2.0:1784047203.616101:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154816 00000100:00100000:2.0:1784047203.616115:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709154944 00000100:00100000:2.0:1784047203.616117:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709154944 00000100:00100000:2.0:1784047203.616141:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155072 00000100:00100000:2.0:1784047203.616145:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155072 00000100:00100000:2.0:1784047203.616160:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1784047203.616167:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709155200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.619969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047203.620866:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156224 00000100:00100000:0.0:1784047203.620880:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156224 00000100:00100000:0.0:1784047203.620948:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1784047203.620960:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709155712:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047203.620999:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef514a80 x1870705709155712/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:334/0 lens 224/224 e 0 to 0 dl 1784047214 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047203.621097:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709155712:12345-0@lo:400:kworker.0 Request processed in 139us (6605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621105:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1784047203.621140:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1784047203.621149:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709154816:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047203.621163:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef516a00 x1870705709154816/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:334/0 lens 224/224 e 0 to 0 dl 1784047214 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047203.621192:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709154816:12345-0@lo:400:kworker.0 Request processed in 45us (6629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621200:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1784047203.621213:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1784047203.621235:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709154944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.621285:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709154944:12345-0@lo:400:kworker.0 Request processed in 66us (6377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621292:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1784047203.621304:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1784047203.621311:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709155072:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047203.621323:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef517800 x1870705709155072/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:334/0 lens 224/224 e 0 to 0 dl 1784047214 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047203.621348:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709155072:12345-0@lo:400:kworker.0 Request processed in 38us (6288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621359:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1784047203.621371:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1784047203.621377:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709156224:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047203.621388:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca63480 x1870705709156224/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:334/0 lens 224/224 e 0 to 0 dl 1784047214 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047203.621423:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709156224:12345-0@lo:400:kworker.0 Request processed in 47us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621430:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1784047203.621457:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155456 00000100:00100000:0.0:1784047203.621462:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155456 00000100:00100000:0.0:1784047203.621496:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155968 00000100:00100000:0.0:1784047203.621499:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155968 00000100:00100000:0.0:1784047203.621520:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155584 00000100:00100000:0.0:1784047203.621523:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155584 00000100:00100000:0.0:1784047203.621834:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156096 00000100:00100000:0.0:1784047203.621839:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156096 00000100:00100000:0.0:1784047203.621864:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:0.0:1784047203.621870:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709155456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.621911:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709155456:12345-0@lo:400:kworker.0 Request processed in 41us (6949us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621918:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00100000:0.0:1784047203.621929:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:0.0:1784047203.621935:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709155968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.621964:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709155968:12345-0@lo:400:kworker.0 Request processed in 30us (6962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.621969:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:0.0:1784047203.621990:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1784047203.621995:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709155584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.622044:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709155584:12345-0@lo:400:kworker.0 Request processed in 48us (6925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.622050:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1784047203.622061:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:0.0:1784047203.622066:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709156096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.622092:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709156096:12345-0@lo:400:kworker.0 Request processed in 27us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.622098:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:0.0:1784047203.622142:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155328 00000100:00100000:0.0:1784047203.622146:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155328 00000100:00100000:0.0:1784047203.622179:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709155840 00000100:00100000:0.0:1784047203.622182:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709155840 00000100:00100000:0.0:1784047203.622201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:0.0:1784047203.622207:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709155328:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047203.622357:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef515c00 x1870705709155328/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:334/0 lens 224/224 e 0 to 0 dl 1784047214 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047203.622390:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709155328:12345-0@lo:400:kworker.0 Request processed in 183us (7762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.622397:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:0.0:1784047203.622411:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:0.0:1784047203.622417:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709155840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.622450:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709155840:12345-0@lo:400:kworker.0 Request processed in 34us (7780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.622457:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:0.0:1784047203.622697:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709156224:0@lo:400:kworker.0 00000100:00080000:0.0:1784047203.626030:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047203.626043:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047203.626048:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047203.626052:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047203.626157:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709155072:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626179:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709155584:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626192:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 2 00000004:00080000:0.0:1784047203.626199:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ccf2c15c00, transno 4294968748 00000100:00100000:0.0:1784047203.626227:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709156096:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626244:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709154944:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626259:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709155456:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709155968:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626466:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709154816:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626481:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709155328:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626493:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709155840:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626505:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709154688:0@lo:400:kworker.0 00000100:00100000:0.0:1784047203.626519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709155712:0@lo:400:kworker.0 00000100:00100000:2.0:1784047203.630334:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709155200:12345-0@lo:400:kworker.0 Request processed in 14152us (15870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047203.630354:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1784047203.630479:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709155200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047203.972865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047203.972931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047203.972964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047203.972994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047203.973053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047203.973101:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391616 00000100:00100000:3.0:1784047203.973126:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391616 00000100:00100000:3.0:1784047203.973212:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391488 00000100:00100000:3.0:1784047203.973216:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391488 00000100:00100000:3.0:1784047203.973269:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2352 00000100:00100000:3.0:1784047203.973284:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689391616:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047203.973394:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689391616:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 113us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047203.973403:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2352 00000100:00100000:3.0:1784047203.973427:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2353 00000100:00100000:3.0:1784047203.973437:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689391488:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047203.973485:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689391488:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047203.973493:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2353 00000100:00100000:0.0:1784047203.977017:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391104 00000100:00100000:0.0:1784047203.977039:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391104 00000100:00100000:0.0:1784047203.977159:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 161 00000100:00100000:0.0:1784047203.977170:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689391104:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047203.977251:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689391104:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 83us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.977260:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 161 00000100:00100000:0.0:1784047203.977319:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391360 00000100:00100000:0.0:1784047203.977326:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391360 00000100:00100000:0.0:1784047203.977378:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391232 00000100:00100000:0.0:1784047203.977383:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391232 00000100:00100000:0.0:1784047203.977413:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1027 00000100:00100000:0.0:1784047203.977420:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689391360:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047203.977455:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689391360:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (4534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.977463:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1027 00000100:00100000:0.0:1784047203.977475:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1028 00000100:00100000:0.0:1784047203.977481:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:2402:x1870705689391232:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:0.0:1784047203.977499:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062d880 x1870705689391232/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:334/0 lens 224/224 e 0 to 0 dl 1784047214 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047203.977521:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:2402:x1870705689391232:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047203.977528:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1028 00000100:00080000:0.0:1784047203.977549:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047203.977553:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047203.977556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047203.977559:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047204.115985:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047204.116027:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709156480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047204.116114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047204.116192:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156480 00000100:00100000:1.0:1784047204.116201:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156480 00000100:00100000:1.0:1784047204.116280:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1784047204.116291:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709156480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047204.116329:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047204.116383:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709156480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047204.116393:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1784047204.116453:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709156480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047204.116870:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709156352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047204.116959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047204.117035:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156352 00000100:00100000:2.0:1784047204.117044:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156352 00000100:00100000:2.0:1784047204.117107:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1784047204.117127:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709156352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047204.117147:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047204.117217:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709156352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047204.117224:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1784047204.117312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709156352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784047204.627956:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047204.635105:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047204.635139:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709156608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047204.635208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047204.635346:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156608 00000100:00100000:0.0:1784047204.635354:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156608 00000100:00100000:0.0:1784047204.635410:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1784047204.635420:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709156608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047204.635453:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00010000:00000080:0.0:1784047204.635468:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00d9d500 x1870705709156608/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:335/0 lens 224/368 e 0 to 0 dl 1784047215 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047204.635514:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709156608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047204.635521:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1784047204.635570:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709156608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047205.650919:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709156736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047205.651039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047205.651106:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156736 00000100:00100000:3.0:1784047205.651119:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156736 00000100:00100000:3.0:1784047205.651220:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1784047205.651235:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709156736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047205.651269:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047205.651332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709156736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047205.651340:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00080000:2.0:1784047205.651411:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047205.651457:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709156736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047205.651478:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047205.651493:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709156864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047205.651520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047205.651729:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156864 00000100:00100000:1.0:1784047205.651734:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156864 00000100:00100000:1.0:1784047205.651780:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:1.0:1784047205.651794:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709156864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047205.651807:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047205.651850:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709156864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047205.651857:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1784047205.651859:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709156864:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784047205.651907:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784047205.651985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047206.675234:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047206.675429:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047206.675473:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709156992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047206.675722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047206.676095:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709156992 00000100:00100000:3.0:1784047206.676107:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709156992 00000100:00100000:3.0:1784047206.676188:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1784047206.676199:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709156992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047206.676244:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047206.676317:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709156992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047206.676326:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:1.0:1784047206.676476:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709156992:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1784047207.378289:0:83304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247811 is committed 00010000:00010000:0.0:1784047207.378591:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378640:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378658:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378667:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047207.378672:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378682:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378720:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13700) 00010000:00010000:0.0:1784047207.378723:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047207.378730:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378737:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c773936 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378763:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378770:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378787:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378793:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047207.378796:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378802:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378810:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13700) 00010000:00010000:0.0:1784047207.378813:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047207.378816:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.378822:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c77396e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047207.698837:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784047208.660745:0:84429:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1784047208.724301:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047208.726295:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709157504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726448:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709158016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726499:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709158528:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726551:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1784047208.726558:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709157120:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726651:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709157632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726674:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726694:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709158144:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726739:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709158656:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726789:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709157376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709157888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726849:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726867:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709158400:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726905:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784047208.726911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709157248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.726949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.726992:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709157760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.727038:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709158272:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047208.727092:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158016 00000100:00100000:1.0:1784047208.727101:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158016 00000100:00100000:1.0:1784047208.727172:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158528 00000100:00100000:1.0:1784047208.727176:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158528 00000100:00100000:1.0:1784047208.727202:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157888 00000100:00100000:1.0:1784047208.727205:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157888 00000100:00100000:1.0:1784047208.727227:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158400 00000100:00100000:1.0:1784047208.727230:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158400 00000100:00100000:1.0:1784047208.727263:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1784047208.727274:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727340:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709158016:12345-0@lo:400:kworker.0 Request processed in 69us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727349:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1784047208.727369:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:1.0:1784047208.727376:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727402:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709158528:12345-0@lo:400:kworker.0 Request processed in 28us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727408:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:1.0:1784047208.727418:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1784047208.727424:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709157888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727453:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709157888:12345-0@lo:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727459:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1784047208.727481:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:1.0:1784047208.727487:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709158400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727515:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709158400:12345-0@lo:400:kworker.0 Request processed in 29us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727520:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:1.0:1784047208.727544:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157504 00000100:00100000:1.0:1784047208.727547:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157504 00000100:00100000:1.0:1784047208.727569:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157632 00000100:00100000:1.0:1784047208.727571:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157632 00000100:00100000:1.0:1784047208.727582:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158144 00000100:00100000:1.0:1784047208.727584:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158144 00000100:00100000:1.0:1784047208.727593:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158656 00000100:00100000:1.0:1784047208.727595:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158656 00000100:00100000:1.0:1784047208.727633:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157376 00000100:00100000:1.0:1784047208.727635:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157376 00000100:00100000:1.0:1784047208.727649:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157248 00000100:00100000:1.0:1784047208.727651:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157248 00000100:00100000:1.0:1784047208.727664:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1784047208.727671:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709157504:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047208.727687:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d0ad80 x1870705709157504/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:339/0 lens 224/224 e 0 to 0 dl 1784047219 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047208.727717:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709157504:12345-0@lo:400:kworker.0 Request processed in 47us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727724:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1784047208.727735:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1784047208.727740:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727765:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709157632:12345-0@lo:400:kworker.0 Request processed in 26us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727781:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1784047208.727792:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1784047208.727798:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709158144:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047208.727808:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d0b800 x1870705709158144/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:339/0 lens 224/224 e 0 to 0 dl 1784047219 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047208.727834:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709158144:12345-0@lo:400:kworker.0 Request processed in 37us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727840:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1784047208.727852:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1784047208.727859:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709158656:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047208.727869:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d08700 x1870705709158656/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:339/0 lens 224/224 e 0 to 0 dl 1784047219 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047208.727894:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709158656:12345-0@lo:400:kworker.0 Request processed in 37us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727900:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1784047208.727910:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1784047208.727936:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709157376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.727965:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709157376:12345-0@lo:400:kworker.0 Request processed in 49us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.727971:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1784047208.727981:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1784047208.727988:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709157248:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047208.727998:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d08000 x1870705709157248/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:339/0 lens 224/224 e 0 to 0 dl 1784047219 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047208.728037:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709157248:12345-0@lo:400:kworker.0 Request processed in 50us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.728043:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1784047208.728078:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157760 00000100:00100000:1.0:1784047208.728082:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157760 00000100:00100000:1.0:1784047208.728117:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158272 00000100:00100000:1.0:1784047208.728120:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158272 00000100:00100000:1.0:1784047208.728143:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:1.0:1784047208.728150:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709157760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047208.728164:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00010000:00000080:1.0:1784047208.728167:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d0b480 x1870705709157760/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:339/0 lens 224/224 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047208.728179:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728200:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709157760:12345-0@lo:400:kworker.0 Request processed in 49us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.728207:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00080000:1.0:1784047208.728229:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047208.728233:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709158272:12345-0@lo:400:kworker.0 Request processed in 58us (1170us total) trans 0 rc 0/0 00000100:00080000:1.0:1784047208.728235:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047208.728240:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047208.728244:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047208.728246:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:1.0:1784047208.728311:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709157248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728323:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709157760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728334:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709158272:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728343:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709157376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728353:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709157888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709158400:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709157632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709158144:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728447:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709158656:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728458:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709157504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728470:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709158016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047208.728482:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709158528:0@lo:400:kworker.0 00000100:00100000:0.0:1784047208.728894:0:83309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709157120 00000100:00100000:0.0:1784047208.728902:0:83309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709157120 00000100:00100000:0.0:1784047208.729103:0:83309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784047208.729114:0:83309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709157120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047208.729289:0:83309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709157120:12345-0@lo:400:kworker.0 Request processed in 177us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047208.729297:0:83309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784047208.732119:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709157120:0@lo:400:kworker.0 00000100:00100000:3.0:1784047208.759306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047208.759457:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391744 00000100:00100000:1.0:1784047208.759470:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391744 00000100:00100000:1.0:1784047208.759571:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1036 00000100:00100000:1.0:1784047208.759585:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:64920:x1870705689391744:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047208.759634:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047208.759666:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c773983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae0fb expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.759760:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c77398a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.759779:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c77398a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.759795:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c77398a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047208.759853:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047208.759870:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1784047208.759911:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c77398a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.759954:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c773983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0fb expref: 7 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784047208.760394:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784047208.761299:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c77398a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0fb expref: 6 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.761310:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2400) 00010000:00010000:1.0:1784047208.761313:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047208.761318:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24ba00, rc 0) 00010000:00000080:1.0:1784047208.761328:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062dc00 x1870705689391744/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:339/0 lens 576/688 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047208.761903:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:64920:x1870705689391744:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2318us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047208.761925:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1036 00000100:00100000:3.0:1784047208.766322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047208.766814:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689391872 00000100:00100000:2.0:1784047208.766828:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689391872 00000100:00100000:2.0:1784047208.766905:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1037 00000100:00100000:2.0:1784047208.766929:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:64920:x1870705689391872:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047208.767796:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047208.767836:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c773991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae102 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.767945:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768041:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768057:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768098:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768108:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768116:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768409:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768420:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768427:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768435:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768442:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047208.768448:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768457:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768473:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2400) 00010000:00010000:2.0:1784047208.768477:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047208.768483:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768498:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768517:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768523:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768529:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.768534:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047208.768537:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.769481:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.769506:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99cce7f99400) 00010000:00010000:2.0:1784047208.769510:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047208.769514:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.769521:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c77399f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.769587:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c773991 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae102 expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.769654:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2400) 00010000:00010000:2.0:1784047208.769657:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047208.769661:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c773991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae102 expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047208.769679:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0200, rc 0) 00010000:00000080:2.0:1784047208.769694:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062f480 x1870705689391872/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:339/0 lens 592/584 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047208.769802:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:64920:x1870705689391872:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2886us (3494us total) trans 0 rc 301/301 00000100:00100000:2.0:1784047208.769814:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1037 00000100:00100000:3.0:1784047208.779238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047208.779577:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392128 00000100:00100000:0.0:1784047208.779593:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392128 00000100:00100000:0.0:1784047208.779906:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1038 00000100:00100000:0.0:1784047208.779931:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:64920:x1870705689392128:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047208.779970:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047208.779974:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784047208.780017:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c77398a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0fb expref: 6 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780047:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2400) 00010000:00010000:0.0:1784047208.780062:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047208.780085:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7739a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae109 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780247:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780286:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780300:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780318:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780326:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.780333:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.783256:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.783286:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.783301:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047208.783318:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784047208.783358:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.783366:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.783372:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785074:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785083:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047208.785089:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785100:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785125:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94900) 00010000:00010000:0.0:1784047208.785129:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047208.785135:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785144:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7739ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047208.785167:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000912950eb reply state 00000000bfde89f4 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785185:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785194:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99ccc3e94f00) 00010000:00010000:0.0:1784047208.785197:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047208.785201:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784047208.785279:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7739a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785306:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.785326:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99ccc3e94800) 00010000:00010000:0.0:1784047208.785328:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047208.785331:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbca00, rc 0) 00010000:00000080:0.0:1784047208.785343:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062e300 x1870705689392128/t98784247812(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:339/0 lens 536/608 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047208.787709:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:64920:x1870705689392128:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 7764us (8472us total) trans 98784247812 rc 0/0 00000100:00100000:1.0:1784047208.787727:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1038 00000100:00100000:0.0:1784047208.793173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047208.793280:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392384 00000100:00100000:1.0:1784047208.793295:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392384 00000100:00100000:1.0:1784047208.793383:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1039 00000100:00100000:1.0:1784047208.793402:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:64920:x1870705689392384:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047208.793435:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047208.794597:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c7739c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae110 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.794813:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.796402:0:66219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.796424:0:66219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.796628:0:66219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.796647:0:66219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 9 pid: 68026 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047208.796670:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66219:1870705709158784:192.168.204.40@tcp:104: 00000100:00100000:1.0:1784047208.796795:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa60c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047208.812359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047208.812490:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392512 00000100:00100000:0.0:1784047208.812504:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392512 00010000:00010000:0.0:1784047208.812561:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 10 pid: 68026 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047208.812649:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2531 00000100:00100000:0.0:1784047208.812661:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf349f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+10:2402:x1870705689392512:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047208.812682:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047208.812690:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 10 pid: 68026 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.812704:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 10 pid: 68026 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.812735:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99ccc3e94800) 00010000:00010000:0.0:1784047208.812742:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.812754:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.812786:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047208.812817:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047208.812887:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf349f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+10:2402:x1870705689392512:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 228us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047208.812896:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2531 00010000:00010000:1.0:1784047208.813440:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7739bb lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 9 pid: 68026 timeout: 3407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047208.813523:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66219:1870705709158784:192.168.204.40@tcp:104: 00010000:00010000:1.0:1784047208.813560:0:66219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.813571:0:66219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.813592:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047208.813840:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784047208.814154:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814165:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814172:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814178:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24bc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047208.814183:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814191:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814205:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99ccc3e94800) 00010000:00010000:1.0:1784047208.814208:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047208.814212:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814218:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7739d0 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814288:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c7739c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae110 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814314:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2300) 00010000:00010000:1.0:1784047208.814316:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784047208.814320:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c7739c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae110 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047208.814334:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b800, rc 0) 00010000:00000080:1.0:1784047208.814344:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca63800 x1870705689392384/t98784247813(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:339/0 lens 712/824 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047208.814425:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:64920:x1870705689392384:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 21030us (21269us total) trans 98784247813 rc 301/301 00000100:00100000:1.0:1784047208.814436:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1039 00000100:00100000:1.0:1784047208.828149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047208.829349:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392768 00000100:00100000:3.0:1784047208.829433:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392768 00000100:00100000:3.0:1784047208.829641:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00100000:3.0:1784047208.829654:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:64920:x1870705689392768:12345-192.168.204.40@tcp:35:lfs.0 00010000:00000080:3.0:1784047208.829937:0:66222:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d08e00 x1870705689392768/t98784247814(0) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:339/0 lens 392/456 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047208.830087:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:64920:x1870705689392768:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 435us (1950us total) trans 98784247814 rc 0/0 00000100:00100000:3.0:1784047208.830096:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00100000:3.0:1784047208.832941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047208.833145:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393024 00000100:00100000:1.0:1784047208.833847:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393024 00000100:00100000:2.0:1784047208.838151:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 214 00000100:00100000:2.0:1784047208.838185:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:64920:x1870705689393024:12345-192.168.204.40@tcp:35:lfs.0 00010000:00000080:2.0:1784047208.840566:0:66222:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062e680 x1870705689393024/t98784247815(0) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:339/0 lens 392/456 e 0 to 0 dl 1784047219 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047208.840727:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:64920:x1870705689393024:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 2557us (7824us total) trans 98784247815 rc 0/0 00000100:00100000:2.0:1784047208.840741:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 214 00000100:00100000:1.0:1784047209.092777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047209.092825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047209.092857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047209.092887:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393280 00000100:00100000:1.0:1784047209.092898:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393280 00000100:00100000:1.0:1784047209.092974:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1035 00000100:00100000:1.0:1784047209.092987:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:2401:x1870705689393280:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:1.0:1784047209.093032:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc8d09180 x1870705689393280/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:340/0 lens 224/224 e 0 to 0 dl 1784047220 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047209.093102:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:2401:x1870705689393280:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047209.093126:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1035 00000100:00100000:3.0:1784047209.093820:0:83311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393152 00000100:00100000:3.0:1784047209.093828:0:83311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393152 00000100:00100000:3.0:1784047209.093881:0:83311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 163 00000100:00100000:3.0:1784047209.093891:0:83311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689393152:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047209.093950:0:83311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689393152:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 60us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047209.093957:0:83311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 163 00000100:00100000:0.0:1784047209.094892:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393536 00000100:00100000:0.0:1784047209.094901:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393536 00000100:00100000:0.0:1784047209.094967:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2358 00000100:00100000:0.0:1784047209.094976:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689393536:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047209.095037:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689393536:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 61us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047209.095044:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2358 00000100:00080000:3.0:1784047209.098078:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047209.104118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047209.104177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047209.104270:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393664 00000100:00100000:0.0:1784047209.104290:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393664 00000100:00100000:0.0:1784047209.104364:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2359 00000100:00100000:0.0:1784047209.104375:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689393664:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047209.104460:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689393664:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047209.104467:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2359 00000100:00080000:1.0:1784047209.104835:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047209.104958:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393408 00000100:00100000:3.0:1784047209.104963:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393408 00000100:00100000:3.0:1784047209.105009:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1036 00000100:00100000:3.0:1784047209.105016:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689393408:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047209.105056:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689393408:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047209.105062:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1036 00000100:00080000:1.0:1784047209.105111:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047209.236949:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047209.236978:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709158912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047209.237067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047209.237123:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709158912 00000100:00100000:1.0:1784047209.237131:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709158912 00000100:00100000:1.0:1784047209.237190:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1784047209.237200:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709158912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047209.237233:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047209.237278:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709158912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047209.237287:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1784047209.237335:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709158912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047209.237707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047209.241742:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709159040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047209.241828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047209.243963:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159040 00000100:00100000:3.0:1784047209.243984:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159040 00000100:00100000:3.0:1784047209.244041:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:3.0:1784047209.244050:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709159040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047209.244081:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047209.244305:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709159040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047209.244313:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:0.0:1784047209.244806:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709159040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784047209.748582:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047209.750416:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709159168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047209.750493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047209.750662:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159168 00000100:00100000:2.0:1784047209.750671:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159168 00000100:00100000:2.0:1784047209.750740:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:2.0:1784047209.750750:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709159168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047209.750787:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00010000:00000080:2.0:1784047209.750811:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0ed80 x1870705709159168/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:340/0 lens 224/368 e 0 to 0 dl 1784047220 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047209.751578:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709159168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 827us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047209.751588:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:1.0:1784047209.755978:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709159168:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1784047210.718171:0:84526:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784047210.718250:0:84526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.718266:0:84526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.718273:0:84526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.718280:0:84526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.718306:0:84526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784047210.718312:0:84526:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784047210.718339:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047210.718344:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784047210.718349:0:84526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784047210.718373:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccca573000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784047210.718376:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047210.718383:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.718391:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047210.718406:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.718416:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047210.718423:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047210.718428:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047210.718431:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784047210.718433:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784047210.718460:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.718467:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047210.718494:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.718501:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7735d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7735e0 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.718514:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047210.718516:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047210.718518:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047210.718536:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709159296:0@lo:39:umount.0 00000100:00100000:1.0:1784047210.718604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.718668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047210.718677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709159424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.718705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.718758:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159296 00000100:00100000:1.0:1784047210.718764:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159296 00000100:00100000:1.0:1784047210.718817:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1784047210.718826:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709159296:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784047210.718850:0:66219:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7736f8 00000100:00080000:1.0:1784047210.718857:0:66219:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6c000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1784047210.718897:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0c700 x1870705709159296/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:341/0 lens 224/224 e 0 to 0 dl 1784047221 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047210.718938:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870705709159296:12345-0@lo:39:umount.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.718946:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000020:00000080:1.0:1784047210.718955:0:66219:0:(genops.c:906:class_export_put()) final put ffff99cbc7a6f000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1784047210.718985:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159424 00000100:00100000:1.0:1784047210.718988:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159424 00000100:00100000:1.0:1784047210.719018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1784047210.719025:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709159424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047210.719037:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047210.719066:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47000/0x4426598c0c7735e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7735d9 expref: 24 pid: 83310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.719078:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047210.719115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709159424:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.719121:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00010000:00010000:1.0:1784047210.719139:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047210.719148:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7a6f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047210.719197:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7a6c000 for lustre-MDT0000 00000100:00100000:1.0:1784047210.719232:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709159424:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1784047210.719276:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccca573000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784047210.719300:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709159296:0@lo:39:umount.0 00000100:00080000:2.0:1784047210.719474:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047210.719478:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784047210.719481:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784047210.720530:0:84526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720556:0:84526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720563:0:84526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720570:0:84526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720592:0:84526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047210.720598:0:84526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720628:0:84526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720635:0:84526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720641:0:84526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720661:0:84526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047210.720667:0:84526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720673:0:84526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720688:0:84526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720695:0:84526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720713:0:84526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784047210.720719:0:84526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720726:0:84526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720732:0:84526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720737:0:84526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.720747:0:84526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1784047210.720751:0:84526:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784047210.720781:0:84526:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784047210.720785:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784047210.720790:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784047210.720794:0:84526:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1784047210.721234:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047210.721242:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721250:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047210.721254:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721262:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047210.721269:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047210.721276:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047210.721278:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1784047210.721281:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1784047210.721325:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721331:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047210.721347:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047210.721354:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721355:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721361:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1800 already unused, calling callback (ffffffffc1465c20) 00010000:00010000:1.0:1784047210.721362:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600c00/0x4426598c0c773500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773507 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047210.721365:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721372:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721376:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1784047210.721378:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047210.721383:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047210.721385:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1784047210.721386:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047210.721387:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784047210.721392:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047210.721395:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721402:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721402:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721408:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1784047210.721409:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721414:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047210.721414:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784047210.721416:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784047210.721418:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784047210.721425:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77360a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721428:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721433:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047210.721434:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047210.721437:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721442:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047210.721446:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721446:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721453:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721454:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c7735cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7735d2 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047210.721460:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721463:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784047210.721465:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047210.721465:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047210.721466:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784047210.721467:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784047210.721469:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784047210.721479:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047210.721482:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709159552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047210.721484:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047210.721490:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721495:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c7734eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7734f9 expref: -99 pid: 83303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047210.721515:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047210.721516:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047210.721518:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047210.721538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.721574:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047210.721580:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709159680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.721599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.721640:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709159936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.721658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.721674:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047210.721679:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709159808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.721695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.721723:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159552 00000100:00100000:1.0:1784047210.721730:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159552 00000100:00100000:1.0:1784047210.721775:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159680 00000100:00100000:1.0:1784047210.721777:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159680 00000100:00100000:1.0:1784047210.721793:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159936 00000100:00100000:1.0:1784047210.721795:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159936 00000100:00100000:1.0:1784047210.721808:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709159808 00000100:00100000:1.0:1784047210.721810:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709159808 00000100:00100000:1.0:1784047210.721825:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1784047210.721833:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709159552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047210.721843:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047210.721857:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601400/0x4426598c0c773507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773500 expref: 26 pid: 83314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721867:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047210.721914:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+25:3645:x1870705709159552:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.721921:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1784047210.721936:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1784047210.721942:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709159680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047210.721958:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047210.721967:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47c00/0x4426598c0c77360a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773603 expref: 24 pid: 83309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.721976:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047210.721997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709159680:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.722003:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1784047210.722016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784047210.722022:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+22:3648:x1870705709159936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047210.722029:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047210.722037:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6c200/0x4426598c0c7734f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7734eb expref: 22 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.722059:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047210.722083:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+21:3648:x1870705709159936:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.722089:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784047210.722100:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1784047210.722106:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+20:3648:x1870705709159808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047210.722113:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047210.722122:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46600/0x4426598c0c7735d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7735cb expref: 20 pid: 83314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047210.722130:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047210.722150:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+19:3648:x1870705709159808:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.722164:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1784047210.722221:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709159808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.722231:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709159936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.722265:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709159680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047210.722272:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709159552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047210.722289:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047210.723211:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1784047210.726021:0:84526:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1784047210.730516:0:83304:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:0.0:1784047210.730812:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047210.730826:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047210.730833:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047210.730840:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047210.730844:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047210.730851:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047210.730870:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99ccc3e94f00) 00010000:00010000:0.0:1784047210.730873:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047210.730890:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047210.730898:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7739b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784047210.737527:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1784047210.737544:0:84526:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccf2d7e800 2a2569b5-a558-4441-a96a-1d77608df16b 192.168.204.40@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 98784247815 stale:0 00000020:00080000:2.0:1784047210.737552:0:84526:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbc753c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.737573:0:84526:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc6dae800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.737578:0:84526:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cce4198000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.737582:0:84526:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd897f800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.737599:0:84526:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99cd00103380) has exports, disconnecting them 00000020:00080000:2.0:1784047210.737626:0:84526:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.40@tcp (ffff99ccf2d7e800), last request at 1784047209 00000020:00000080:2.0:1784047210.737634:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7738c6 00000100:00080000:2.0:1784047210.737645:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7b000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.737676:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccf2d7e800): rc 0 00000020:00000080:2.0:1784047210.737679:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7e800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00080000:2.0:1784047210.737698:0:84526:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbc753c000), last request at 1784046996 00000020:00000080:2.0:1784047210.737701:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7736f1 00000100:00080000:2.0:1784047210.737706:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a69000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.737715:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc753c000): rc 0 00000020:00000080:2.0:1784047210.737717:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbc753c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784047210.737721:0:84526:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccc6dae800), last request at 1784047208 00000020:00000080:2.0:1784047210.737724:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7736ea 00000100:00080000:2.0:1784047210.737727:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccc6dac800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.737735:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc6dae800): rc 0 00000020:00000080:2.0:1784047210.737737:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccc6dae800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784047210.737741:0:84526:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cce4198000), last request at 1784047208 00000020:00000080:2.0:1784047210.737744:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7736e3 00000100:00080000:2.0:1784047210.737765:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99cce419d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.737815:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cce4198000): rc 0 00000020:00000080:2.0:1784047210.737817:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cce4198000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784047210.737821:0:84526:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd897f800), last request at 1784046991 00000020:00000080:2.0:1784047210.737824:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77354d 00000100:00080000:2.0:1784047210.737842:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccebebe800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.737853:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd897f800): rc 0 00000020:00000080:2.0:1784047210.737855:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccd897f800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1784047210.737862:0:84526:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc9141d87ae0 00000100:00080000:2.0:1784047210.737895:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047210.737899:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 3 00010000:00010000:0.0:1784047210.738700:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784047210.738713:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7e800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-MDT0000 00000020:00000080:0.0:1784047210.738775:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc753c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784047210.738808:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dae800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784047210.738829:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce4198000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784047210.738863:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd897f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1784047210.738906:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d7b000 for lustre-MDT0000 00000020:00000080:0.0:1784047210.738911:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7a69000 for lustre-MDT0000 00000020:00000080:0.0:1784047210.738914:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6dac800 for lustre-MDT0000 00000020:00000080:0.0:1784047210.738917:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce419d800 for lustre-MDT0000 00000020:00000080:0.0:1784047210.738921:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccebebe800 for lustre-MDT0000 00010000:00010000:3.0:1784047210.739858:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047210.739868:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047210.740053:0:84526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784047210.740247:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccc5020800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784047210.740318:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709160064:0@lo:39:umount.0 00000100:00100000:0.0:1784047210.740398:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047210.740572:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160064 00000100:00100000:3.0:1784047210.740580:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160064 00000100:00100000:3.0:1784047210.740652:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:3.0:1784047210.740663:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709160064:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784047210.740690:0:23872:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77358c 00000100:00080000:3.0:1784047210.740699:0:23872:0:(import.c:65:import_set_state_nolock()) ffff99cbc7651000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047210.740718:0:23872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411434 00010000:00010000:1.0:1784047210.740743:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047210.740750:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047210.740985:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047210.740990:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 3 00000004:00080000:2.0:1784047210.741012:0:84526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784047210.741229:0:84526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784047210.741246:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784047210.741814:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709160192:0@lo:9:umount.0 00000100:00100000:0.0:1784047210.741858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047210.743502:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3644:x1870705709160064:12345-0@lo:39:umount.0 Request processed in 2832us (3094us total) trans 77309411435 rc 0/0 00000100:00100000:3.0:1784047210.743516:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00010000:00010000:3.0:1784047210.743561:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047210.744343:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047210.744348:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 3 00000004:00080000:2.0:1784047210.744364:0:84526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784047210.744426:0:84526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784047210.744453:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784047210.744501:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cd00103380) has no exports 00000100:00100000:1.0:1784047210.745250:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160192 00000100:00100000:1.0:1784047210.745260:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160192 00000100:00100000:1.0:1784047210.745329:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929 00000100:00100000:1.0:1784047210.745345:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709160192:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784047210.745371:0:26192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77359a 00000100:00080000:1.0:1784047210.745381:0:26192:0:(import.c:65:import_set_state_nolock()) ffff99ccc5c01800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047210.745423:0:26192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968748 00000020:00080000:2.0:1784047210.745461:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cd00103380) has no exports 00000100:00100000:1.0:1784047210.745581:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709160192:12345-0@lo:9:umount.0 Request processed in 244us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.745589:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929 00000100:00080000:1.0:1784047210.745625:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784047210.745745:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047210.746078:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccc5020800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784047210.746154:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709160064:0@lo:39:umount.0 00000100:00100000:0.0:1784047210.746176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709160320:0@lo:9:umount.0 00000100:00100000:0.0:1784047210.746220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047210.746300:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784047210.746310:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784047210.746312:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047210.746314:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709160192:0@lo:9:umount.0 00000100:00100000:3.0:1784047210.748049:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160320 00000100:00100000:3.0:1784047210.748061:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160320 00000100:00080000:1.0:1784047210.748274:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047210.748386:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4930 00000100:00100000:3.0:1784047210.748399:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709160320:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784047210.748425:0:26189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7735b6 00000100:00080000:3.0:1784047210.748434:0:26189:0:(import.c:65:import_set_state_nolock()) ffff99ccd8416800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047210.748489:0:26189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968748 00000100:00100000:3.0:1784047210.748677:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709160320:12345-0@lo:9:umount.0 Request processed in 281us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047210.748685:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4930 00010000:00010000:1.0:1784047210.748753:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784047210.756657:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784047210.756688:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784047210.756690:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047210.756698:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709160320:0@lo:9:umount.0 00010000:00010000:1.0:1784047210.770784:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047210.771710:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047210.771733:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709160448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047210.771815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047210.771859:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160448 00000100:00100000:1.0:1784047210.771866:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160448 00000100:00100000:1.0:1784047210.771940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1784047210.771950:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709160448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047210.771979:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047210.772020:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709160448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047210.772027:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00080000:1.0:1784047210.772061:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047210.772169:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709160448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047210.772438:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047210.772448:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709160576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047210.772481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047210.772577:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160576 00000100:00100000:0.0:1784047210.772581:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160576 00000100:00100000:0.0:1784047210.772650:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1784047210.772660:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709160576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047210.772678:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047210.772716:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709160576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047210.772722:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:3.0:1784047210.772812:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709160576:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047210.772884:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1784047210.804962:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773562 00000020:00000080:2.0:1784047210.804983:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccec804800/lustre-QMT0000_UUID 00000020:01000000:2.0:1784047210.805007:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784047210.805030:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec804800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784047210.805070:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047210.805092:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784047210.805098:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99cbc76ccd40) has no exports 00000020:00000080:3.0:1784047210.805549:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77355b 00000020:00000080:3.0:1784047210.805555:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccec318800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047210.805656:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047210.805665:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784047210.805668:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccec31c800/lustre-QMT0000_UUID 00000020:00000080:3.0:1784047210.805670:0:84526:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec31c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784047210.805675:0:84526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1784047210.805890:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec318800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784047210.806430:0:84526:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccff3317e0 - data ffff99ccf7870bd0/ffff99cd00ebf000 00000020:01000000:3.0:1784047210.806582:0:84526:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccfdc88a20 - data ffff99ccf7b13ca8/ffff99ccc6dcb000 00000100:00080000:2.0:1784047210.853463:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047210.853474:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 4 00000100:00100000:2.0:1784047210.853490:0:84526:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99cd00d9e300 x1870705709160064/t77309411435(77309411435) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047220 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047210.853515:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784047210.855065:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784047210.855071:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 4 00000004:00080000:3.0:1784047210.855091:0:84526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047210.855094:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047210.855332:0:83321:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047210.855337:0:83321:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:1.0:1784047210.855348:0:83321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:3.0:1784047210.855997:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784047210.856001:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 4 00000004:00080000:3.0:1784047210.856022:0:84526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047210.856024:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047210.856342:0:83323:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047210.856346:0:83323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:1.0:1784047210.856355:0:83323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:3.0:1784047210.857118:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77351c 00000020:00000080:3.0:1784047210.857131:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccc5e53800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047210.857762:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773531 00000020:00000080:3.0:1784047210.857770:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbcad88800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784047210.857775:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784047210.857782:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047210.857793:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784047210.857797:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99cd001019c0) has no exports 00000004:01000000:3.0:1784047210.857966:0:84526:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784047210.857975:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7735af 00000020:00000080:3.0:1784047210.857980:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbc753f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784047210.857984:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784047210.857988:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047210.857995:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784047210.857997:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99cbc76c8000) has no exports 00000020:00000080:3.0:1784047210.858002:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7735a8 00000020:00000080:3.0:1784047210.858006:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cce4924000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784047210.858346:0:84526:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784047210.858352:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784047210.858355:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968748 gen 5 00000004:00080000:3.0:1784047210.858360:0:84526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047210.858362:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784047210.858390:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047210.858398:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784047210.858402:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773593 00000020:00000080:3.0:1784047210.858406:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784047210.858409:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784047210.858412:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047210.858416:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784047210.858418:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99cd00c899c0) has no exports 00000020:00000080:3.0:1784047210.858422:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773585 00000020:00000080:3.0:1784047210.858424:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccf2d79800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784047210.858732:0:84526:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784047210.858747:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784047210.858749:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968748 gen 5 00000004:00080000:3.0:1784047210.858752:0:84526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047210.858753:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784047210.858777:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047210.858782:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1784047210.858790:0:84526:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1784047210.858794:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773577 00000020:00000080:3.0:1784047210.858798:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784047210.858801:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784047210.858804:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047210.858808:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784047210.858811:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99cbc989cd40) has no exports 00000020:00000080:3.0:1784047210.858814:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773570 00000020:00000080:3.0:1784047210.858817:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccc5c03000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047210.859430:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e53800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047210.859443:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcad88800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784047210.859449:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc753f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784047210.859456:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce4924000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047210.859462:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce4927800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784047210.859470:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047210.859472:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784047210.859477:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047210.859564:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784047210.859577:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d79800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047210.859580:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d7f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784047210.859584:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047210.859586:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784047210.859589:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047210.859634:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784047210.859638:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784047210.860713:0:84526:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784047210.860727:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047210.860730:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 5 00000100:00100000:2.0:1784047210.860737:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047210.860798:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047210.860811:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047210.860837:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047210.860840:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047210.860845:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccf7569000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047210.860848:0:84526:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7569000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784047210.860855:0:84526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047210.860958:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773538 00000020:00000080:2.0:1784047210.860964:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbcad8d800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784047210.860968:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784047210.860971:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047210.860975:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047210.860979:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cd00104d40) has no exports 00000020:00000080:2.0:1784047210.861002:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047210.861005:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784047210.861009:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77353f 00000020:00000080:2.0:1784047210.861011:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbcad89800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784047210.861017:0:84526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccc6dad000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784047210.861020:0:84526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc6dad000 3 00000020:01000004:2.0:1784047210.861023:0:84526:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccc6dad000 from lustre-MDT0000 00000020:00000080:2.0:1784047210.861045:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047210.861049:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784047210.861051:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccc5e57800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784047210.861053:0:84526:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e57800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784047210.861060:0:84526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784047210.861088:0:84526:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784047210.861092:0:84526:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784047210.861095:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784047210.861098:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047210.861107:0:84526:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784047210.861116:0:84526:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99cbcd4b1000 d42aef96-772a-4ce2-a768-bea713505b5b 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.861122:0:84526:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccd897f000 6e36843b-2016-43fe-8842-da5818d68597 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.861126:0:84526:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff99cceff3cd40) has exports, disconnecting them 00000020:00080000:2.0:1784047210.861131:0:84526:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.40@tcp (ffff99cbcd4b1000), last request at 1784046992 00000020:00000080:2.0:1784047210.861152:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7735fc 00000020:00010000:2.0:1784047210.861156:0:84526:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cbcd4b1000: total 2 00000100:00080000:2.0:1784047210.861160:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99cbcd4b7000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.861171:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99cbcd4b1000): rc 0 00000020:00080000:2.0:1784047210.861174:0:84526:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ccd897f000), last request at 1784046991 00000020:00000080:2.0:1784047210.861229:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7734dd 00000020:00010000:2.0:1784047210.861233:0:84526:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccd897f000: total 2 00000100:00080000:2.0:1784047210.861235:0:84526:0:(import.c:65:import_set_state_nolock()) ffff99ccd897d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047210.861244:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd897f000): rc 0 00000020:00080000:2.0:1784047210.861248:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99cceff3cd40) has no exports 00000100:00100000:2.0:1784047210.861316:0:83314:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99ccfebcea00:83314] 3 exiting: rc = 0 00000020:00010000:2.0:1784047210.861399:0:16469:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cbcd4b1000: total 2 00010000:00010000:2.0:1784047210.861427:0:16469:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cbcd4b1000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1784047210.861457:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6c400/0x4426598c0c7736dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0d1 expref: 5 pid: 83309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.861475:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6d600/0x4426598c0c7736d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0ca expref: 4 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.861487:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c7736c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0bc expref: 3 pid: 83314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.861498:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0600/0x4426598c0c7736ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae0c3 expref: 2 pid: 83309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.861522:0:16469:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cbcd4b1000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1784047210.861552:0:16469:0:(genops.c:906:class_export_put()) final put ffff99cbcd4b1000/d42aef96-772a-4ce2-a768-bea713505b5b 00000020:00010000:2.0:1784047210.861557:0:16469:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccd897f000: total 3 00000100:00100000:1.0:1784047210.861963:0:83310:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ccef55da00:83310] 1 exiting: rc = 0 00000020:00000080:1.0:1784047210.862014:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5020800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784047210.862019:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccc5c05000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047210.862021:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c05000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784047210.862026:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047210.862082:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcad8d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784047210.862086:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccf756e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784047210.862088:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf756e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784047210.862092:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784047210.862119:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcad89800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047210.862127:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcd4b1000/d42aef96-772a-4ce2-a768-bea713505b5b for MGS 00000020:00000080:1.0:1784047210.862159:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcd4b7000 for MGS 00010000:00010000:1.0:1784047210.862172:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047210.862220:0:16469:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccd897f000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784047210.862247:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0400/0x4426598c0c77366c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773665 expref: 14 pid: 83310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862260:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1000/0x4426598c0c77367a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773673 expref: 13 pid: 83310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862270:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6c800/0x4426598c0c773618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773611 expref: 12 pid: 83310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862280:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600000/0x4426598c0c773696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77368f expref: 11 pid: 83314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862290:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6d400/0x4426598c0c773626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77361f expref: 10 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862301:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601000/0x4426598c0c773688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773681 expref: 9 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862312:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46200/0x4426598c0c773642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77363b expref: 8 pid: 83314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862323:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6d200/0x4426598c0c7736a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77369d expref: 7 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862333:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47800/0x4426598c0c773634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77362d expref: 6 pid: 83314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862355:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601200/0x4426598c0c7736b2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7736ab expref: 5 pid: 83309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862366:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6d800/0x4426598c0c7736c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7736b9 expref: 4 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862375:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1c00/0x4426598c0c773650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773649 expref: 3 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862385:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6c000/0x4426598c0c77365e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773657 expref: 2 pid: 83310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047210.862393:0:16469:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccd897f000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784047210.862407:0:16469:0:(genops.c:906:class_export_put()) final put ffff99ccd897f000/6e36843b-2016-43fe-8842-da5818d68597 00010000:00010000:2.0:1784047210.862424:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047210.862426:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047210.862428:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047210.862471:0:83311:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ccef55d000:83311] 2 exiting: rc = 0 00000020:00000080:1.0:1784047210.862687:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd897f000/6e36843b-2016-43fe-8842-da5818d68597 for MGS 00000020:00000080:1.0:1784047210.862717:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897d800 for MGS 00000100:00100000:1.0:1784047210.863733:0:83309:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99cbc6515200:83309] 0 exiting: rc = 1 00000100:00100000:2.0:1784047210.863892:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863902:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863908:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863913:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863920:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863925:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863931:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863938:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863945:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863952:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863963:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863970:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863988:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.863994:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864000:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864007:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864012:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864018:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864025:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864031:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864037:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864043:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864049:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864057:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864062:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864069:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864076:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864082:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864088:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864094:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864099:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864104:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864109:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864114:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864120:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864125:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864131:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864137:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864143:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864150:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864156:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864162:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864167:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864173:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864179:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864185:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864191:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864206:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864211:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864217:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864223:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864229:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864235:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864240:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864245:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864251:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864257:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864263:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864269:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864274:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864281:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864286:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864291:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047210.864297:0:84526:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784047210.865305:0:84526:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccfdc880c0 - data ffff99ccf336f438/ffff99cbc78e5400 00000020:01000000:2.0:1784047210.865431:0:84526:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc822c360 - data ffff99ccf33900d8/ffff99cbc780d800 00000020:00000080:2.0:1784047210.865915:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7734d6 00000020:00000080:2.0:1784047210.865927:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbcae52800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784047210.865941:0:84526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccc6dad000 from MGS, refs=2 00000020:01000004:2.0:1784047210.865946:0:84526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc6dad000 2 00000020:01000004:2.0:1784047210.865949:0:84526:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccc6dad000 from MGS 00000020:00000080:2.0:1784047210.865976:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047210.865984:0:84526:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784047210.865987:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbcae51000/MGS 00000020:00000080:2.0:1784047210.865989:0:84526:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcae51000/MGS for MGS 00000020:01000000:2.0:1784047210.865999:0:84526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784047210.866079:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784047210.866084:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047210.866093:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784047210.866100:0:84526:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ccfe665800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047210.866108:0:84526:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99ccfebb4d40) has exports, disconnecting them 00000020:00080000:2.0:1784047210.866127:0:84526:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ccfe665800), last request at 1784046991 00000020:00000080:2.0:1784047210.866131:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7735ee 00000020:00080000:2.0:1784047210.866141:0:84526:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccfe665800): rc 0 00000020:00000080:2.0:1784047210.866146:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccfe665800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784047210.866256:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcae52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047210.866265:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe665800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784047210.889706:0:84526:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784047210.889715:0:84526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784047210.889720:0:84526:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784047210.889726:0:84526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784047210.889924:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047210.889938:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784047210.889946:0:84526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc6dad000 1 00000020:00000080:3.0:1784047210.889953:0:84526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7734c8 00000020:00000080:3.0:1784047210.889961:0:84526:0:(genops.c:906:class_export_put()) final put ffff99cbcae57000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047210.890049:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccca573000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784047210.890056:0:45180:0:(genops.c:906:class_export_put()) final put ffff99cbc79c0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784047210.890071:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc79c0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784047210.890081:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1784047210.890595:0:84526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784047210.890601:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047210.890625:0:84526:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784047210.890630:0:84526:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99cbc9898000) has no exports 00000020:00000080:1.0:1784047210.894362:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcae57000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047211.030329:0:84526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047211.030344:0:84526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784047211.030351:0:84526:0:(genops.c:906:class_export_put()) final put ffff99ccc6daa800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047211.030356:0:84526:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6daa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784047211.030368:0:84526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784047211.030507:0:84526:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ccc6dae000 00000020:02000400:2.0:1784047211.030587:0:84526:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1784047211.795758:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047212.819184:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047213.842980:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709160704:0@lo:400:kworker.0 00000400:00000100:3.0:1784047213.843047:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709160704 offset 0 length 224: 4 00000100:00100000:1.0:1784047213.843498:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709161088:0@lo:400:kworker.0 00000100:00100000:1.0:1784047213.843693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047213.843716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709161600:0@lo:400:kworker.0 00000100:00100000:1.0:1784047213.843744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047213.843767:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784047213.843775:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709160960:0@lo:400:kworker.0 00000100:00100000:1.0:1784047213.843800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047213.843831:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709161472:0@lo:400:kworker.0 00000100:00100000:1.0:1784047213.843853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047213.844942:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161088 00000100:00100000:3.0:1784047213.844952:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161088 00000100:00100000:3.0:1784047213.844996:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160960 00000100:00100000:3.0:1784047213.844998:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160960 00000100:00100000:3.0:1784047213.845031:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1784047213.845040:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709160960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047213.845098:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709160960:12345-0@lo:400:kworker.0 Request processed in 60us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047213.845105:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1784047213.845121:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1784047213.845124:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1870705709161088:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784047213.845129:0:66220:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784047213.845149:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1870705709161088:12345-0@lo:400:kworker.0 Request processed in 23us (1458us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047213.845155:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:1.0:1784047213.845210:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047213.845488:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709160832:0@lo:400:kworker.0 00010000:00010000:2.0:1784047213.846442:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047213.846532:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161600 00000100:00100000:0.0:1784047213.846540:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161600 00000100:00100000:0.0:1784047213.846596:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161472 00000100:00100000:0.0:1784047213.846600:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161472 00000100:00100000:0.0:1784047213.846646:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:0.0:1784047213.846655:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709161600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047213.848122:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:3.0:1784047213.848141:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709161472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047213.850057:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709160960:0@lo:400:kworker.0 00000100:00080000:2.0:1784047213.850080:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784047213.850086:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784047213.850090:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784047213.850096:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784047213.850099:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709161600:12345-0@lo:400:kworker.0 Request processed in 3443us (6351us total) trans 0 rc 0/0 00000100:00080000:2.0:1784047213.850104:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3095 00000100:00100000:0.0:1784047213.850111:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00080000:2.0:1784047213.850115:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047213.850150:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00d9e300 x1870705709161856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047213.850151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047213.850157:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047213.850184:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709161088:0@lo:400:kworker.0 00000100:00100000:0.0:1784047213.850194:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709161216:0@lo:400:kworker.0 00000100:00100000:2.0:1784047213.850205:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709161600:0@lo:400:kworker.0 00000100:00100000:0.0:1784047213.850228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047213.850257:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709161728:0@lo:400:kworker.0 00000100:00100000:3.0:1784047213.850264:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709161472:12345-0@lo:400:kworker.0 Request processed in 2126us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047213.850264:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709161472:0@lo:400:kworker.0 00000100:00100000:0.0:1784047213.850278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047213.850303:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709161856:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784047213.850308:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161216 00000100:00100000:0.0:1784047213.850313:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161216 00000100:00100000:0.0:1784047213.850356:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161728 00000100:00100000:2.0:1784047213.850357:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047213.850359:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161728 00000100:00100000:3.0:1784047213.850399:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:0.0:1784047213.850439:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161856 00000100:00100000:0.0:1784047213.850444:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161856 00000100:00100000:2.0:1784047213.850485:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1784047213.850495:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709161216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047213.850537:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709161216:12345-0@lo:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047213.850637:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1784047213.850654:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1784047213.850658:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1870705709161728:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047213.850663:0:67153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047213.850770:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1870705709161728:12345-0@lo:400:kworker.0 Request processed in 109us (490us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047213.850776:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1784047213.850789:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1784047213.850793:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709161856:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784047213.850811:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047213.850856:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709161856:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (500us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047213.850862:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:2.0:1784047213.850892:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047213.850896:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047213.850899:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709161856:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784047213.850965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047213.850989:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709161344:0@lo:400:kworker.0 00000100:00080000:2.0:1784047213.850993:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047213.851016:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709161216:0@lo:400:kworker.0 00000100:00080000:2.0:1784047213.851030:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1784047213.851034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047213.851044:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784047213.851049:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784047213.851053:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047213.851058:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3095 00000100:00080000:2.0:1784047213.851064:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047213.851076:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161344 00000100:00100000:1.0:1784047213.851082:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161344 00000100:00100000:2.0:1784047213.851084:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00d9e300 x1870705709161984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047213.851104:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709161728:0@lo:400:kworker.0 00000100:00100000:1.0:1784047213.851115:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:1.0:1784047213.851122:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1870705709161344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047213.851130:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709161984:0@lo:38:ptlrpcd_00_02.0 00000020:00080000:1.0:1784047213.851131:0:8441:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047213.851173:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1870705709161344:12345-0@lo:400:kworker.0 Request processed in 50us (141us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047213.851174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047213.851183:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:2.0:1784047213.851208:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709160832 00000100:00100000:2.0:1784047213.851213:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709160832 00000100:00100000:1.0:1784047213.851220:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709161984 00000100:00100000:1.0:1784047213.851226:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709161984 00000100:00100000:2.0:1784047213.851236:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1784047213.851241:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709160832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047213.851246:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047213.851272:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709160832:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047213.851279:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1784047213.851381:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1784047213.851453:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709161984:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1784047213.851466:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784047213.851667:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047213.851672:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047213.851675:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784047213.851679:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047213.851683:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3095 00000100:00080000:0.0:1784047213.851689:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047213.851694:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709161984:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 304us (519us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047213.851705:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1784047213.851715:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cceca62a00 x1870705709162112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047213.851726:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709160832:0@lo:400:kworker.0 00000100:00080000:0.0:1784047213.851738:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047213.851741:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047213.851743:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784047213.851748:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047213.851751:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3276 00000100:00080000:0.0:1784047213.851755:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047213.851766:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cceca60380 x1870705709162240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047213.851775:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709161344:0@lo:400:kworker.0 00000100:00080000:2.0:1784047213.853739:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047213.853749:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047213.853754:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709161984:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784047213.854025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709162112:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047213.854089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047213.854136:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709162240:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047213.854180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047213.854451:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709162112 00000100:00100000:0.0:1784047213.854459:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709162112 00000100:00100000:1.0:1784047213.854982:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709162240 00000100:00100000:1.0:1784047213.854988:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709162240 00000100:00100000:1.0:1784047213.855020:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:1.0:1784047213.855028:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709162240:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1784047213.855049:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047213.855103:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709162240:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 75us (922us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047213.855111:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00080000:1.0:1784047213.855152:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047213.855157:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047213.855160:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709162240:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1784047213.855254:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1784047213.855262:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709162112:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1784047213.855342:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047213.855695:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709162112:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 126us (1299us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047213.855703:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00080000:1.0:1784047213.856096:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047213.856101:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047213.856104:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709162112:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784047214.212852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:3.0:1784047214.212895:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689393792 offset 0 length 224: 4 00000100:00100000:3.0:1784047214.212914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047214.212955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047214.213127:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393920 00000100:00100000:0.0:1784047214.213137:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393920 00000100:00100000:0.0:1784047214.213182:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394048 00000100:00100000:0.0:1784047214.213185:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394048 00000100:00100000:0.0:1784047214.213233:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1039 00000100:00100000:0.0:1784047214.213243:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689394048:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047214.213320:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689394048:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047214.213328:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1039 00000100:00100000:0.0:1784047214.213345:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1047 00000100:00100000:0.0:1784047214.213350:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1870705689393920:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:0.0:1784047214.213356:0:66221:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:0.0:1784047214.213380:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1870705689393920:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (540us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047214.213386:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1047 00000100:00100000:1.0:1784047214.213653:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394304 00000100:00100000:1.0:1784047214.213658:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394304 00000100:00100000:1.0:1784047214.213707:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2362 00000100:00100000:1.0:1784047214.213720:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689394304:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047214.213767:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689394304:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 51us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047214.213774:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2362 00000100:00080000:2.0:1784047214.215717:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047214.215728:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047214.221961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047214.222059:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394176 00000100:00100000:1.0:1784047214.222071:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394176 00000100:00100000:1.0:1784047214.222162:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2363 00000100:00100000:1.0:1784047214.222180:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689394176:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047214.222280:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689394176:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047214.222288:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2363 00000100:00080000:2.0:1784047214.222471:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047214.223871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047214.223964:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394432 00000100:00100000:2.0:1784047214.223973:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394432 00000100:00100000:2.0:1784047214.224017:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1048 00000100:00100000:2.0:1784047214.224024:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689394432:12345-192.168.204.40@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1784047214.224048:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047214.224108:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689394432:12345-192.168.204.40@tcp:38:ptlrpcd_01_01.0 Request processed in 83us (243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047214.224116:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1048 00010000:00010000:1.0:1784047214.866952:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047215.891010:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709162368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047215.891080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047215.891173:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709162368 00000100:00100000:1.0:1784047215.891181:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709162368 00000100:00100000:1.0:1784047215.891253:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1784047215.891270:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709162368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047215.891302:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047215.891349:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709162368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047215.891356:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00080000:0.0:1784047215.891423:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047215.891459:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709162368:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047215.892248:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047215.892757:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047215.892774:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709162496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047215.892855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047215.893043:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709162496 00000100:00100000:0.0:1784047215.893051:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709162496 00000100:00100000:0.0:1784047215.893145:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1784047215.893153:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709162496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047215.893180:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047215.893232:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709162496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047215.893239:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:1.0:1784047215.893363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709162496:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784047215.893410:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784047216.915751:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784047216.917337:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784047216.917352:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411435 is committed 00000020:00000080:1.0:1784047216.917358:0:75662:0:(genops.c:906:class_export_put()) final put ffff99cbc7652800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047216.917515:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7652800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784047216.917577:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7651000 for lustre-MDT0001 00000001:00100000:1.0:1784047216.918056:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047216.918061:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccc5c01000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784047216.918284:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047216.918288:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccf7598000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047216.918346:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c01000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784047216.918399:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7598000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784047216.918418:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5c01800 for lustre-OST0000 00000020:00000080:0.0:1784047216.918423:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd8416800 for lustre-OST0001 00010000:00010000:1.0:1784047217.940785:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047218.962890:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047218.963030:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047218.963035:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047218.963039:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047218.963049:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3312 00000100:00080000:1.0:1784047218.963055:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047218.963062:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047218.963086:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce411b800 x1870705709162752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047218.963287:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047218.963308:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709162624:0@lo:400:kworker.0 00000400:00000100:3.0:1784047218.963358:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709162624 offset 0 length 224: 4 00000100:00080000:1.0:1784047218.963504:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047218.963508:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047218.963510:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047218.963514:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3312 00000100:00080000:1.0:1784047218.963517:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047218.963520:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047218.963532:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce4119880 x1870705709163008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047218.963548:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047218.963551:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047218.963553:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047218.963556:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3312 00000100:00080000:1.0:1784047218.963558:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047218.963562:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047218.963571:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce4118e00 x1870705709163264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047218.963637:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047218.963640:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047218.963642:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047218.963646:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3312 00000100:00080000:1.0:1784047218.963648:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047218.963652:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047218.963663:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce411b100 x1870705709163648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047218.963732:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709163136:0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.963768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047218.963798:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047218.963804:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709162880:0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.963827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047218.963856:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163136 00000100:00100000:3.0:1784047218.963863:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163136 00000100:00100000:3.0:1784047218.963909:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709162880 00000100:00100000:3.0:1784047218.963912:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709162880 00000100:00100000:3.0:1784047218.963935:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1784047218.963943:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709163136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.963992:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709163136:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047218.963999:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1784047218.964016:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1784047218.964022:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709162880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.964049:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709162880:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047218.964055:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1784047218.964073:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709163392:0@lo:400:kworker.0 00000100:00100000:2.0:1784047218.964404:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709162752:0@lo:38:kworker.0 00000100:00100000:2.0:1784047218.964434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047218.964451:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709163008:0@lo:38:kworker.0 00000100:00100000:2.0:1784047218.964472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047218.964489:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709163264:0@lo:38:kworker.0 00000100:00100000:2.0:1784047218.964513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047218.964531:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709163648:0@lo:38:kworker.0 00000100:00100000:2.0:1784047218.964551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047218.964574:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163264 00000100:00100000:2.0:1784047218.964584:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163264 00000100:00100000:2.0:1784047218.964638:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:2.0:1784047218.964643:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709163264:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047218.964660:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047218.964698:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709163264:12345-0@lo:38:kworker.0 Request processed in 53us (183us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047218.964705:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:2.0:1784047218.964740:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709163520:0@lo:400:kworker.0 00000100:00100000:2.0:1784047218.964768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047218.964801:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047218.964812:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709162752 00000100:00100000:2.0:1784047218.964815:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709162752 00000100:00100000:2.0:1784047218.964827:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163008 00000100:00100000:2.0:1784047218.964830:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163008 00000100:00100000:2.0:1784047218.964835:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163648 00000100:00100000:2.0:1784047218.964837:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163648 00000100:00100000:2.0:1784047218.964845:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1784047218.964849:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709162752:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047218.964859:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047218.964884:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709162752:12345-0@lo:38:kworker.0 Request processed in 33us (450us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047218.964890:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1784047218.964900:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1784047218.964904:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709163008:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047218.964913:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047218.964935:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709163008:12345-0@lo:38:kworker.0 Request processed in 29us (461us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047218.964950:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1784047218.964963:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1784047218.964967:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709163648:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047218.964976:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047218.965002:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709163648:12345-0@lo:38:kworker.0 Request processed in 33us (450us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047218.965008:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00080000:2.0:1784047218.965042:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047218.965047:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047218.965050:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709162752:0@lo:38:kworker.0 00000100:00080000:2.0:1784047218.965059:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047218.965062:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047218.965064:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709163008:0@lo:38:kworker.0 00000100:00080000:2.0:1784047218.965071:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047218.965074:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047218.965077:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709163264:0@lo:38:kworker.0 00000100:00080000:2.0:1784047218.965083:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047218.965086:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047218.965089:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709163648:0@lo:38:kworker.0 00000100:00100000:3.0:1784047218.965282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047218.965327:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709162880:0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.965338:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709163136:0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.965384:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163520 00000100:00100000:3.0:1784047218.965388:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163520 00000100:00100000:3.0:1784047218.965421:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163392 00000100:00100000:3.0:1784047218.965424:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163392 00000100:00100000:3.0:1784047218.965446:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:3.0:1784047218.965451:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709163520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.965490:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709163520:12345-0@lo:400:kworker.0 Request processed in 38us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047218.965496:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:3.0:1784047218.965507:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:3.0:1784047218.965513:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709163392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.965542:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709163392:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047218.965548:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00080000:3.0:1784047218.965561:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047218.965563:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047218.965579:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709163520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047218.965600:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709163392:0@lo:400:kworker.0 00000400:00000100:3.0:1784047219.335466:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689394560 offset 0 length 224: 4 00000100:00100000:0.0:1784047219.340243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047219.340287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047219.340319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047219.340360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047219.340399:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394944 00000100:00100000:0.0:1784047219.340415:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394944 00000100:00100000:3.0:1784047219.340428:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394688 00000100:00100000:3.0:1784047219.340436:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394688 00000100:00100000:3.0:1784047219.340486:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689394816 00000100:00100000:0.0:1784047219.340489:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689395072 00000100:00100000:0.0:1784047219.340493:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689395072 00000100:00100000:3.0:1784047219.340508:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689394816 00000100:00100000:0.0:1784047219.340535:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2366 00000100:00100000:3.0:1784047219.340552:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1042 00000100:00100000:0.0:1784047219.340554:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689394944:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047219.340567:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689394816:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047219.340672:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2367 00000100:00100000:1.0:1784047219.340685:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689395072:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047219.340705:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1052 00000100:00100000:2.0:1784047219.340724:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689394688:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047219.340745:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047219.343705:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689394816:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 3128us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047219.343734:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1042 00000100:00080000:3.0:1784047219.343787:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047219.343794:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047219.343797:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047219.346554:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689394944:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 5992us (6218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047219.346555:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689395072:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 5858us (6177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047219.346579:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2367 00000100:00100000:2.0:1784047219.351985:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689394688:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 11257us (11740us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047219.352005:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1052 00000100:00100000:0.0:1784047219.353091:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2366 00010000:00010000:1.0:1784047219.987010:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047221.010861:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047221.011228:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047221.011253:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709163776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047221.011342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047221.011390:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709163904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047221.011426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047221.011457:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163776 00000100:00100000:1.0:1784047221.011466:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163776 00000100:00080000:3.0:1784047221.011629:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047221.011990:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709163904 00000100:00100000:1.0:1784047221.011996:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709163904 00000100:00080000:3.0:1784047221.012058:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047221.015388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1784047221.015420:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709163776:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047221.015436:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1784047221.015446:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709163904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047221.015473:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1784047221.015511:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047221.015564:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709163904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (4136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047221.015572:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1784047221.015660:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709163904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047221.017186:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709163776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1780us (5839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047221.017197:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1784047221.017271:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709163776:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047222.035764:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047223.058742:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047224.082897:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709164032:0@lo:400:kworker.0 00000400:00000100:3.0:1784047224.082955:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709164032 offset 0 length 224: 4 00000100:00080000:2.0:1784047224.083029:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047224.083034:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047224.083038:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047224.083044:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1784047224.083048:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047224.083056:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047224.083080:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb82300 x1870705709164160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047224.083161:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709164288:0@lo:400:kworker.0 00000100:00100000:1.0:1784047224.083206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047224.086076:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164288 00000100:00100000:0.0:1784047224.086092:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164288 00000100:00100000:0.0:1784047224.086243:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1784047224.086258:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047224.086358:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709164288:12345-0@lo:400:kworker.0 Request processed in 105us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047224.086365:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1784047224.086456:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709164288:0@lo:400:kworker.0 00000100:00080000:2.0:1784047224.087459:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047224.087465:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047224.087469:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047224.087477:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1784047224.087494:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047224.087499:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00010000:00010000:2.0:1784047224.087511:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047224.087527:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709164160:0@lo:38:kworker.0 00000100:00100000:2.0:1784047224.087581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047224.087698:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb80a80 x1870705709164416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047224.087725:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709164416:0@lo:38:kworker.0 00000100:00100000:2.0:1784047224.087752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047224.088165:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164160 00000100:00100000:2.0:1784047224.088172:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164160 00000100:00100000:2.0:1784047224.088211:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164416 00000100:00100000:2.0:1784047224.088215:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164416 00000100:00100000:2.0:1784047224.088235:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1784047224.088241:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709164160:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047224.088260:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047224.088303:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709164160:12345-0@lo:38:kworker.0 Request processed in 60us (722us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047224.088310:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1784047224.088327:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1784047224.088330:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709164416:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047224.088340:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047224.088436:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709164416:12345-0@lo:38:kworker.0 Request processed in 103us (683us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047224.088443:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1784047224.088550:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047224.088555:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047224.088558:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709164416:0@lo:38:kworker.0 00000100:00080000:2.0:1784047224.088570:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047224.088574:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047224.088576:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709164160:0@lo:38:kworker.0 00000100:00080000:2.0:1784047224.088657:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047224.088661:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047224.088662:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047224.088666:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1784047224.088676:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047224.088681:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047224.088694:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709164544:0@lo:400:kworker.0 00000100:00100000:2.0:1784047224.088721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047224.088759:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb81500 x1870705709164672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047224.088900:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709164672:0@lo:38:kworker.0 00000100:00100000:2.0:1784047224.088930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047224.088965:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164672 00000100:00100000:2.0:1784047224.088969:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164672 00000100:00100000:2.0:1784047224.088991:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1784047224.088995:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709164672:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047224.089007:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047224.089038:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709164672:12345-0@lo:38:kworker.0 Request processed in 41us (108us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047224.089045:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00080000:2.0:1784047224.089072:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047224.089076:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047224.089079:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709164672:0@lo:38:kworker.0 00000100:00100000:2.0:1784047224.089110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047224.089116:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709164800:0@lo:400:kworker.0 00000100:00100000:2.0:1784047224.089141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047224.089177:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784047224.089306:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164544 00000100:00100000:3.0:1784047224.089310:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164544 00000100:00080000:2.0:1784047224.089340:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047224.089343:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047224.089364:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1784047224.089366:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047224.089371:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047224.089378:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047224.089386:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709164928:0@lo:400:kworker.0 00000100:00100000:2.0:1784047224.089412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047224.089438:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164800 00000100:00100000:2.0:1784047224.089441:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164800 00000100:00080000:1.0:1784047224.090069:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047224.090075:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047224.090122:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1784047224.090134:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709164544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047224.090212:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709164544:12345-0@lo:400:kworker.0 Request processed in 79us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047224.090593:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709164928 00000100:00100000:2.0:1784047224.090599:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709164928 00000100:00100000:2.0:1784047224.090660:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1784047224.090668:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709164800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047224.090706:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709164800:12345-0@lo:400:kworker.0 Request processed in 39us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047224.090713:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1784047224.090728:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:2.0:1784047224.090735:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709164928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047224.091430:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709164928:12345-0@lo:400:kworker.0 Request processed in 691us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047224.091441:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00100000:2.0:1784047224.093485:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709164928:0@lo:400:kworker.0 00000100:00080000:2.0:1784047224.093533:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047224.093595:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb82d80 x1870705709165056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047224.093658:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709165056:0@lo:38:kworker.0 00000100:00100000:2.0:1784047224.093730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047224.093787:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165056 00000100:00100000:2.0:1784047224.094297:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165056 00000100:00100000:1.0:1784047224.098915:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709164800:0@lo:400:kworker.0 00000100:00100000:1.0:1784047224.098931:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709164544:0@lo:400:kworker.0 00000100:00100000:3.0:1784047224.099202:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1784047224.100596:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1784047224.100635:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709165056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047224.100664:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047224.100772:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709165056:12345-0@lo:38:kworker.0 Request processed in 147us (7040us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047224.100781:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:2.0:1784047224.100846:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047224.100852:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047224.100857:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709165056:0@lo:38:kworker.0 00000100:00100000:3.0:1784047224.453870:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047224.453904:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689395328 00000100:00100000:3.0:1784047224.453912:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689395328 00000100:00100000:3.0:1784047224.453951:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1056 00000100:00100000:3.0:1784047224.453971:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689395328:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047224.453994:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047224.454059:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689395328:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 87us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047224.454076:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1056 00000100:00100000:0.0:1784047224.459780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047224.459993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047224.460033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:0.0:1784047224.460051:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689395200 offset 0 length 224: 4 00000100:00100000:0.0:1784047224.460089:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689395584 00000100:00100000:0.0:1784047224.460098:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689395584 00000100:00100000:0.0:1784047224.460163:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689395712 00000100:00100000:0.0:1784047224.460167:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689395712 00000100:00100000:0.0:1784047224.460194:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4931 00000100:00100000:0.0:1784047224.460205:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689395584:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1784047224.460238:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7738cd 00000100:00080000:0.0:1784047224.460246:0:26182:0:(import.c:65:import_set_state_nolock()) ffff99cbcd4b2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047224.460292:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968748 00000100:00100000:0.0:1784047224.460457:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+2:2398:x1870705689395584:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 254us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047224.460466:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4931 00000100:00100000:0.0:1784047224.460482:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4932 00000100:00100000:0.0:1784047224.460488:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689395712:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1784047224.460500:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77343c 00000100:00080000:0.0:1784047224.460504:0:26182:0:(import.c:65:import_set_state_nolock()) ffff99ccc6dad800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047224.460528:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968748 00000100:00100000:0.0:1784047224.460652:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+2:2398:x1870705689395712:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 118us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047224.460659:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4932 00000100:00080000:0.0:1784047224.460683:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047224.460688:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047224.460704:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047224.461920:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047224.462962:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689395456 00000100:00100000:2.0:1784047224.462972:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689395456 00000100:00100000:2.0:1784047224.463053:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1045 00000100:00100000:2.0:1784047224.463064:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689395456:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047224.463137:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689395456:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047224.463146:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1045 00000100:00080000:1.0:1784047224.463585:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784047225.108386:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047226.131089:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709165184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047226.131184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047226.131326:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047226.131337:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165184 00000100:00100000:3.0:1784047226.131347:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165184 00000100:00100000:0.0:1784047226.131355:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709165312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047226.131391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047226.131424:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047226.131568:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165312 00000100:00100000:2.0:1784047226.131572:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165312 00000100:00100000:3.0:1784047226.131574:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1784047226.131591:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709165184:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047226.131679:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1784047226.131688:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709165312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047226.131713:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047226.131761:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709165312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (369us total) trans 0 rc 0/0 00002000:00000024:3.0:1784047226.131762:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047226.131775:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1784047226.131805:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709165184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 223us (622us total) trans 0 rc 0/0 00010000:00010000:0.0:1784047226.131808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047226.131812:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1784047226.131831:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709165312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047226.131863:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709165184:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784047226.131905:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784047227.155812:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047228.181048:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1784047229.202706:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047213/real 1784047213] req@ffff99ccfde0ce00 x1870705709160704/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047229.202736:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99ccfde0ce00 x1870705709160704/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047229.202755:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784047229.202759:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1784047229.209156:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047229.220152:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784047229.220158:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784047229.220168:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccfde0ce00 x1870705709160704/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047229.220181:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cce4119180 x1870705709162624/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047234 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047229.220203:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccfeb82a00 x1870705709164032/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047240 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784047229.220213:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784047229.220216:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784047229.220226:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784047229.220229:0:3647:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1784047229.220450:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709164032:0@lo:400:kworker.0 00000100:00080000:3.0:1784047229.222832:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047229.222841:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784047229.222845:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047229.222852:0:52247:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3089 00000100:00080000:3.0:1784047229.222861:0:52247:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047229.222894:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86f800 x1870705709165440/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047229.222946:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709165440:0@lo:250:kworker.0 00000400:00000100:2.0:1784047229.222993:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709165440 offset 0 length 520: 4 00000100:00100000:1.0:1784047229.223025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709162624:0@lo:400:kworker.0 00000100:00080000:3.0:1784047229.223045:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047229.223050:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047229.223052:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047229.223056:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3322 00000100:00080000:3.0:1784047229.223061:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047229.223065:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047229.223081:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86f480 x1870705709165568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047229.223128:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709160704:0@lo:400:kworker.0 00000100:00100000:2.0:1784047229.226864:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709165568:0@lo:38:kworker.0 00000100:00100000:2.0:1784047229.226940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047229.227131:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165568 00000100:00100000:3.0:1784047229.227140:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165568 00000100:00100000:3.0:1784047229.227254:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1784047229.227262:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709165568:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047229.227283:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047229.227341:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709165568:12345-0@lo:38:kworker.0 Request processed in 77us (400us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047229.227349:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:2.0:1784047229.227408:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047229.227413:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047229.227417:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709165568:0@lo:38:kworker.0 00000100:00080000:3.0:1784047229.228021:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784047229.228117:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047229.228131:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709165696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047229.228172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047229.228235:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047229.228245:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047229.228250:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3322 00000100:00080000:3.0:1784047229.228254:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047229.228260:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047229.228290:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86d880 x1870705709165824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047229.228370:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165696 00000100:00100000:2.0:1784047229.228375:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165696 00000100:00100000:2.0:1784047229.228419:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1784047229.228427:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709165696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047229.228473:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709165696:12345-0@lo:400:kworker.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047229.228480:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00080000:1.0:1784047229.228500:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047229.228515:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709165824:0@lo:38:kworker.0 00000100:00100000:1.0:1784047229.228559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047229.228678:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165824 00000100:00100000:2.0:1784047229.228683:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165824 00000100:00100000:2.0:1784047229.228704:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00080000:3.0:1784047229.228707:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784047229.228708:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709165824:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1784047229.228710:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047229.228712:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047229.228715:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3322 00000100:00080000:3.0:1784047229.228718:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047229.228721:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00010000:00020000:2.0:1784047229.228721:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047229.228728:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047229.228987:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709165952:0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.229018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047229.229052:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709165952 00000100:00100000:3.0:1784047229.229055:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709165952 00000100:00100000:3.0:1784047229.229086:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1784047229.229092:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709165952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.229129:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709165952:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047229.229135:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1784047229.229166:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709165952:0@lo:400:kworker.0 00000100:00080000:3.0:1784047229.229186:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047229.229209:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86ed80 x1870705709166080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047229.229250:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709166208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.229277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047229.229324:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166208 00000100:00100000:3.0:1784047229.229328:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166208 00000100:00100000:3.0:1784047229.229364:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:3.0:1784047229.229371:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709166208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.229415:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709166208:12345-0@lo:400:kworker.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047229.229421:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00100000:3.0:1784047229.229448:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709166208:0@lo:400:kworker.0 00000100:00080000:3.0:1784047229.229462:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047229.229480:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047229.229484:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047229.229486:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047229.229490:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3322 00000100:00080000:3.0:1784047229.229493:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047229.229497:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047229.229503:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047229.229512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709166336:0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.229547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047229.229575:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166336 00000100:00100000:3.0:1784047229.229579:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166336 00000100:00100000:3.0:1784047229.229624:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:3.0:1784047229.229631:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709166336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.229668:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709166336:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047229.229679:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000100:00100000:3.0:1784047229.229708:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709166336:0@lo:400:kworker.0 00000100:00080000:3.0:1784047229.229721:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047229.229751:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86c380 x1870705709166464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047229.230393:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709165824:12345-0@lo:38:kworker.0 Request processed in 1681us (1831us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047229.230401:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:1.0:1784047229.230467:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047229.230473:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047229.230477:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709165824:0@lo:38:kworker.0 00000100:00100000:1.0:1784047229.230517:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709166080:0@lo:38:kworker.0 00000100:00100000:1.0:1784047229.230567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047229.230587:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709166464:0@lo:38:kworker.0 00000100:00100000:1.0:1784047229.230624:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047229.230675:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709165696:0@lo:400:kworker.0 00000100:00100000:3.0:1784047229.230862:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166464 00000100:00100000:3.0:1784047229.230867:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166464 00000100:00100000:3.0:1784047229.230904:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1784047229.230910:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709166464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047229.230927:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047229.230970:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709166464:12345-0@lo:38:kworker.0 Request processed in 59us (345us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047229.230977:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:1.0:1784047229.230997:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047229.231001:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047229.231004:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709166464:0@lo:38:kworker.0 00000100:00100000:2.0:1784047229.231098:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166080 00000100:00100000:2.0:1784047229.231102:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166080 00000100:00100000:2.0:1784047229.231129:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:2.0:1784047229.231134:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709166080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047229.231145:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047229.231185:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709166080:12345-0@lo:38:kworker.0 Request processed in 49us (618us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047229.231191:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00080000:3.0:1784047229.231251:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047229.231256:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047229.231258:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709166080:0@lo:38:kworker.0 00000400:00000100:0.0:1784047229.578055:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689395840 offset 0 length 224: 4 00000100:00100000:0.0:1784047229.578172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047229.578537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047229.578590:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396096 00000100:00100000:2.0:1784047229.578602:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396096 00000100:00080000:0.0:1784047229.578671:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047229.578695:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689395968 00000100:00100000:2.0:1784047229.578700:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689395968 00000100:00100000:2.0:1784047229.578720:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1048 00000100:00100000:2.0:1784047229.578730:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689396096:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047229.578799:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1060 00000100:00100000:3.0:1784047229.578808:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689395968:12345-192.168.204.40@tcp:38:kworker.0 00000100:00100000:2.0:1784047229.578814:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689396096:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 82us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047229.578824:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1048 00010000:00020000:3.0:1784047229.578834:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047229.578868:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689395968:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 59us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047229.578875:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1060 00010000:00010000:1.0:1784047230.229142:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1784047230.621485:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689396224 offset 0 length 520: 4 00000100:00100000:1.0:1784047230.621549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047230.621594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047230.621657:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396352 00000100:00100000:1.0:1784047230.621666:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396352 00000100:00100000:1.0:1784047230.621701:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396480 00000100:00100000:1.0:1784047230.621711:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396480 00000100:00100000:1.0:1784047230.621961:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1049 00000100:00100000:1.0:1784047230.621973:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689396480:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047230.622058:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689396480:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 88us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047230.622068:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1049 00000100:00100000:1.0:1784047230.622087:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1061 00000100:00100000:1.0:1784047230.622092:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689396352:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:1.0:1784047230.622213:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047230.622242:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689396352:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 147us (693us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047230.622249:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1061 00000001:00100000:2.0:1784047230.747056:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047230.747066:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccc6dab800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:3.0:1784047230.747144:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dab800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0001 00000020:00000080:3.0:1784047230.747196:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6dad800 for lustre-OST0001 00000001:00100000:1.0:1784047230.749909:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:1.0:1784047230.749918:0:8425:0:(genops.c:906:class_export_put()) final put ffff99cbcd4b6800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:3.0:1784047230.750465:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcd4b6800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0000 00000020:00000080:3.0:1784047230.751478:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcd4b2000 for lustre-OST0000 00010000:00010000:0.0:1784047231.250781:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047231.251803:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709166592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047231.251898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047231.251972:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166592 00000100:00100000:2.0:1784047231.251982:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166592 00000100:00100000:2.0:1784047231.252069:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1784047231.252081:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709166592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047231.252122:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047231.252179:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709166592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047231.252188:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00080000:2.0:1784047231.252216:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047231.252269:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709166592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047231.252423:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047231.252435:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709166720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047231.252478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047231.252645:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166720 00000100:00100000:2.0:1784047231.252651:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166720 00000100:00100000:2.0:1784047231.252697:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1784047231.252704:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709166720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047231.252724:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047231.252762:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709166720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047231.252769:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1784047231.252805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709166720:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784047231.253391:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000004:0.0:1784047232.030847:0:85146:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784047232.030857:0:85146:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784047232.030859:0:85146:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784047232.030995:0:85146:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ccfddd1000 00000020:01000004:0.0:1784047232.031017:0:85146:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784047232.031035:0:85146:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784047232.031055:0:85146:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99ccfebb19c0) 00000020:00000080:0.0:1784047232.031081:0:85146:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784047232.130234:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784047232.131264:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.134813:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.136200:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784047232.136784:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.137076:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.137352:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.137599:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784047232.138031:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784047232.138357:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.138832:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.139046:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784047232.139359:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1784047232.139791:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784047232.140025:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784047232.140561:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.140927:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.141138:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.141406:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.141862:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.142073:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.142333:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.142548:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.142970:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.143189:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.143498:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.143898:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.144107:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.144375:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.144578:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.144913:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.145113:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.145565:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.146001:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.146207:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.146496:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.151011:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.151750:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.152007:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.152356:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.152657:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.152970:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.153417:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.153819:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784047232.154589:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.155422:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784047232.155875:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784047232.164917:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784047232.165582:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784047232.165875:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784047232.166452:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784047232.166743:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784047232.166924:0:85146:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1784047232.168530:0:85146:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784047232.169065:0:85146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784047232.169079:0:85146:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784047232.169095:0:85146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7739e5 00000020:01000004:1.0:1784047232.169106:0:85146:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784047232.169120:0:85146:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784047232.169127:0:85146:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccfddd1000 from MGS 00000020:01000004:1.0:1784047232.169132:0:85146:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784047232.169147:0:85146:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cd00104d40) 00000020:00000080:1.0:1784047232.169161:0:85146:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1784047232.169248:0:85146:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccfddd1000 from MGS, refs=2 00080000:01000000:1.0:1784047232.169255:0:85146:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784047232.169260:0:85146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7739f3 00010000:00010000:1.0:1784047232.169405:0:85146:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784047232.181026:0:85146:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784047232.182462:0:85150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784047232.182536:0:85146:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784047232.182586:0:85146:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784047232.183411:0:85146:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784047232.185255:0:85146:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784047232.185530:0:85146:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784047232.185539:0:85146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784047232.187336:0:85146:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784047232.187351:0:85146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784047232.188393:0:85146:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784047232.188405:0:85146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784047232.188992:0:85146:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784047232.189028:0:85146:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1784047232.189035:0:85146:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1784047232.189040:0:85146:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1784047232.189047:0:85146:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 59, was 0): CONNECTING 00000100:00100000:3.0:1784047232.189054:0:85146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:1.0:1784047232.275561:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047233.300994:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047234.322980:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047234.322995:0:81515:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784047234.322999:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047234.323003:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047234.323009:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047234.323019:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3327 00000100:00080000:2.0:1784047234.323026:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047234.323063:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047234.323117:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb82300 x1870705709166848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047234.323208:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047234.323213:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047234.323215:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047234.323219:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3327 00000100:00080000:2.0:1784047234.323222:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047234.323226:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047234.323241:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0045b800 x1870705709167104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047234.323246:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709166976:0@lo:400:kworker.0 00000100:00080000:2.0:1784047234.323280:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047234.323285:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047234.323286:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047234.323302:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3327 00000100:00080000:2.0:1784047234.323305:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047234.323308:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047234.323323:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0045bb80 x1870705709167360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047234.323349:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047234.323352:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047234.323354:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047234.323358:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3327 00000100:00080000:2.0:1784047234.323364:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1784047234.323364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047234.323376:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047234.323391:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0045aa00 x1870705709167744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047234.323417:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047234.323422:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709167232:0@lo:400:kworker.0 00000100:00100000:2.0:1784047234.323483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047234.323507:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047234.323512:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709167488:0@lo:400:kworker.0 00000100:00100000:2.0:1784047234.323547:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047234.323550:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709167616:0@lo:400:kworker.0 00000100:00100000:3.0:1784047234.323586:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709166848:0@lo:38:kworker.0 00000100:00100000:0.0:1784047234.323602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047234.323652:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166976 00000100:00100000:2.0:1784047234.323662:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166976 00000100:00100000:3.0:1784047234.323728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047234.323870:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167488 00000100:00100000:0.0:1784047234.323876:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167488 00000100:00100000:0.0:1784047234.323915:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167616 00000100:00100000:0.0:1784047234.323919:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167616 00000100:00100000:0.0:1784047234.323962:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1784047234.323976:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709167488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047234.324059:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709167488:12345-0@lo:400:kworker.0 Request processed in 86us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047234.324067:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1784047234.324089:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:3.0:1784047234.324209:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709167104:0@lo:38:kworker.0 00000100:00100000:3.0:1784047234.324241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047234.324335:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709167616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047234.324388:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709167616:12345-0@lo:400:kworker.0 Request processed in 293us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047234.324396:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00080000:0.0:1784047234.324420:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047234.324424:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047234.324437:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047234.324450:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047234.324540:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709167488:0@lo:400:kworker.0 00000100:00100000:0.0:1784047234.324581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709167616:0@lo:400:kworker.0 00000100:00100000:2.0:1784047234.326331:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167232 00000100:00100000:2.0:1784047234.326352:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167232 00000100:00100000:2.0:1784047234.326487:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709166848 00000100:00100000:2.0:1784047234.326492:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709166848 00000100:00100000:2.0:1784047234.326513:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1784047234.326526:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709166976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047234.326656:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709166976:12345-0@lo:400:kworker.0 Request processed in 132us (3295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047234.326664:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1784047234.326692:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1784047234.326700:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709167232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047234.326769:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709167360:0@lo:38:kworker.0 00000100:00100000:2.0:1784047234.327128:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709167232:12345-0@lo:400:kworker.0 Request processed in 426us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047234.327137:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1784047234.327152:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167104 00000100:00100000:2.0:1784047234.327157:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167104 00000100:00100000:2.0:1784047234.327244:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1784047234.327268:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709166848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047234.327305:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047234.327347:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709166848:12345-0@lo:38:kworker.0 Request processed in 79us (3623us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047234.327355:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1784047234.327367:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1784047234.327372:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709167104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047234.327382:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047234.327409:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709167104:12345-0@lo:38:kworker.0 Request processed in 35us (3167us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047234.327415:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:2.0:1784047234.327460:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047234.327498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047234.327547:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709167744:0@lo:38:kworker.0 00000100:00100000:3.0:1784047234.327584:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047234.327589:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709167232:0@lo:400:kworker.0 00000100:00080000:3.0:1784047234.327690:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784047234.327696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709166976:0@lo:400:kworker.0 00000100:00080000:3.0:1784047234.327701:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047234.327715:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709166848:0@lo:38:kworker.0 00000100:00080000:3.0:1784047234.327734:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047234.327738:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047234.327741:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709167104:0@lo:38:kworker.0 00000100:00100000:3.0:1784047234.327786:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167744 00000100:00100000:3.0:1784047234.327793:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167744 00000100:00100000:3.0:1784047234.327971:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1784047234.327979:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709167744:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047234.327999:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047234.328111:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709167744:12345-0@lo:38:kworker.0 Request processed in 130us (525us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047234.328134:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1784047234.328164:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167360 00000100:00100000:3.0:1784047234.328169:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167360 00000100:00100000:3.0:1784047234.328248:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:3.0:1784047234.328252:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709167360:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047234.328263:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047234.328293:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709167360:12345-0@lo:38:kworker.0 Request processed in 39us (1284us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047234.328299:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00080000:2.0:1784047234.328342:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047234.328350:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047234.328354:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709167360:0@lo:38:kworker.0 00000100:00080000:2.0:1784047234.328367:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047234.328371:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047234.328374:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709167744:0@lo:38:kworker.0 00010000:00010000:1.0:1784047235.346918:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047235.720557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047235.720951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047235.721167:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396736 00000100:00100000:3.0:1784047235.721180:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396736 00000100:00080000:2.0:1784047235.721435:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047235.721540:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396608 00000100:00100000:3.0:1784047235.721545:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396608 00000100:00100000:1.0:1784047235.721590:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1052 00000100:00100000:1.0:1784047235.721648:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689396736:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047235.721787:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689396736:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 184us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047235.721797:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1052 00000100:00100000:1.0:1784047235.721823:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1065 00000100:00100000:1.0:1784047235.721828:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689396608:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:1.0:1784047235.721861:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047235.721896:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689396608:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 65us (945us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047235.721925:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1065 00000100:00100000:3.0:1784047236.370906:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709167872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047236.371044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047236.371179:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709167872 00000100:00100000:2.0:1784047236.371190:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709167872 00000100:00100000:2.0:1784047236.371283:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:2.0:1784047236.371320:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709167872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047236.371364:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047236.371434:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709167872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047236.371442:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00080000:3.0:1784047236.372563:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047236.372645:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709167872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047236.372766:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709168000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047236.372840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047236.373655:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047236.375120:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168000 00000100:00100000:3.0:1784047236.375138:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168000 00000100:00100000:3.0:1784047236.375230:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1784047236.375241:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709168000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047236.375283:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047236.375372:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709168000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047236.375379:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1784047236.375763:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709168000:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784047236.375899:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784047237.399388:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047238.418764:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047239.443157:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047239.443172:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784047239.443176:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047239.443180:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047239.443186:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047239.443198:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1784047239.443205:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047239.443215:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047239.443454:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0045bb80 x1870705709168128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047239.443527:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047239.443530:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047239.443532:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047239.443536:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1784047239.443538:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047239.443542:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047239.443558:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00458e00 x1870705709168384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047239.443583:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047239.443637:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047239.443639:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047239.443643:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1784047239.443646:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047239.443650:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047239.443667:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00458a80 x1870705709168640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047239.443691:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047239.443695:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047239.443696:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047239.443699:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1784047239.443701:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047239.443705:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047239.443715:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0045ad80 x1870705709169024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047239.444139:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709168896:0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.444243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.444304:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047239.444311:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709168256:0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.444352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.444386:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709168512:0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.444418:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.444446:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047239.444454:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709168768:0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.444484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.444501:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168256 00000100:00100000:0.0:1784047239.444518:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168256 00000100:00100000:1.0:1784047239.444527:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168896 00000100:00100000:1.0:1784047239.444535:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168896 00000100:00100000:3.0:1784047239.444648:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047229/real 1784047229] req@ffff99ccec86f800 x1870705709165440/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047239 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047239.444675:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168768 00000100:00100000:2.0:1784047239.444681:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168768 00000100:00100000:3.0:1784047239.444689:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ccec86f800 x1870705709165440/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047239 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047239.444790:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168512 00000100:00100000:0.0:1784047239.444796:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168512 00000100:00100000:1.0:1784047239.444871:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1784047239.444872:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1784047239.444889:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709168256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.444897:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709168896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.444993:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709168896:12345-0@lo:400:kworker.0 Request processed in 109us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.445005:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1784047239.445033:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709168256:12345-0@lo:400:kworker.0 Request processed in 145us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.445043:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1784047239.445071:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1784047239.445076:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709168256:0@lo:400:kworker.0 00000100:00100000:0.0:1784047239.445085:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047239.445099:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709168896:0@lo:400:kworker.0 00000100:00100000:0.0:1784047239.445139:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709168512:12345-0@lo:400:kworker.0 Request processed in 58us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.445150:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1784047239.445159:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709168512:0@lo:400:kworker.0 00000100:00080000:0.0:1784047239.445182:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047239.445189:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047239.445192:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047239.445242:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047239.445433:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709168128:0@lo:38:kworker.0 00000100:00100000:3.0:1784047239.445474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.445512:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709168384:0@lo:38:kworker.0 00000100:00100000:3.0:1784047239.445535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.445563:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709168640:0@lo:38:kworker.0 00000100:00100000:3.0:1784047239.445592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.445645:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709169024:0@lo:38:kworker.0 00000100:00100000:3.0:1784047239.445670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047239.445692:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047239.445708:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784047239.445716:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709165440:0@lo:250:kworker.0 00000100:00100000:3.0:1784047239.445745:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168128 00000100:00100000:3.0:1784047239.445749:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168128 00000100:00100000:3.0:1784047239.445771:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168384 00000100:00100000:3.0:1784047239.445774:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168384 00000100:00100000:3.0:1784047239.445788:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169024 00000100:00100000:3.0:1784047239.445790:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169024 00000100:00100000:3.0:1784047239.445802:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1784047239.445807:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709168128:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047239.445825:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047239.445861:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709168128:12345-0@lo:38:kworker.0 Request processed in 52us (386us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047239.445885:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1784047239.445903:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1784047239.445907:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709168384:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047239.445917:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047239.445944:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709168384:12345-0@lo:38:kworker.0 Request processed in 35us (408us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047239.445950:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1784047239.445961:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1784047239.445965:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709169024:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047239.445974:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047239.445998:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709169024:12345-0@lo:38:kworker.0 Request processed in 31us (327us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047239.446004:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:3.0:1784047239.446037:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047239.446055:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047239.446059:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709168128:0@lo:38:kworker.0 00000100:00080000:3.0:1784047239.446069:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047239.446072:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047239.446075:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709168384:0@lo:38:kworker.0 00000100:00080000:3.0:1784047239.446083:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047239.446086:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047239.446089:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709169024:0@lo:38:kworker.0 10000000:01000000:3.0:1784047239.446118:0:85146:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1784047239.446142:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46400/0x4426598c0c7736ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7736b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446154:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46400/0x4426598c0c7736ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7736b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446161:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784047239.446175:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446184:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46400/0x4426598c0c7736ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7736b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446216:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773618 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446223:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773618 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446228:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446235:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446239:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773618 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446249:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c77362d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773634 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446255:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c77362d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773634 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446259:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446274:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446278:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c77362d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773634 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446298:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77365e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446322:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77365e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446327:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446358:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446363:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77365e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446372:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c773665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77366c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446378:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c773665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77366c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446383:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446391:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446394:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c773665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77366c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446403:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446409:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446414:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446437:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446442:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773688 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446452:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6da00/0x4426598c0c77368f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446458:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6da00/0x4426598c0c77368f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446463:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446475:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446479:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6da00/0x4426598c0c77368f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773696 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446489:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c7736b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7736c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446495:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c7736b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7736c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446501:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446510:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446514:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c7736b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7736c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446531:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0a00/0x4426598c0c77361f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773626 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446538:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0a00/0x4426598c0c77361f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773626 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446552:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446558:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446562:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0a00/0x4426598c0c77361f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773626 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446583:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ca00/0x4426598c0c77363b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773642 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446590:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ca00/0x4426598c0c77363b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773642 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446595:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047239.446600:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446604:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ca00/0x4426598c0c77363b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773642 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446660:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c773649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446666:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c773649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446671:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784047239.446677:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446681:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c773649 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773650 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446690:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6de00/0x4426598c0c773673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77367a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446706:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6de00/0x4426598c0c773673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77367a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446711:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784047239.446726:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446731:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6de00/0x4426598c0c773673 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77367a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.446740:0:85146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c77369d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7736a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047239.446746:0:85146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c77369d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7736a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.446752:0:85146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784047239.446766:0:85146:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047239.446769:0:85146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c77369d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7736a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784047239.446794:0:85146:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 59, was 0): DISCONN 00000100:00080000:3.0:1784047239.446800:0:85146:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047239.446804:0:85146:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3327 00000100:00080000:3.0:1784047239.446809:0:85146:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047239.446814:0:85146:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047239.446842:0:85146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86f800 x1870705709169152/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047239.446861:0:85146:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1784047239.446874:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709169152:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784047239.446922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047239.446995:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047239.447000:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784047239.447026:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709168640 00000100:00100000:3.0:1784047239.447032:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709168640 00000100:00100000:3.0:1784047239.447058:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1784047239.447064:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709168640:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047239.447079:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047239.447116:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709168640:12345-0@lo:38:kworker.0 Request processed in 50us (1522us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047239.447123:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00080000:3.0:1784047239.447151:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047239.447155:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047239.447159:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709168640:0@lo:38:kworker.0 00000100:00100000:1.0:1784047239.447729:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169152 00000100:00100000:1.0:1784047239.447737:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169152 00000100:00100000:1.0:1784047239.447783:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784047239.447789:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870705709169152:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784047239.447811:0:85152:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6e36843b-2016-43fe-8842-da5818d68597@0@lo t0 exp 0000000000000000 cur 3337 last 0 00000020:00000080:1.0:1784047239.447842:0:85152:0:(genops.c:1406:class_connect()) connect: client 6e36843b-2016-43fe-8842-da5818d68597, cookie 0x4426598c0c7739fa 00000100:00100000:2.0:1784047239.447894:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:2.0:1784047239.447914:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709168768:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784047239.448019:0:85152:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047239.448021:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709168768:12345-0@lo:400:kworker.0 Request processed in 113us (3533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.448037:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1784047239.450699:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+5:3644:x1870705709169152:12345-0@lo:250:mount.lustre.0 Request processed in 2898us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.450716:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784047239.450810:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 24 00000100:00080000:1.0:1784047239.450821:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:1.0:1784047239.450830:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784047239.450835:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784047239.450840:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784047239.450844:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784047239.450874:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784047239.450887:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709169152:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784047239.450941:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709168768:0@lo:400:kworker.0 00000100:00080000:1.0:1784047239.450964:0:85146:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1784047239.450978:0:85146:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784047239.451023:0:85146:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1784047239.451030:0:85146:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784047239.451145:0:85146:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784047239.451186:0:85146:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784047239.451190:0:85146:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784047239.451191:0:85146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784047239.451192:0:85146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047239.451194:0:85146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047239.451195:0:85146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047239.451196:0:85146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047239.451202:0:85146:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047239.451203:0:85146:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784047239.451205:0:85146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047239.451206:0:85146:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784047239.451209:0:85146:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784047239.451211:0:85146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784047239.451212:0:85146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784047239.451213:0:85146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047239.451214:0:85146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047239.451215:0:85146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047239.451216:0:85146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047239.451217:0:85146:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047239.451217:0:85146:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784047239.451218:0:85146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047239.451220:0:85146:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784047239.451242:0:85146:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784047239.451259:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709169280:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784047239.451346:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.451385:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047239.451421:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169280 00000100:00100000:1.0:1784047239.451428:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169280 00000100:00100000:1.0:1784047239.451468:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784047239.451478:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+5:85146:x1870705709169280:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784047239.451522:0:85154:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784047239.451526:0:85154:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784047239.451529:0:85154:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000000:2.0:1784047239.458072:0:52247:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.140@tcp 10000000:01000000:2.0:1784047239.458102:0:52247:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1784047239.458106:0:52247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784047239.458108:0:52247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047239.458117:0:52247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.458119:0:52247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.458120:0:52247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.458121:0:52247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.458122:0:52247:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047239.458124:0:52247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.458126:0:52247:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047239.458244:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709169408:0@lo:253:kworker.0 00000100:00100000:0.0:1784047239.458346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1784047239.458421:0:52247:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784047239.458430:0:52247:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1784047239.458432:0:52247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784047239.458433:0:52247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784047239.458434:0:52247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.458435:0:52247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.458436:0:52247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.458437:0:52247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.458439:0:52247:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047239.458440:0:52247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.458441:0:52247:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784047239.458465:0:52247:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784047239.458470:0:52247:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1784047239.458472:0:52247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784047239.458473:0:52247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784047239.458474:0:52247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.458475:0:52247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.458477:0:52247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.458478:0:52247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.458479:0:52247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047239.458481:0:52247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.458482:0:52247:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784047239.458494:0:52247:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1784047239.458525:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709169536:0@lo:253:kworker.0 00000100:00100000:2.0:1784047239.458559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.458578:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047239.458584:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709169664:0@lo:253:kworker.0 00000100:00100000:2.0:1784047239.458639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.458703:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169408 00000100:00100000:2.0:1784047239.458710:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169408 00000100:00100000:2.0:1784047239.458756:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169536 00000100:00100000:2.0:1784047239.458759:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169536 00000100:00100000:2.0:1784047239.458769:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169664 00000100:00100000:2.0:1784047239.458771:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169664 00000100:00100000:2.0:1784047239.458783:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784047239.458790:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:3648:x1870705709169408:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784047239.458823:0:85152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1784047239.458928:0:85156:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784047239.459047:0:85154:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 105 20000000:01000000:3.0:1784047239.472137:0:85157:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784047239.472149:0:85157:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784047239.472152:0:85157:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784047239.472155:0:85157:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784047239.472486:0:85157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784047239.475718:0:85154:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784047239.475785:0:85152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784047239.476557:0:85154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784047239.479794:0:85152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784047239.479816:0:85152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784047239.480058:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:85146:x1870705709169280:12345-0@lo:253:mount.lustre.0 Request processed in 28577us (28707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.480072:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784047239.480120:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784047239.480150:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+7:3645:x1870705709169536:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784047239.480182:0:85154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784047239.480196:0:85154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784047239.480399:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709169280:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784047239.480416:0:85146:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784047239.480419:0:85146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784047239.480421:0:85146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784047239.480422:0:85146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047239.480424:0:85146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047239.480425:0:85146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047239.480426:0:85146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047239.480427:0:85146:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784047239.480436:0:85146:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784047239.480438:0:85146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047239.480439:0:85146:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784047239.480462:0:85146:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccfddd1000 from lustre-MDT0000 10000000:01000000:3.0:1784047239.480498:0:85146:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784047239.480501:0:85146:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784047239.480511:0:85146:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccfddd1000 10000000:01000000:3.0:1784047239.480515:0:85146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784047239.480520:0:85146:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ccfddd1000 10000000:01000000:3.0:1784047239.480523:0:85146:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784047239.480526:0:85146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccfddd1000 from 1 10000000:01000000:3.0:1784047239.480530:0:85146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784047239.480574:0:85146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.480584:0:85146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.480594:0:85146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047239.480656:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709169792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784047239.480699:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.480730:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047239.480924:0:85153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1784047239.480932:0:85153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:0.0:1784047239.481301:0:85156:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784047239.481314:0:85156:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784047239.481344:0:85156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481360:0:85156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047239.481381:0:85156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067037s 00010000:00010000:0.0:1784047239.481386:0:85156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481392:0:85156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481398:0:85156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481405:0:85156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481410:0:85156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047239.481414:0:85156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481422:0:85156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481435:0:85156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481443:0:85156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.481449:0:85156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc800/0x4426598c0c773a08 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047239.481778:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3648:x1870705709169408:12345-0@lo:253:kworker.0 Request processed in 22984us (23429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.481788:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784047239.481819:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169792 00000100:00100000:1.0:1784047239.481825:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169792 00000100:00100000:1.0:1784047239.481852:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784047239.481858:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3645:x1870705709169664:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784047239.481880:0:85152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1784047239.482010:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784047239.482019:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+7:85146:x1870705709169792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047239.482028:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047239.482044:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c773a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773a01 expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.482062:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c773a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773a01 expref: 8 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.482071:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c773a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773a01 expref: 8 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.482078:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0c00, rc 0) 00000100:00100000:2.0:1784047239.482116:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:85146:x1870705709169792:12345-0@lo:101:mount.lustre.0 Request processed in 99us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.482121:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784047239.482204:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709169792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047239.482221:0:85146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.482229:0:85146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.482258:0:85146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784047239.482276:0:85146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.482283:0:85146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047239.482291:0:85146:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784047239.482295:0:85146:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784047239.482301:0:85146:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ccfddd1000 10000000:01000000:3.0:1784047239.482506:0:85146:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784047239.482511:0:85146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784047239.482514:0:85146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784047239.482550:0:85146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.482557:0:85146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.482566:0:85146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047239.482584:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709169920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784047239.482670:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.482694:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005240 going to sleep for 11 seconds 00000020:01000004:0.0:1784047239.482868:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784047239.482878:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784047239.482880:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047239.482881:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047239.482882:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047239.482883:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047239.482885:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784047239.482887:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047239.482888:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047239.482892:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709169408:0@lo:253:kworker.0 00000100:00100000:1.0:1784047239.482989:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709169920 00000100:00100000:1.0:1784047239.482994:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709169920 00000100:00100000:1.0:1784047239.483036:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784047239.483046:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:85146:x1870705709169920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047239.483055:0:85153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047239.483070:0:85153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24ac00/0x4426598c0c773a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773a16 expref: -99 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.483087:0:85153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24ac00/0x4426598c0c773a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773a16 expref: 9 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.483096:0:85153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24ac00/0x4426598c0c773a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773a16 expref: 9 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.483104:0:85153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24ac00, rc 0) 00000100:00100000:1.0:1784047239.483146:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:85146:x1870705709169920:12345-0@lo:101:mount.lustre.0 Request processed in 103us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.483159:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784047239.483655:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709169920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047239.483670:0:85146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.483686:0:85146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047239.483752:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709170048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047239.483785:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.483812:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047239.483867:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170048 00000100:00100000:2.0:1784047239.483874:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170048 00000100:00100000:2.0:1784047239.483903:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784047239.483911:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:85146:x1870705709170048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047239.484067:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709170048:12345-0@lo:501:mount.lustre.0 Request processed in 156us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.484075:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784047239.484159:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709170048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047239.484186:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709170176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047239.484223:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.484243:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047239.484282:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170176 00000100:00100000:2.0:1784047239.484286:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170176 00000100:00100000:2.0:1784047239.484303:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784047239.484381:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709170176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047239.489259:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709170176:12345-0@lo:503:mount.lustre.0 Request processed in 4867us (5022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.489277:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784047239.489499:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709170176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047239.490461:0:85159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85159:1870705709170304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047239.490524:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.490636:0:85159:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23780 going to sleep for 11 seconds 20000000:01000000:0.0:1784047239.490972:0:85154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047239.490991:0:85154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784047239.491249:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:3645:x1870705709169536:12345-0@lo:253:kworker.0 Request processed in 11106us (32687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.491265:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784047239.491299:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170304 00000100:00100000:0.0:1784047239.491319:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170304 20000000:01000000:1.0:1784047239.491393:0:85152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1784047239.491670:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784047239.491674:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784047239.491675:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.491677:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.491678:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.491680:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.491682:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047239.491684:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.491685:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784047239.491689:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709169536:0@lo:253:kworker.0 20000000:01000000:2.0:1784047239.491716:0:85156:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047239.491721:0:85156:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047239.491741:0:85156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491758:0:85156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784047239.491768:0:85156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067037s 00010000:00010000:2.0:1784047239.491773:0:85156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491789:0:85156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491797:0:85156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491806:0:85156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491813:0:85156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047239.491817:0:85156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491825:0:85156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491840:0:85156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491848:0:85156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.491854:0:85156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1200/0x4426598c0c773a24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047239.496667:0:85152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784047239.496680:0:85152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784047239.497004:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:3645:x1870705709169664:12345-0@lo:253:kworker.0 Request processed in 15139us (38357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.497018:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784047239.497065:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784047239.497078:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:85159:x1870705709170304:12345-0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784047239.497248:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784047239.497251:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784047239.497252:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047239.497254:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047239.497255:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047239.497257:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047239.497258:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047239.497260:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047239.497261:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047239.497265:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709169664:0@lo:253:kworker.0 20000000:01000000:2.0:1784047239.497583:0:85156:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047239.497589:0:85156:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047239.497627:0:85156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497643:0:85156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784047239.497664:0:85156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000076154s 00010000:00010000:2.0:1784047239.497670:0:85156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497678:0:85156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497686:0:85156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497696:0:85156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497704:0:85156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047239.497708:0:85156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497717:0:85156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497730:0:85156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497737:0:85156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.497743:0:85156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773a2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047239.498203:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:85159:x1870705709170304:12345-0@lo:502:llog_process_th.0 Request processed in 1127us (7676us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.498214:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784047239.498318:0:85159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85159:1870705709170304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047239.498370:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047239.498382:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.498384:0:85159:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784047239.498390:0:85159:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784047239.498393:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047239.498408:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cbc76cb380) 00000020:00000080:2.0:1784047239.498430:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1784047239.498437:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784047239.498527:0:85159:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784047239.498534:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773a39 00000020:00000080:2.0:1784047239.498833:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784047239.498838:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047239.498843:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.498844:0:85159:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784047239.498847:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047239.498851:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.498852:0:85159:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784047239.498855:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047239.498863:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cbc76c8000) 00000020:00000080:2.0:1784047239.498877:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1784047239.498881:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784047239.498883:0:85159:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784047239.498886:0:85159:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784047239.498892:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784047239.498943:0:85159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccfddd1000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784047239.498955:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cbc76ccd40) 00000020:00000080:2.0:1784047239.498965:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1784047239.499028:0:85159:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784047239.499035:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773a4e 00000020:00000080:2.0:1784047239.499141:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784047239.499148:0:85159:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784047239.499152:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4426598c0c773a55 00080000:01000000:2.0:1784047239.499164:0:85159:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784047239.499168:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773a5c 00010000:00010000:2.0:1784047239.589179:0:85159:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784047239.590035:0:85159:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a2569b5-a558-4441-a96a-1d77608df16b idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:2.0:1784047239.590097:0:85159:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:2.0:1784047239.590119:0:85159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1784047239.590234:0:85159:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784047239.590289:0:85159:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cbc109ce40: xid 1870705689388032, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:2.0:1784047239.590838:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99cd00d799c0) 00000020:00000080:2.0:1784047239.590859:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784047239.591019:0:85159:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784047239.591027:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773a78 00000020:00000080:3.0:1784047239.591582:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784047239.601467:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4426598c0c773a7f 00000020:00000080:3.0:1784047239.602055:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784047239.602068:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047239.602074:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047239.602077:0:85159:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784047239.602080:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784047239.602082:0:85159:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784047239.602083:0:85159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784047239.602085:0:85159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784047239.602086:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784047239.602089:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047239.602090:0:85159:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784047239.602092:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047239.602097:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047239.602098:0:85159:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784047239.602102:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784047239.602144:0:85159:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784047239.602162:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047239.602166:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047239.602167:0:85159:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784047239.602170:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047239.602173:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047239.602174:0:85159:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784047239.602183:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784047239.602189:0:85159:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:3.0:1784047239.602212:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784047239.602227:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99cceff38000) 00000020:00000080:3.0:1784047239.602243:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1784047239.602248:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784047239.602305:0:85159:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784047239.602311:0:85159:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784047239.602316:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773a8d 00010000:00080000:3.0:1784047239.602369:0:85159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cd00328800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:3.0:1784047239.609978:0:85159:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1784047239.612451:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047239.612469:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784047239.612506:0:85159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784047239.612543:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773a94 00000100:00080000:2.0:1784047239.612554:0:85159:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047239.612560:0:85159:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cd00328800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047239.612595:0:85159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00458a80 x1870705709170432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047239.612791:0:85159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784047239.612882:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709170432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047239.612959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.613024:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170432 00000100:00100000:1.0:1784047239.613038:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170432 00000100:00100000:1.0:1784047239.613070:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1784047239.613077:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709170432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784047239.613102:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3337 last 0 00000020:00000080:1.0:1784047239.613133:0:8441:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773a9b 00000004:00100000:1.0:1784047239.613148:0:8441:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047239.613248:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccd001c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047239.613303:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709170432:12345-0@lo:38:llog_process_th.0 Request processed in 224us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.613310:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1784047239.613359:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784047239.613367:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1784047239.613373:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784047239.613378:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784047239.613380:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cd00328800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:2.0:1784047239.613451:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047239.613456:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.613458:0:85159:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784047239.613462:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784047239.613464:0:85159:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1784047239.613466:0:85159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047239.613467:0:85159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047239.613469:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784047239.613477:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.613479:0:85159:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784047239.613482:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784047239.613486:0:85159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784047239.613489:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.613490:0:85159:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784047239.613494:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784047239.613497:0:85159:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:2.0:1784047239.613517:0:85159:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784047239.613519:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047239.613545:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cce497cd40) 00000020:00000080:2.0:1784047239.613562:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1784047239.613567:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784047239.613667:0:85159:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784047239.613674:0:85159:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784047239.613682:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773aa9 00010000:00080000:2.0:1784047239.613712:0:85159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccec804800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047239.613922:0:85159:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:2.0:1784047239.614970:0:85159:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784047239.615001:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784047239.615240:0:85159:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1784047239.616052:0:85159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047239.616085:0:85159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:2.0:1784047239.616244:0:85159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000100:00100000:0.0:1784047239.616838:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047239.616859:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709170560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047239.616943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.617004:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170560 00000100:00100000:0.0:1784047239.617013:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170560 00000100:00100000:0.0:1784047239.617064:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:0.0:1784047239.617072:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709170560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047239.617110:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047239.617167:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709170560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.617175:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:0.0:1784047239.617229:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709170560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047239.617354:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709170432:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1784047239.620078:0:85165:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:3.0:1784047239.620090:0:85165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784047239.620297:0:85165:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1784047239.620322:0:85165:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784047239.620486:0:85165:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1784047239.620490:0:85165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784047239.621912:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047239.621927:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784047239.621971:0:85159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784047239.621998:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773ab0 00000100:00080000:0.0:1784047239.622009:0:85159:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047239.622015:0:85159:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccec804800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047239.622048:0:85159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030dc00 x1870705709170688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047239.622076:0:85159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784047239.622134:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047239.622139:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047239.622141:0:85159:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784047239.622144:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784047239.622147:0:85159:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1784047239.622148:0:85159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047239.622150:0:85159:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047239.622151:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784047239.622154:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047239.622155:0:85159:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784047239.622157:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784047239.622161:0:85159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784047239.622165:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047239.622166:0:85159:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784047239.622169:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784047239.622173:0:85159:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:0.0:1784047239.622195:0:85159:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784047239.622207:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784047239.622219:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ccfebb4d40) 00000020:00000080:0.0:1784047239.622235:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1784047239.622241:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784047239.622311:0:85159:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784047239.622318:0:85159:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784047239.622323:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773abe 00010000:00080000:0.0:1784047239.622364:0:85159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccec319000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1784047239.622564:0:85159:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1784047239.622789:0:85159:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784047239.622807:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784047239.623384:0:85159:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:1.0:1784047239.623656:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709170688:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784047239.623732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.623893:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170688 00000100:00100000:3.0:1784047239.623903:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170688 00000100:00100000:3.0:1784047239.623945:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933 00000100:00100000:3.0:1784047239.623953:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3644:x1870705709170688:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1784047239.623984:0:26180:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3337 last 0 00000020:00000080:3.0:1784047239.624020:0:26180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773ac5 00002000:00100000:3.0:1784047239.624033:0:26180:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cbc753c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784047239.624037:0:26180:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784047239.624041:0:26180:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784047239.624099:0:26180:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784047239.624127:0:26180:0:(import.c:65:import_set_state_nolock()) ffff99cce4924000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047239.624198:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709170688:12345-0@lo:8:llog_process_th.0 Request processed in 244us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.624206:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933 00000100:00100000:3.0:1784047239.624253:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047239.624261:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784047239.624269:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784047239.624274:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784047239.624276:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec804800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784047239.624285:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784047239.624290:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709170688:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1784047239.624313:0:85165:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784047239.624374:0:85165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3337876766826ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784047239.624381:0:85165:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1784047239.625922:0:85147:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1784047239.626222:0:85159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784047239.626256:0:85159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:0.0:1784047239.626582:0:85159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:0.0:1784047239.627146:0:85167:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1784047239.627153:0:85167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1784047239.627412:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709170816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047239.627491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.627583:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170816 00000100:00100000:2.0:1784047239.627590:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170816 00000100:00100000:2.0:1784047239.627843:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1784047239.627852:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709170816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047239.627880:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047239.627927:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709170816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.627946:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00080000:0.0:1784047239.628073:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047239.628110:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709170816:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1784047239.629104:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047239.629117:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784047239.629160:0:85159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784047239.629186:0:85159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773acc 00000100:00080000:1.0:1784047239.629195:0:85159:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784047239.629200:0:85159:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ccec319000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047239.629227:0:85159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfde0f800 x1870705709170944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047239.629296:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709170944:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047239.629368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.629464:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709170944 00000100:00100000:0.0:1784047239.629472:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709170944 00000100:00100000:0.0:1784047239.629504:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:0.0:1784047239.629510:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3644:x1870705709170944:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784047239.629546:0:26196:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3337 last 0 00000020:00000080:0.0:1784047239.629577:0:26196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773ad3 00002000:00100000:0.0:1784047239.629594:0:26196:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99ccd8410800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784047239.629635:0:26196:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784047239.629639:0:26196:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784047239.629736:0:26196:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047239.629763:0:26196:0:(import.c:65:import_set_state_nolock()) ffff99ccff384000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784047239.630016:0:85159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784047239.630102:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047239.630108:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047239.630110:0:85159:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784047239.630113:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047239.630117:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047239.630118:0:85159:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784047239.630121:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784047239.630123:0:85159:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784047239.630125:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047239.630128:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047239.630129:0:85159:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784047239.630132:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047239.630134:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047239.630135:0:85159:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784047239.630139:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784047239.630173:0:85159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85159:1870705709171072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047239.630226:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.630247:0:85159:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.630480:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709170944:12345-0@lo:8:llog_process_th.0 Request processed in 967us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.630488:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00100000:3.0:1784047239.630773:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047239.630785:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784047239.630794:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784047239.630800:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784047239.630803:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec319000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784047239.630851:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784047239.630859:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709170944:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047239.630900:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171072 00000100:00100000:3.0:1784047239.630906:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171072 00000100:00100000:3.0:1784047239.630950:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784047239.630958:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:85159:x1870705709171072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047239.631102:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:85159:x1870705709171072:12345-0@lo:502:llog_process_th.0 Request processed in 145us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.631110:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784047239.631187:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709171200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047239.631217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.631260:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171200 00000100:00100000:3.0:1784047239.631264:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171200 00000100:00100000:3.0:1784047239.631305:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1784047239.631312:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709171200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047239.631348:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047239.631388:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709171200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.631394:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1784047239.631429:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709171200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047239.631553:0:85159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85159:1870705709171072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047239.631579:0:85159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047239.631586:0:85159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.631588:0:85159:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784047239.631591:0:85159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:0.0:1784047239.632125:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:0.0:1784047239.632144:0:85146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1784047239.632174:0:85146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784047239.632198:0:85146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.632211:0:85146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047239.632220:0:85146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccfddd1000 from 1 10000000:01000000:0.0:1784047239.632223:0:85146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784047239.632257:0:85146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.632265:0:85146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.632274:0:85146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047239.632292:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047239.632347:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.632391:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.632436:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709171456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784047239.632470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.632507:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171456 00000100:00100000:0.0:1784047239.632512:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171456 00000100:00100000:0.0:1784047239.632554:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:0.0:1784047239.632561:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709171456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784047239.632585:0:26190:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1698 count 1 00000100:00100000:0.0:1784047239.632791:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709171456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 230us (320us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047239.632799:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00000004:00080000:0.0:1784047239.632831:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cd0030c700, transno 0 00000004:00080000:0.0:1784047239.632836:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cd0030c700/1, rc -2, transno 0 00000100:00100000:0.0:1784047239.632842:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709171456:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1784047239.632976:0:85167:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1784047239.633002:0:85167:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1784047239.633016:0:85167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:0.0:1784047239.633178:0:85167:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1784047239.633182:0:85167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1784047239.633201:0:85167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784047239.633223:0:85167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3337885615610ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784047239.633228:0:85167:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784047239.633745:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171328 00000100:00100000:1.0:1784047239.633754:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171328 00000100:00100000:1.0:1784047239.633796:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047239.633804:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:85146:x1870705709171328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047239.633816:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047239.633835:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773ada expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.633863:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773ada expref: 9 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.633893:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773ada expref: 9 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.633903:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b200, rc 0) 00000100:00100000:1.0:1784047239.633950:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:85146:x1870705709171328:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.633957:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047239.634020:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047239.634038:0:85146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.634048:0:85146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047239.634710:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171584:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784047239.634767:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.634793:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d180 going to sleep for 11 seconds 00000004:00080000:0.0:1784047239.635988:0:85147:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784047239.636173:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171584 00000100:00100000:3.0:1784047239.636183:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171584 00000100:00100000:3.0:1784047239.636238:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784047239.636247:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:85146:x1870705709171584:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784047239.636270:0:85158:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784047239.636296:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784047239.636300:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784047239.636303:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784047239.636305:0:85158:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 108 00000100:00100000:3.0:1784047239.636600:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:85146:x1870705709171584:12345-0@lo:256:mount.lustre.0 Request processed in 354us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.636996:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784047239.637296:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171584:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784047239.638245:0:85146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784047239.638306:0:85146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.638341:0:85146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047239.638350:0:85146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfddd1000 from 1 10000000:01000000:0.0:1784047239.638354:0:85146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047239.638394:0:85146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.638403:0:85146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.638415:0:85146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047239.638440:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047239.638503:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.638548:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047239.638756:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171712 00000100:00100000:1.0:1784047239.638763:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171712 00000100:00100000:1.0:1784047239.638809:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784047239.638817:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:85146:x1870705709171712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047239.638830:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047239.638849:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24be00/0x4426598c0c773aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773ae8 expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.638875:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24be00/0x4426598c0c773aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773ae8 expref: 10 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.638957:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24be00/0x4426598c0c773aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773ae8 expref: 10 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.638967:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24be00, rc 0) 00000100:00100000:1.0:1784047239.639020:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709171712:12345-0@lo:101:mount.lustre.0 Request processed in 202us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.639026:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784047239.639105:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047239.639119:0:85146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.639127:0:85146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047239.639193:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047239.639221:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.639248:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784047239.639312:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171840 00000100:00100000:3.0:1784047239.639316:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171840 00000100:00100000:3.0:1784047239.639358:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784047239.639365:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709171840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047239.639507:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709171840:12345-0@lo:501:mount.lustre.0 Request processed in 143us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.639514:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784047239.639756:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047239.639785:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047239.639838:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.639854:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.639867:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709171968 00000100:00100000:0.0:1784047239.639871:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709171968 00000100:00100000:0.0:1784047239.640286:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784047239.640297:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709171968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047239.640408:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709171968:12345-0@lo:503:mount.lustre.0 Request processed in 113us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.640416:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784047239.640987:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709171968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047239.643241:0:85169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85169:1870705709172096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047239.643346:0:85169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.643431:0:85169:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.643478:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172096 00000100:00100000:0.0:1784047239.643487:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172096 00000100:00100000:0.0:1784047239.643574:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784047239.643584:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:85169:x1870705709172096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047239.644409:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:85169:x1870705709172096:12345-0@lo:502:llog_process_th.0 Request processed in 823us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.644419:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047239.644509:0:85169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85169:1870705709172096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047239.644553:0:85169:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047239.644562:0:85169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.644565:0:85169:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784047239.644571:0:85169:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccfddd1000 00000020:00000080:2.0:1784047239.644574:0:85169:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784047239.644585:0:85169:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047239.644588:0:85169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.644589:0:85169:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784047239.644592:0:85169:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047239.644594:0:85169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.644596:0:85169:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784047239.644600:0:85169:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccfddd1000 00000020:00000080:2.0:1784047239.644602:0:85169:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784047239.644720:0:85169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85169:1870705709172224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047239.644763:0:85169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.647412:0:85169:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047239.647911:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172224 00000100:00100000:3.0:1784047239.647924:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172224 00000100:00100000:3.0:1784047239.647999:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784047239.648010:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85169:x1870705709172224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047239.648184:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85169:x1870705709172224:12345-0@lo:502:llog_process_th.0 Request processed in 175us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.648192:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784047239.648308:0:85169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85169:1870705709172224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047239.648366:0:85169:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047239.648375:0:85169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047239.648378:0:85169:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784047239.648383:0:85169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784047239.648562:0:85146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784047239.648588:0:85146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047239.648629:0:85146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.648641:0:85146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047239.648720:0:85146:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784047239.648724:0:85146:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccfddd1000 10000000:01000000:0.0:1784047239.648727:0:85146:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccfddd1000 10000000:01000000:0.0:1784047239.648732:0:85146:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784047239.648737:0:85146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfddd1000 from 1 10000000:01000000:0.0:1784047239.648740:0:85146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047239.648775:0:85146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.648785:0:85146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.648795:0:85146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047239.648818:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709172352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047239.648865:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.649050:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047239.649763:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172352 00000100:00100000:3.0:1784047239.649771:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172352 00000100:00100000:3.0:1784047239.649822:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784047239.649831:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:85146:x1870705709172352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047239.649843:0:85153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047239.649863:0:85153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c773afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773af6 expref: -99 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.649887:0:85153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c773afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773af6 expref: 11 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.649898:0:85153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c773afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773af6 expref: 11 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047239.649918:0:85153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46c00, rc 0) 00000100:00100000:3.0:1784047239.649975:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709172352:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.649981:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784047239.650123:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709172352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047239.650138:0:85146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.650147:0:85146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047239.650205:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709172480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047239.650235:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.650260:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.650275:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172480 00000100:00100000:0.0:1784047239.650278:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172480 00000100:00100000:0.0:1784047239.650303:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784047239.650309:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709172480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047239.651120:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709172480:12345-0@lo:501:mount.lustre.0 Request processed in 807us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.651130:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784047239.651378:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709172480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047239.651424:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709172608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047239.651473:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.651500:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047239.651554:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172608 00000100:00100000:3.0:1784047239.651560:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172608 00000100:00100000:3.0:1784047239.651602:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784047239.651803:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709172608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047239.651906:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709172608:12345-0@lo:503:mount.lustre.0 Request processed in 107us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047239.654867:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784047239.655045:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709172608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047239.655430:0:85171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85171:1870705709172736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047239.655505:0:85171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.655602:0:85171:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047239.660250:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172736 00000100:00100000:1.0:1784047239.660268:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172736 00000100:00100000:1.0:1784047239.660380:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784047239.660391:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:85171:x1870705709172736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047239.660594:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:85171:x1870705709172736:12345-0@lo:502:llog_process_th.0 Request processed in 203us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.660601:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784047239.662885:0:85171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85171:1870705709172736:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784047239.662982:0:85171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784047239.663001:0:85171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99cceff3b380) 00000020:00000080:3.0:1784047239.663032:0:85171:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1784047239.663223:0:85171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccfddd1000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784047239.663228:0:85171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccfddd1000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784047239.663230:0:85171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccfddd1000 4 00010000:00080000:3.0:1784047239.663259:0:85171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc7a69000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:3.0:1784047239.666044:0:85171:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1784047239.666162:0:85171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784047239.666219:0:85171:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784047239.666235:0:85171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4426598c0c773b0b 00000100:00080000:3.0:1784047239.666246:0:85171:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784047239.666251:0:85171:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbc7a69000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047239.666294:0:85171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86f480 x1870705709172864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047239.666354:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709172864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784047239.666435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.666506:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172864 00000100:00100000:3.0:1784047239.666513:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172864 00000100:00100000:3.0:1784047239.667796:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1784047239.667806:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709172864:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784047239.670309:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709172864:12345-0@lo:38:llog_process_th.0 Request processed in 2492us (3864us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047239.670338:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00080000:3.0:1784047239.670383:0:85171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784047239.680120:0:85171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85171:1870705709172992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047239.680232:0:85171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.680285:0:85171:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047239.680426:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709172992 00000100:00100000:2.0:1784047239.680435:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709172992 00000100:00100000:2.0:1784047239.680494:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784047239.680505:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:85171:x1870705709172992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047239.680668:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:85171:x1870705709172992:12345-0@lo:502:llog_process_th.0 Request processed in 165us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.680678:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784047239.682177:0:85171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85171:1870705709172992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047239.682252:0:85171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85171:1870705709173120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047239.682319:0:85171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047239.682374:0:85171:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.683363:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784047239.683374:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047239.683380:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047239.683384:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709172864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047239.683636:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173120 00000100:00100000:1.0:1784047239.683644:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173120 00000100:00100000:1.0:1784047239.683693:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784047239.683702:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:85171:x1870705709173120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047239.683872:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:85171:x1870705709173120:12345-0@lo:502:llog_process_th.0 Request processed in 170us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.683880:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784047239.683996:0:85171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:85171:1870705709173120:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784047239.684026:0:85171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784047239.684817:0:85146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784047239.684845:0:85146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047239.684862:0:85146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047239.684874:0:85146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784047239.684929:0:85146:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784047239.684931:0:85146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047239.684933:0:85146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.684934:0:85146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.684935:0:85146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.684940:0:85146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.684941:0:85146:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047239.684942:0:85146:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047239.684944:0:85146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.684946:0:85146:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047239.684949:0:85146:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784047239.684952:0:85146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784047239.684953:0:85146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047239.684954:0:85146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.684955:0:85146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.684955:0:85146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.684956:0:85146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.684957:0:85146:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047239.684958:0:85146:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047239.684959:0:85146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.684960:0:85146:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047239.684980:0:85146:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784047239.684997:0:85146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709173248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784047239.685053:0:85146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047239.685087:0:85146:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047239.685112:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173248 00000100:00100000:2.0:1784047239.685117:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173248 00000100:00100000:2.0:1784047239.685153:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784047239.685160:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc87a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709173248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784047239.685183:0:85152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784047239.685197:0:85152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784047239.688761:0:85152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784047239.688775:0:85152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784047239.691176:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc87a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:85146:x1870705709173248:12345-0@lo:253:mount.lustre.0 Request processed in 6006us (6112us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.691192:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784047239.691265:0:85146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:85146:1870705709173248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784047239.691296:0:85146:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784047239.691309:0:85146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784047239.691311:0:85146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047239.691313:0:85146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047239.691314:0:85146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047239.691315:0:85146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047239.691317:0:85146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047239.691318:0:85146:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047239.691320:0:85146:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047239.691322:0:85146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047239.691323:0:85146:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784047239.691348:0:85146:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1784047239.691972:0:85156:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784047239.691980:0:85156:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784047239.692010:0:85156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.692030:0:85156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773ada expref: 10 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.692040:0:85156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.692090:0:85156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c773ada expref: 10 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.692109:0:85156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c773ada expref: 10 pid: 85154 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047239.692123:0:85156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85156:1870705709173376:0@lo:104: 00000100:00100000:0.0:1784047239.692173:0:85156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047239.692207:0:85156:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00ed3540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.692230:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173376 00000100:00100000:0.0:1784047239.692236:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173376 00000100:00100000:0.0:1784047239.692276:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784047239.692284:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:85156:x1870705709173376:12345-0@lo:104: 00010000:00010000:0.0:1784047239.692296:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.692353:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047239.692358:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:85156:x1870705709173376:12345-0@lo:104: Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.692365:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784047239.692393:0:85156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85156:1870705709173376:0@lo:104: 00010000:00010000:0.0:1784047239.692410:0:85156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.700753:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047239.700771:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.700784:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047239.700808:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.700832:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047239.700839:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047239.700846:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047239.700918:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.700925:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047239.700952:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.700959:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c773ada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c773ae1 expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.700975:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047239.700978:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047239.700979:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047239.700998:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709173504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047239.701084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.701161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173504 00000100:00100000:1.0:1784047239.701168:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173504 00010000:00010000:1.0:1784047239.701198:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c773ada expref: 11 pid: 85154 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047239.701228:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1784047239.701244:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+11:3647:x1870705709173504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047239.701258:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047239.701263:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c773ada expref: 11 pid: 85154 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701275:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c773ada expref: 11 pid: 85154 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701290:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24b200/0x4426598c0c773ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c773ada expref: 11 pid: 85154 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701305:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701313:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047239.701340:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009360769s 00010000:00010000:1.0:1784047239.701345:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701353:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701360:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701365:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701371:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047239.701381:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701389:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701402:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047239.701417:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047239.701459:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+10:3647:x1870705709173504:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047239.701467:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1784047239.701512:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709173504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047239.701968:0:85156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.701978:0:85156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047239.701985:0:85156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbca00/0x4426598c0c773b12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784047239.726839:0:85146:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411365 00000040:01000000:3.0:1784047239.727500:0:85146:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784047239.727593:0:85177:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411365 00000020:00080000:2.0:1784047239.727598:0:85177:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411365 00000040:01000000:2.0:1784047239.727843:0:85178:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1784047239.727899:0:85178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1784047239.728431:0:85146:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1784047239.730502:0:85178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784047239.730589:0:85178:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1784047239.731517:0:85179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85179:1870705709173632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784047239.731636:0:85179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.731671:0:85179:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784047239.731790:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173632 00000100:00100000:2.0:1784047239.731798:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173632 00000100:00100000:2.0:1784047239.731859:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1784047239.731868:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85179:x1870705709173632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047239.731960:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85179:x1870705709173632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.731967:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:1.0:1784047239.732082:0:85179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85179:1870705709173632:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1784047239.732114:0:85179:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784047239.732140:0:85179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85179:1870705709173760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784047239.732168:0:85179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.732191:0:85179:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784047239.732238:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173760 00000100:00100000:0.0:1784047239.732243:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173760 00000100:00100000:0.0:1784047239.732276:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1784047239.732283:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85179:x1870705709173760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047239.732485:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85179:x1870705709173760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 201us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047239.732492:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:1.0:1784047239.732726:0:85179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85179:1870705709173760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784047239.732791:0:85179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85179:1870705709173888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784047239.732818:0:85179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047239.732840:0:85179:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784047239.732935:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709173888 00000100:00100000:2.0:1784047239.732940:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709173888 00000100:00100000:2.0:1784047239.732979:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1784047239.732985:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85179:x1870705709173888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047239.733043:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85179:x1870705709173888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047239.733060:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:1.0:1784047239.733149:0:85179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85179:1870705709173888:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784047239.733190:0:85179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047239.737715:0:85179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784047239.737816:0:85179:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784047239.737822:0:85179:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1784047239.744267:0:85146:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784047239.744403:0:85146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784047239.745012:0:85146:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784047239.745023:0:85146:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784047239.745066:0:85146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047239.746654:0:85146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784047239.747216:0:85146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784047239.747245:0:85146:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784047239.747715:0:85146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784047239.748252:0:85146:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:2.0:1784047239.750731:0:85146:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:1.0:1784047239.751486:0:85180:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85180 00010000:02000000:1.0:1784047239.751537:0:85180:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1784047239.756549:0:85146:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784047239.756578:0:85146:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784047239.756597:0:85146:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784047239.756635:0:85146:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784047239.757558:0:85146:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784047239.757864:0:85146:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1784047239.773845:0:85180:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784047239.773854:0:85180:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1784047240.468957:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047240.840571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047240.840934:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396864 00000100:00100000:0.0:1784047240.840946:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396864 00000100:00100000:0.0:1784047240.841003:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:0.0:1784047240.841013:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc87a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1870705689396864:12345-192.168.204.40@tcp:250:kworker.0 00010000:00080000:0.0:1784047240.841044:0:85154:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d42aef96-772a-4ce2-a768-bea713505b5b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3339 last 0 00000020:00000080:0.0:1784047240.841074:0:85154:0:(genops.c:1406:class_connect()) connect: client d42aef96-772a-4ce2-a768-bea713505b5b, cookie 0x4426598c0c773b19 00000100:00080000:0.0:1784047240.841531:0:85154:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047240.843259:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc87a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+5:2398:x1870705689396864:12345-192.168.204.40@tcp:250:kworker.0 Request processed in 2163us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047240.843276:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:2.0:1784047240.848490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047240.848548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047240.848646:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689396992 00000100:00100000:0.0:1784047240.848656:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689396992 00000100:00100000:0.0:1784047240.848700:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397120 00000100:00100000:0.0:1784047240.848703:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397120 00000100:00080000:1.0:1784047240.848807:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047240.848925:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1055 00000100:00100000:0.0:1784047240.848939:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689397120:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047240.849075:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689397120:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 140us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047240.849083:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1055 00000100:00100000:0.0:1784047240.849104:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1070 00000100:00100000:0.0:1784047240.849123:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689396992:12345-192.168.204.40@tcp:38:kworker.0 00010000:00080000:0.0:1784047240.849149:0:67153:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a2569b5-a558-4441-a96a-1d77608df16b' at ffff99ccc355b000, cookie 0x4426598c0c773a63 00010000:00080000:0.0:1784047240.849155:0:67153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp recovering/t98784247810 exp ffff99ccc355b000 cur 3339 last 1784047239 00010000:02000400:0.0:1784047240.849163:0:67153:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784047240.849168:0:67153:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784047240.849202:0:67153:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784047240.849353:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccff383800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047240.849387:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689396992:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 263us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047240.849394:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1070 10000000:01000000:2.0:1784047240.851895:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784047240.851904:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccfddd1000 from 109 10000000:01000000:2.0:1784047240.851909:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784047240.851966:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.851977:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.851988:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.852040:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.852109:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.852157:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.852268:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174016 00000100:00100000:1.0:1784047240.852277:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174016 00000100:00100000:1.0:1784047240.852418:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784047240.852429:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:6515:x1870705709174016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.852443:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.852458:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24a400/0x4426598c0c773b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b20 expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.852482:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24a400/0x4426598c0c773b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b20 expref: 11 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.852493:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24a400/0x4426598c0c773b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b20 expref: 11 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.852502:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a400, rc 0) 00000100:00100000:1.0:1784047240.852548:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709174016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.852555:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784047240.852643:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.852658:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.852667:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.852729:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.852769:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.852792:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.852955:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174144 00000100:00100000:3.0:1784047240.852960:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174144 00000100:00100000:3.0:1784047240.852996:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784047240.853004:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec74b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709174144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047240.853018:0:85153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784047240.853043:0:85153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047240.853046:0:85153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 109 00000100:00100000:3.0:1784047240.853130:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec74b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709174144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.853137:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784047240.853669:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784047240.853729:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784047240.853736:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.853748:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047240.853758:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047240.853760:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 52 10000000:01000000:2.0:1784047240.853763:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047240.853783:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.853800:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.853809:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.853826:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.853862:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.853894:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174272 00000100:00100000:2.0:1784047240.853896:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.853899:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174272 00000100:00100000:1.0:1784047240.853933:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784047240.853939:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec74a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709174272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.853948:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.853958:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b600/0x4426598c0c773b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b2e expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.853975:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b600/0x4426598c0c773b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b2e expref: 12 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.853984:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b600/0x4426598c0c773b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b2e expref: 12 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.853990:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b600, rc 0) 00000100:00100000:1.0:1784047240.854021:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec74a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709174272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.854028:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784047240.854110:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.854121:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.854130:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.854182:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.854214:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.854238:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.854255:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174400 00000100:00100000:1.0:1784047240.854259:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174400 00000100:00100000:1.0:1784047240.854291:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784047240.854297:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709174400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.854444:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709174400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.854451:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784047240.856325:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.856391:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.856492:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.856537:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.860824:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174528 00000100:00100000:3.0:1784047240.860841:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174528 00000100:00100000:3.0:1784047240.860982:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784047240.860995:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709174528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.862072:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709174528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1075us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.862083:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047240.868295:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047240.873402:0:85240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047240.873498:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047240.873526:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047240.873540:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.873566:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047240.873576:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784047240.873578:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 106 10000000:01000000:1.0:1784047240.873581:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047240.873643:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.873651:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.873662:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.873824:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.873910:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.873969:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799db40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.874003:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174656 00000100:00100000:1.0:1784047240.874011:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174656 00000100:00100000:1.0:1784047240.874062:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784047240.874069:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709174656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.874080:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.874091:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24a200/0x4426598c0c773b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b3c expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.874112:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24a200/0x4426598c0c773b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b3c expref: 13 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.874135:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24a200/0x4426598c0c773b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b3c expref: 13 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.874144:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a200, rc 0) 00000100:00100000:1.0:1784047240.874620:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709174656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.874630:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784047240.875015:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.875088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:1.0:1784047240.875092:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.875105:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.875160:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.875285:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.875366:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799db40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047240.875420:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174784 00000100:00100000:2.0:1784047240.875426:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174784 00000100:00100000:3.0:1784047240.875452:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390464 00000100:00100000:3.0:1784047240.875456:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390464 00000100:00100000:3.0:1784047240.875491:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1071 00000100:00100000:3.0:1784047240.875500:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689390464:12345-192.168.204.40@tcp:36:mcreate.0 00000100:00100000:2.0:1784047240.875501:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784047240.875508:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709174784:12345-0@lo:256:ll_cfg_requeue.0 00010000:00080000:3.0:1784047240.875514:0:68026:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 20000000:01000000:2.0:1784047240.875523:0:85152:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:3.0:1784047240.875530:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689390464:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 32us (447us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047240.875536:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1071 20000000:01000000:2.0:1784047240.875538:0:85152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784047240.875543:0:85152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784047240.875545:0:85152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784047240.875548:0:85152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784047240.875551:0:85152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 109 00010000:00080000:3.0:1784047240.875575:0:85180:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1784047240.875658:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709174784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047240.875666:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784047240.875808:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784047240.875880:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047240.875887:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.875896:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047240.875905:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784047240.875912:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784047240.875925:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784047240.875947:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.875953:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.875961:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.875975:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.876004:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.876023:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799db40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.876046:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709174912 00000100:00100000:1.0:1784047240.876051:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709174912 00000100:00100000:1.0:1784047240.876073:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784047240.876078:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709174912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.876086:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.876097:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24aa00/0x4426598c0c773b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b4a expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.876115:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24aa00/0x4426598c0c773b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b4a expref: 14 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.876124:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24aa00/0x4426598c0c773b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b4a expref: 14 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.876132:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24aa00, rc 0) 00000100:00100000:1.0:1784047240.876158:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709174912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.876170:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784047240.876215:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709174912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.876226:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.876235:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.876284:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.876321:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.876334:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799db40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.876347:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175040 00000100:00100000:1.0:1784047240.876350:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175040 00000100:00100000:1.0:1784047240.876373:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784047240.876379:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709175040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.876519:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709175040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.876526:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784047240.876558:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.876589:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.876658:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047240.876676:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.876724:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175168 00000100:00100000:1.0:1784047240.876728:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175168 00000100:00100000:1.0:1784047240.876767:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784047240.876773:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709175168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.878455:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709175168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1676us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.878469:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784047240.878673:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047240.880756:0:85242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1784047240.881004:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1784047240.881044:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784047240.881059:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.881071:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047240.881080:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1784047240.881082:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc355c000 from 1 10000000:01000000:2.0:1784047240.881085:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784047240.881123:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.881132:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.881158:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.881189:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.881282:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.881335:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.881416:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175296 00000100:00100000:3.0:1784047240.881424:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175296 00000100:00100000:3.0:1784047240.881482:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784047240.881492:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709175296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.881507:0:85152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047240.881521:0:85152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47400/0x4426598c0c773b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b58 expref: -99 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.881544:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47400/0x4426598c0c773b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b58 expref: 15 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.881554:0:85152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47400/0x4426598c0c773b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b58 expref: 15 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.881563:0:85152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47400, rc 0) 00000100:00100000:3.0:1784047240.882550:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709175296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 698us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.882561:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784047240.883050:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.883073:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.883084:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047240.883101:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784047240.883106:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.883114:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047240.883121:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784047240.883124:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc355c000 from 7 10000000:01000000:2.0:1784047240.883126:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047240.883150:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.883158:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.883179:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.883199:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.883252:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.883291:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.883409:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175424 00000100:00100000:3.0:1784047240.883416:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175424 00000100:00100000:3.0:1784047240.883515:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784047240.883526:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709175424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.883537:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047240.883549:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c773b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b66 expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.883568:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c773b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b66 expref: 16 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.883578:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c773b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b66 expref: 16 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.883585:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47e00, rc 0) 00000100:00100000:3.0:1784047240.883646:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709175424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.883652:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784047240.883782:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.883792:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.883800:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.883862:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.883890:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.887761:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175552 00000100:00100000:2.0:1784047240.887762:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214df00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.887779:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175552 00000100:00100000:1.0:1784047240.887849:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784047240.887859:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709175552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.888033:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709175552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.888043:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784047240.890521:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.890582:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.892438:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.892490:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.892971:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175680 00000100:00100000:3.0:1784047240.892980:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175680 00000100:00100000:3.0:1784047240.893031:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784047240.893042:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709175680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.893182:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709175680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.893189:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784047240.893922:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047240.896000:0:85243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784047240.897412:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784047240.897444:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784047240.897457:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.897470:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047240.897486:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047240.897489:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 52 10000000:01000000:3.0:1784047240.897492:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047240.897532:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.897541:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.897552:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047240.897579:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.897679:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047240.897720:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.897765:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175808 00000100:00100000:1.0:1784047240.897775:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175808 00000100:00100000:1.0:1784047240.897830:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784047240.897840:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709175808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.897854:0:85153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.897868:0:85153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24a000/0x4426598c0c773b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b74 expref: -99 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.897890:0:85153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24a000/0x4426598c0c773b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b74 expref: 17 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.897901:0:85153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24a000/0x4426598c0c773b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b74 expref: 17 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.897910:0:85153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a000, rc 0) 00000100:00100000:1.0:1784047240.897974:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709175808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.897981:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784047240.898161:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.898176:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.898200:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.898261:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.898292:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.898324:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.898404:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709175936 00000100:00100000:3.0:1784047240.898408:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709175936 00000100:00100000:3.0:1784047240.898443:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784047240.898450:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709175936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.898582:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709175936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.898589:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784047240.898802:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709175936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.898831:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.898873:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.898902:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.899008:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176064 00000100:00100000:1.0:1784047240.899013:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176064 00000100:00100000:1.0:1784047240.899784:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784047240.899795:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc971b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709176064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.899906:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc971b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709176064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.899925:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784047240.901845:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047240.916538:0:85244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784047240.916815:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784047240.916843:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047240.916855:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.916867:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047240.916877:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784047240.916880:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784047240.916883:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784047240.916927:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.916935:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.916962:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.916992:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.917072:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.917119:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.917235:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176192 00000100:00100000:3.0:1784047240.917243:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176192 00000100:00100000:3.0:1784047240.917294:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784047240.917315:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709176192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.917339:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047240.917353:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46200/0x4426598c0c773b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b82 expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.917378:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46200/0x4426598c0c773b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b82 expref: 18 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.917389:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46200/0x4426598c0c773b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b82 expref: 18 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.917398:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46200, rc 0) 00000100:00100000:3.0:1784047240.917450:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709176192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.917457:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784047240.917567:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.917580:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.917589:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.917945:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.917979:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.918004:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.918062:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176320 00000100:00100000:3.0:1784047240.918067:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176320 00000100:00100000:3.0:1784047240.918133:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784047240.918142:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709176320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.918293:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709176320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.918301:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784047240.918368:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.918398:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.918444:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.922087:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.922243:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176448 00000100:00100000:1.0:1784047240.922253:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176448 00000100:00100000:1.0:1784047240.922361:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784047240.922370:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc971b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709176448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.926770:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc971b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709176448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4387us (8311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047240.926786:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784047240.926906:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047240.927750:0:85246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784047240.927910:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784047240.927934:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784047240.927953:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.927964:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047240.927974:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784047240.927976:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccf756a000 from 7 10000000:01000000:2.0:1784047240.927979:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047240.928014:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.928022:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.928031:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.928053:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.928108:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.928151:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.928195:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176576 00000100:00100000:1.0:1784047240.928202:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176576 00000100:00100000:1.0:1784047240.928250:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784047240.928260:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709176576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.928273:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.928286:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b800/0x4426598c0c773b97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b90 expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.928318:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b800/0x4426598c0c773b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b90 expref: 19 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.928342:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b800/0x4426598c0c773b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b90 expref: 19 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.928350:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b800, rc 0) 00000100:00100000:1.0:1784047240.928385:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709176576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.928392:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784047240.929403:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.929423:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.929433:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.929507:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.929567:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.929595:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.932362:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176704 00000100:00100000:1.0:1784047240.932375:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176704 00000100:00100000:1.0:1784047240.932436:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784047240.932448:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709176704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.932640:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709176704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.932648:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784047240.932709:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.932761:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.932812:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.932832:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.932846:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176832 00000100:00100000:1.0:1784047240.932850:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176832 00000100:00100000:1.0:1784047240.932869:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784047240.932874:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc971a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709176832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.932955:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc971a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709176832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.932962:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784047240.933003:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047240.933867:0:85247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784047240.933923:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784047240.933945:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784047240.933956:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.933968:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047240.933988:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047240.933991:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 52 10000000:01000000:1.0:1784047240.933994:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047240.934025:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.934032:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.934042:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.934060:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.934105:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.934123:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.934143:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709176960 00000100:00100000:1.0:1784047240.934148:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709176960 00000100:00100000:1.0:1784047240.934172:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784047240.934178:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709176960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.934187:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047240.934199:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24a800/0x4426598c0c773ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773b9e expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.934221:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24a800/0x4426598c0c773ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773b9e expref: 20 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.934231:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24a800/0x4426598c0c773ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773b9e expref: 20 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.934250:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a800, rc 0) 00000100:00100000:1.0:1784047240.934282:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709176960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.934288:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784047240.934336:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709176960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.934350:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.934358:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.934405:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.934432:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.934444:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.934455:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177088 00000100:00100000:1.0:1784047240.934458:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177088 00000100:00100000:1.0:1784047240.934475:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784047240.934480:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709177088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.934565:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709177088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.934572:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784047240.934594:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.934633:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.934667:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.934683:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.934693:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177216 00000100:00100000:1.0:1784047240.934696:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177216 00000100:00100000:1.0:1784047240.934710:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784047240.934715:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709177216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.934774:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709177216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.934780:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784047240.934815:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047240.940174:0:85248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047240.940547:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047240.940574:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047240.940587:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.940598:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047240.940629:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784047240.940631:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784047240.940634:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784047240.940669:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.940678:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.940688:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.940712:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.940795:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.940835:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.940904:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177344 00000100:00100000:3.0:1784047240.940911:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177344 00000100:00100000:3.0:1784047240.940961:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784047240.940971:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709177344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.940985:0:85158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047240.941007:0:85158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c773bb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773bac expref: -99 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.941031:0:85158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c773bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773bac expref: 21 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.941041:0:85158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c773bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773bac expref: 21 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.941049:0:85158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47a00, rc 0) 00000100:00100000:3.0:1784047240.941089:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709177344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.941095:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784047240.941353:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047240.941370:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.941379:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.941437:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.941465:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.941494:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.941508:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177472 00000100:00100000:1.0:1784047240.941511:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177472 00000100:00100000:1.0:1784047240.941533:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784047240.941539:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709177472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.941685:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709177472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047240.941691:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784047240.941719:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.941743:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.941780:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.941792:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784047240.941803:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177600 00000100:00100000:1.0:1784047240.941807:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177600 00000100:00100000:1.0:1784047240.941824:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784047240.941836:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709177600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.945180:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709177600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3335us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047240.945422:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784047240.947504:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047240.948535:0:85251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784047240.948806:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784047240.948830:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784047240.948841:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.948853:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047240.948862:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784047240.948865:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfe6b8800 from 7 10000000:01000000:1.0:1784047240.948868:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047240.948903:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.948912:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047240.948922:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047240.948947:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047240.949018:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047240.949062:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.949108:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177728 00000100:00100000:3.0:1784047240.949115:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177728 00000100:00100000:3.0:1784047240.949166:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784047240.949176:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709177728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.949188:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047240.949201:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46600/0x4426598c0c773bc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773bba expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.949223:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46600/0x4426598c0c773bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773bba expref: 22 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.949233:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46600/0x4426598c0c773bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773bba expref: 22 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.949241:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46600, rc 0) 00000100:00100000:3.0:1784047240.949288:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709177728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.949313:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784047240.949400:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.949416:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.949426:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047240.949492:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047240.949520:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047240.949542:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd214d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.949736:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177856 00000100:00100000:3.0:1784047240.949742:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177856 00000100:00100000:3.0:1784047240.949764:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784047240.949771:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709177856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.949888:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709177856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.949894:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784047240.949926:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.949955:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.949994:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047240.950016:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff367a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.950028:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709177984 00000100:00100000:3.0:1784047240.950032:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709177984 00000100:00100000:3.0:1784047240.950053:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784047240.950059:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709177984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.950134:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709177984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047240.950141:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784047240.950182:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709177984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047240.950835:0:85252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784047240.950884:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784047240.950902:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784047240.950909:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.950927:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047240.950936:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784047240.950938:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ccc5e4b380 from 1 10000000:01000000:3.0:1784047240.950941:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784047240.950965:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.950973:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.951330:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047240.951355:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709178112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.951398:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047240.951472:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047240.953088:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178112 00000100:00100000:2.0:1784047240.953099:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178112 00000100:00100000:2.0:1784047240.953182:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784047240.953193:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709178112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047240.953209:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047240.953226:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0400/0x4426598c0c773bcf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773bc8 expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.953252:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0400/0x4426598c0c773bcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773bc8 expref: 23 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.953263:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0400/0x4426598c0c773bcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773bc8 expref: 23 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047240.953284:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0400, rc 0) 00000100:00100000:2.0:1784047240.953355:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709178112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047240.953362:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784047240.953551:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709178112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.953569:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.953578:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047240.953601:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784047240.953634:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.953654:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047240.953662:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784047240.953666:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:3.0:1784047240.953668:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784047240.953695:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.953703:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.953712:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047240.953732:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709178240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.953767:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047240.957475:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047240.957555:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178240 00000100:00100000:0.0:1784047240.957564:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178240 00000100:00100000:0.0:1784047240.957640:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784047240.957650:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709178240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047240.957664:0:85153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047240.957683:0:85153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c773bdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773bd6 expref: -99 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047240.957709:0:85153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c773bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773bd6 expref: 24 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047240.957720:0:85153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c773bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773bd6 expref: 24 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047240.957730:0:85153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbdc00, rc 0) 00000100:00100000:0.0:1784047240.957796:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709178240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047240.957803:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784047240.957904:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709178240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047240.957922:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.957932:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047240.958013:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709178368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.958052:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047240.958088:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047240.958103:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178368 00000100:00100000:3.0:1784047240.958107:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178368 00000100:00100000:3.0:1784047240.958131:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784047240.958136:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709178368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047240.958208:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709178368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (155us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047240.958215:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784047240.958238:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709178368:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784047240.958263:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784047240.958270:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047240.958278:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047241.490889:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047241.493766:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047241.493789:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709178624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047241.493863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047241.493909:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178624 00000100:00100000:2.0:1784047241.493916:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178624 00000100:00100000:2.0:1784047241.494054:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1784047241.494857:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709178624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047241.494892:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047241.494952:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709178624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 889us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047241.494960:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00080000:2.0:1784047241.494989:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047241.495052:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709178624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047241.496312:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709178496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047241.496379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047241.499858:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178496 00000100:00100000:2.0:1784047241.499872:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178496 00000100:00100000:2.0:1784047241.499948:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1784047241.499959:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709178496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047241.499991:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047241.500071:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709178496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047241.500088:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1784047241.500142:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709178496:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047241.500203:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047242.508563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047242.510671:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397248 00000100:00100000:3.0:1784047242.510688:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397248 00000100:00100000:3.0:1784047242.510812:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:3.0:1784047242.510823:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+5:42435:x1870705689397248:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047242.510843:0:85152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047242.510864:0:85152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46a00/0x4426598c0c773be4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae117 expref: -99 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047242.510895:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46a00/0x4426598c0c773be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae117 expref: 6 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047242.510906:0:85152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46a00/0x4426598c0c773be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae117 expref: 6 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047242.510924:0:85152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46a00, rc 0) 00000100:00100000:3.0:1784047242.510995:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689397248:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 174us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047242.511003:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:3.0:1784047242.515010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047242.516181:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397376 00000100:00100000:1.0:1784047242.516193:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397376 00000100:00100000:1.0:1784047242.516398:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:1.0:1784047242.516410:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689397376:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784047242.516438:0:85158:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1784047242.516463:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784047242.516467:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784047242.516470:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784047242.516473:0:85158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784047242.516475:0:85158:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 109 00010000:00010000:1.0:1784047242.517641:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047242.520441:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689397376:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 4021us (5429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047242.520458:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:1.0:1784047242.532587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047242.532789:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397504 00000100:00100000:2.0:1784047242.532801:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397504 00000100:00100000:2.0:1784047242.533248:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:2.0:1784047242.533261:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf289a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689397504:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047242.533293:0:85153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047242.533314:0:85153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1600/0x4426598c0c773beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae11e expref: -99 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047242.533344:0:85153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1600/0x4426598c0c773beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae11e expref: 7 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047242.533356:0:85153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1600/0x4426598c0c773beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae11e expref: 7 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047242.533367:0:85153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1600, rc 0) 00000100:00100000:2.0:1784047242.533439:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf289a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689397504:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 181us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047242.533447:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:0.0:1784047242.535693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047242.535805:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397632 00000100:00100000:2.0:1784047242.535816:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397632 00000100:00100000:2.0:1784047242.535871:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:2.0:1784047242.535970:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689397632:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047242.536139:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689397632:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 196us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047242.536159:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:1.0:1784047242.548557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047242.548699:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397760 00000100:00100000:2.0:1784047242.548710:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397760 00000100:00100000:2.0:1784047242.548761:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:2.0:1784047242.548772:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689397760:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047242.548920:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689397760:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047242.548928:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:1.0:1784047242.555881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047242.556582:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689397888 00000100:00100000:2.0:1784047242.556593:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689397888 00000100:00100000:2.0:1784047242.556680:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:2.0:1784047242.556693:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689397888:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047242.556711:0:85154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047242.556730:0:85154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae125 expref: -99 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047242.556762:0:85154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae125 expref: 9 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047242.556773:0:85154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae125 expref: 9 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047242.556783:0:85154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0200, rc 0) 00000100:00100000:2.0:1784047242.556839:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689397888:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 149us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047242.556848:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:2.0:1784047242.562801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047242.563379:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398016 00000100:00100000:3.0:1784047242.563391:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398016 00000100:00100000:3.0:1784047242.563456:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:3.0:1784047242.563467:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689398016:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047242.563671:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689398016:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 192us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047242.563679:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:1.0:1784047242.567687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047242.567734:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398144 00000100:00100000:2.0:1784047242.567744:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398144 00000100:00100000:2.0:1784047242.567796:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:2.0:1784047242.567805:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689398144:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047242.567924:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689398144:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 121us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047242.567931:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:1.0:1784047242.585835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047242.586160:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398272 00000100:00100000:3.0:1784047242.586181:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398272 00000100:00100000:3.0:1784047242.586260:0:85152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:3.0:1784047242.586280:0:85152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689398272:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047242.586299:0:85152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047242.586535:0:85152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47200/0x4426598c0c773bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae12c expref: -99 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047242.586572:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47200/0x4426598c0c773bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae12c expref: 10 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047242.586585:0:85152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47200/0x4426598c0c773bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae12c expref: 10 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047242.586697:0:85152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47200, rc 0) 00000100:00100000:3.0:1784047242.586799:0:85152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689398272:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 529us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047242.586807:0:85152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:2.0:1784047242.594839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047242.595581:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398400 00000100:00100000:3.0:1784047242.595593:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398400 00000100:00100000:0.0:1784047242.595737:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:0.0:1784047242.595754:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689398400:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047242.595914:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689398400:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 164us (1086us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047242.595923:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 70 00010000:00010000:0.0:1784047243.544758:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784047243.548909:0:85431:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1784047244.378829:0:85483:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784047244.379028:0:85483:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047244.569385:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047245.074852:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709178752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047245.074984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047245.078684:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178752 00000100:00100000:1.0:1784047245.078710:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178752 00000100:00100000:1.0:1784047245.078910:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1784047245.078927:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709178752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047245.078986:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047245.079132:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709178752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 209us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047245.079152:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00080000:1.0:1784047245.079449:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047245.079455:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047245.079459:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047245.079465:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3337 00000100:00080000:1.0:1784047245.079539:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047245.079547:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047245.079582:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd09500 x1870705709179008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047245.079645:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047245.079649:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047245.079651:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047245.079655:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3337 00000100:00080000:1.0:1784047245.079658:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047245.079662:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047245.079673:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd0a300 x1870705709179264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047245.079695:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047245.079699:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047245.079701:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047245.079704:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3337 00000100:00080000:1.0:1784047245.079708:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047245.079713:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047245.079726:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd0b480 x1870705709179520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047245.079927:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709179136:0@lo:400:kworker.0 00000100:00100000:2.0:1784047245.079985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047245.080025:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047245.080032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709178880:0@lo:400:kworker.0 00000100:00100000:2.0:1784047245.080065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047245.080144:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179136 00000100:00100000:2.0:1784047245.080150:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179136 00000100:00100000:2.0:1784047245.080199:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1784047245.080207:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709179136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047245.080262:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709179136:12345-0@lo:400:kworker.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047245.080270:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1784047245.080293:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709178880 00000100:00100000:2.0:1784047245.080297:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709178880 00000100:00100000:2.0:1784047245.080326:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784047245.080333:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709178880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047245.080364:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709178880:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047245.080377:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1784047245.080408:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047245.080448:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709178880:0@lo:400:kworker.0 00000100:00100000:2.0:1784047245.080464:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709179136:0@lo:400:kworker.0 00000100:00080000:1.0:1784047245.080633:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047245.080637:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047245.080639:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047245.080643:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3337 00000100:00080000:1.0:1784047245.080646:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047245.080649:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047245.080662:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd09180 x1870705709179904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047245.080685:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784047245.080688:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047245.080690:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047245.080694:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbc7a69000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047245.080704:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd0bb80 x1870705709180288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047245.080728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709179776:0@lo:400:kworker.0 00000100:00100000:1.0:1784047245.080883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047245.080909:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047245.080916:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709180032:0@lo:400:kworker.0 00000100:00100000:1.0:1784047245.080942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047245.081664:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179776 00000100:00100000:3.0:1784047245.081672:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179776 00000100:00100000:3.0:1784047245.081717:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180032 00000100:00100000:3.0:1784047245.081721:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180032 00000100:00100000:3.0:1784047245.081760:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:3.0:1784047245.081769:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709179776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.081936:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709179776:12345-0@lo:400:kworker.0 Request processed in 168us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.081945:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:3.0:1784047245.081962:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:3.0:1784047245.081968:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709180032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.081999:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709180032:12345-0@lo:400:kworker.0 Request processed in 31us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.082005:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:3.0:1784047245.082050:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709180032:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.082062:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709179776:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.082088:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709179648:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.082127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047245.082173:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709178752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047245.082188:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784047245.082194:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709179392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.082234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047245.082258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709180160:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.082283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047245.082314:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179648 00000100:00100000:3.0:1784047245.082318:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179648 00000100:00100000:3.0:1784047245.082347:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180160 00000100:00100000:3.0:1784047245.082351:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180160 00000100:00100000:3.0:1784047245.082386:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:3.0:1784047245.082393:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709179648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.082432:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709179648:12345-0@lo:400:kworker.0 Request processed in 39us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.082439:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:3.0:1784047245.082453:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:3.0:1784047245.082459:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709180160:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784047245.082570:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047245.082575:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047245.082677:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709180160:12345-0@lo:400:kworker.0 Request processed in 218us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.082683:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:3.0:1784047245.082704:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179392 00000100:00100000:3.0:1784047245.082708:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179392 00000100:00100000:3.0:1784047245.083674:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1784047245.083686:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709179392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.083760:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709179392:12345-0@lo:400:kworker.0 Request processed in 77us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.083776:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1784047245.083975:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709179392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.083993:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709180160:0@lo:400:kworker.0 00000100:00100000:3.0:1784047245.084010:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709179648:0@lo:400:kworker.0 00000100:00100000:0.0:1784047245.084895:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709179008:0@lo:38:kworker.0 00000100:00100000:0.0:1784047245.084969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047245.085007:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709179264:0@lo:38:kworker.0 00000100:00100000:0.0:1784047245.085034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047245.085061:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709179520:0@lo:38:kworker.0 00000100:00100000:0.0:1784047245.085091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047245.085111:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709179904:0@lo:38:kworker.0 00000100:00100000:0.0:1784047245.085135:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047245.085155:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709180288:0@lo:38:kworker.0 00000100:00100000:0.0:1784047245.085179:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047245.086626:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179008 00000100:00100000:3.0:1784047245.086639:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179008 00000100:00100000:3.0:1784047245.086676:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179264 00000100:00100000:3.0:1784047245.086680:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179264 00000100:00100000:3.0:1784047245.086688:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179904 00000100:00100000:3.0:1784047245.086690:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179904 00000100:00100000:3.0:1784047245.086697:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180288 00000100:00100000:3.0:1784047245.086700:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180288 00000100:00100000:3.0:1784047245.086714:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1784047245.086723:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709179008:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047245.086776:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3343 last 0 00000020:00000080:3.0:1784047245.087562:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c773c00 00000004:00100000:3.0:1784047245.087587:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047245.087806:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a68800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047245.088023:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709179008:12345-0@lo:38:kworker.0 Request processed in 1298us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.088035:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1784047245.088065:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1784047245.088072:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709179264:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047245.088092:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3343 last 0 00000020:00000080:3.0:1784047245.088124:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4426598c0c773c07 00000004:00100000:3.0:1784047245.088137:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047245.088158:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047245.088191:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870705709179264:12345-0@lo:38:kworker.0 Request processed in 120us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.088198:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1784047245.088212:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1784047245.088216:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709179904:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047245.088244:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3343 last 0 00000020:00000080:3.0:1784047245.088270:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4426598c0c773c0e 00000004:00100000:3.0:1784047245.088276:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047245.088292:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99ccebebd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047245.088324:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870705709179904:12345-0@lo:38:kworker.0 Request processed in 106us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.088331:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1784047245.088345:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1784047245.088350:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709180288:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047245.088364:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3343 last 0 00000020:00000080:3.0:1784047245.088389:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4426598c0c773c15 00000004:00100000:3.0:1784047245.088395:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047245.088408:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99ccebebb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047245.088439:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709180288:12345-0@lo:38:kworker.0 Request processed in 87us (3259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.088446:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00010000:00080000:3.0:1784047245.089150:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ccfdd09500 x1870705709179008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.089172:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00080000:2.0:1784047245.090064:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047245.090101:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709179520 00000100:00100000:2.0:1784047245.090112:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709179520 00000100:00100000:2.0:1784047245.090165:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1784047245.090173:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709179520:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047245.090204:0:8441:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99ccc3558000, cookie 0x4426598c0c773a6a 00010000:00080000:2.0:1784047245.090209:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff99ccc3558000 cur 3343 last 1784047239 00000004:00100000:2.0:1784047245.090241:0:8441:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047245.090274:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99cbcd4b2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047245.090363:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709179520:12345-0@lo:38:kworker.0 Request processed in 189us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047245.090372:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00010000:00080000:2.0:1784047245.091952:0:85180:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784047245.091963:0:85180:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:2.0:1784047245.091971:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.091975:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:2.0:1784047245.091980:0:85180:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:2.0:1784047245.091983:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.091999:0:85180:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689390464 t98784247810 from 192.168.204.40@tcp req@ffff99cd0045aa00 x1870705689390464/t0(98784247810) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:371/0 lens 528/0 e 0 to 0 dl 1784047251 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.092690:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99ccfdd09500 x1870705709179008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047270 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.092704:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784047245.092710:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784047245.092716:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000004:00080000:2.0:1784047245.095889:0:85180:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3779us 00000100:00100000:3.0:1784047245.117205:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709179008:0@lo:38:kworker.0 00010000:00080000:3.0:1784047245.117302:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ccfdd0a300 x1870705709179264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.117326:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:3.0:1784047245.122402:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99ccfdd0a300 x1870705709179264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047270 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.122423:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784047245.122431:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784047245.122436:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784047245.122446:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709179264:0@lo:38:kworker.0 00000100:00080000:3.0:1784047245.123711:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:3.0:1784047245.123737:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784047245.125380:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1784047245.125385:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:3.0:1784047245.125394:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc6531800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:3.0:1784047245.125400:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1784047245.128112:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709179520:0@lo:38:kworker.0 00010000:00080000:2.0:1784047245.128169:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ccfdd09180 x1870705709179904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047245.128193:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:2.0:1784047245.129294:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99ccfdd09180 x1870705709179904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047270 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047245.129308:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784047245.129314:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784047245.129318:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784047245.129325:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709179904:0@lo:38:kworker.0 00010000:00080000:2.0:1784047245.129363:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ccfdd0bb80 x1870705709180288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047245.129377:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:2.0:1784047245.129383:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784047245.129388:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784047245.129390:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a69000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784047245.129394:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709180288:0@lo:38:kworker.0 00010000:00080000:0.0:1784047245.129534:0:85521:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1784047245.129541:0:85521:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1784047245.129553:0:85521:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1784047245.130196:0:85521:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1784047245.130433:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709180416:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1784047245.130539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047245.130804:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180416 00000100:00100000:0.0:1784047245.130880:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180416 00000100:00100000:0.0:1784047245.130947:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:0.0:1784047245.130958:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709180416:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784047245.130984:0:83733:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cd0045b800 x1870705709180416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:376/0 lens 224/0 e 0 to 0 dl 1784047256 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047245.130997:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709180416:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 41us (459us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047245.131005:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00010000:00010000:1.0:1784047245.138132:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.138167:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.138198:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.138216:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.138234:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.138242:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141521:0:85180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141554:0:85180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141564:0:85180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141571:0:85180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047245.141577:0:85180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141590:0:85180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141629:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:1.0:1784047245.141633:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047245.141639:0:85180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141656:0:85180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047245.141688:0:85180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000836c6ca0 reply state 00000000818477db transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141703:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.141711:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2a00) 00010000:00010000:1.0:1784047245.141714:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047245.141719:0:85180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784047245.142076:0:85180:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047245.142113:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047245.142118:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:1.0:1784047245.142124:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047245.142126:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000100:00100000:0.0:1784047245.146384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047245.146728:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689390976 00000100:00100000:2.0:1784047245.146742:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689390976 00000100:00100000:2.0:1784047245.146827:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1076 00000100:00100000:2.0:1784047245.146841:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689390976:12345-192.168.204.40@tcp:36:rm.0 00010000:00080000:2.0:1784047245.146870:0:66220:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:2.0:1784047245.146892:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689390976:12345-192.168.204.40@tcp:36:rm.0 Request processed in 55us (528us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047245.146901:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1076 00000020:00080000:2.0:1784047245.146926:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.146930:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:2.0:1784047245.146936:0:85180:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:2.0:1784047245.146941:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.146954:0:85180:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689390976 t98784247811 from 192.168.204.40@tcp req@ffff99cd0030f800 x1870705689390976/t0(98784247811) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 512/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784047245.147061:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147082:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147096:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147110:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147119:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147127:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147262:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147271:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147279:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147577:0:85180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147585:0:85180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147593:0:85180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147601:0:85180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047245.147629:0:85180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147639:0:85180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147654:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff99ccfebe4400) 00010000:00010000:2.0:1784047245.147658:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784047245.147663:0:85180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147672:0:85180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773c38 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147703:0:85180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147711:0:85180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147718:0:85180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147723:0:85180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047245.147726:0:85180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147731:0:85180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147739:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4b00) 00010000:00010000:2.0:1784047245.147742:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047245.147745:0:85180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147751:0:85180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047245.147762:0:85180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032e7ccf5 reply state 0000000064ceb9ca transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147776:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.147783:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2a00) 00010000:00010000:2.0:1784047245.147790:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047245.147793:0:85180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784047245.147894:0:85180:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784047245.147918:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.147921:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:2.0:1784047245.147925:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.147928:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:0.0:1784047245.151968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047245.152104:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392128 00000100:00100000:1.0:1784047245.152117:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392128 00000100:00100000:1.0:1784047245.152239:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1077 00000100:00100000:1.0:1784047245.152260:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689392128:12345-192.168.204.40@tcp:101:lfs.0 00010000:00080000:1.0:1784047245.152295:0:66221:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:1.0:1784047245.152312:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689392128:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 63us (359us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047245.152320:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1077 00000020:00080000:1.0:1784047245.153088:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047245.153096:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:1.0:1784047245.153110:0:85180:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:1.0:1784047245.153114:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047245.153128:0:85180:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689392128 t98784247812 from 192.168.204.40@tcp req@ffff99cd0030f480 x1870705689392128/t0(98784247812) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 536/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1784047245.153159:0:85180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047245.153189:0:85180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae109 expref: -99 pid: 85180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784047245.153357:0:85147:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:0.0:1784047245.153404:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.153415:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.153423:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.153430:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047245.153436:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.153445:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.153475:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2a00) 00010000:00010000:0.0:1784047245.153478:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047245.153483:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.153491:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c773c23 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.153553:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.153569:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.153582:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.153598:0:85180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.153672:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.153681:0:85180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047245.154318:0:85180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:1.0:1784047245.154345:0:85180:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x4426598c0c7739c2 00000004:00080000:1.0:1784047245.154348:0:85180:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x4426598c0c7739c2 in new mfd 00010000:00010000:1.0:1784047245.154361:0:85180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154380:0:85180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154387:0:85180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154392:0:85180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047245.154396:0:85180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154402:0:85180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154415:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa500) 00010000:00010000:1.0:1784047245.154418:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047245.154421:0:85180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154550:0:85180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773c46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047245.154567:0:85180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007047416e reply state 0000000057d19e1e transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154581:0:85180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154588:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99ccc12aa100) 00010000:00010000:1.0:1784047245.154591:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047245.154595:0:85180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047245.154701:0:85180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c3f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 10 pid: 85180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154721:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa500) 00010000:00010000:1.0:1784047245.154724:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047245.154728:0:85180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c773c3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae109 expref: 10 pid: 85180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.154883:0:85180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b000, rc 0) 00010000:00080000:1.0:1784047245.155023:0:85180:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047245.155048:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047245.155052:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:1.0:1784047245.155056:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047245.155058:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:1.0:1784047245.182281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047245.182965:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392384 00000100:00100000:3.0:1784047245.182980:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392384 00000100:00100000:3.0:1784047245.183085:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1078 00000100:00100000:3.0:1784047245.183098:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689392384:12345-192.168.204.40@tcp:101:lfs.0 00010000:00080000:3.0:1784047245.183134:0:67153:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:3.0:1784047245.183158:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689392384:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 63us (891us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047245.183167:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1078 00000020:00080000:2.0:1784047245.184951:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.184965:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:2.0:1784047245.184974:0:85180:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:2.0:1784047245.184979:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.184999:0:85180:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689392384 t98784247813 from 192.168.204.40@tcp req@ffff99ccfdd0a680 x1870705689392384/t0(98784247813) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 736/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784047245.185041:0:85180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047245.185079:0:85180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae110 expref: -99 pid: 85180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047245.186018:0:85180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:2.0:1784047245.186295:0:85180:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x4426598c0c7739d7 00000004:00080000:2.0:1784047245.186299:0:85180:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x4426598c0c7739d7 in new mfd 00010000:00010000:2.0:1784047245.186362:0:85180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae110 expref: 12 pid: 85180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.186380:0:85180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4b00) 00010000:00010000:2.0:1784047245.186384:0:85180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047245.186390:0:85180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae110 expref: 12 pid: 85180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.186433:0:85180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1a00, rc 0) 00010000:00080000:2.0:1784047245.186539:0:85180:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784047245.186569:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.186573:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:2.0:1784047245.186580:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.186582:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:3.0:1784047245.192593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047245.193629:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689392768 00000100:00100000:0.0:1784047245.193646:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689392768 00000100:00100000:0.0:1784047245.193710:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 215 00000100:00100000:0.0:1784047245.193723:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689392768:12345-192.168.204.40@tcp:35:lfs.0 00010000:00080000:0.0:1784047245.193745:0:66222:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:0.0:1784047245.193767:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689392768:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 47us (1192us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047245.193775:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 215 00000020:00080000:2.0:1784047245.193795:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.193801:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1784047245.193806:0:85180:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1784047245.193810:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.193821:0:85180:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689392768 t98784247814 from 192.168.204.40@tcp req@ffff99ccef515880 x1870705689392768/t0(98784247814) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 392/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047245.194107:0:85180:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784047245.194122:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.194125:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1784047245.194128:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.194129:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:0.0:1784047245.198466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047245.198561:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689393024 00000100:00100000:3.0:1784047245.198579:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689393024 00000100:00100000:1.0:1784047245.198832:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:1.0:1784047245.198852:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf35d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:2398:x1870705689393024:12345-192.168.204.40@tcp:35:lfs.0 00010000:00080000:1.0:1784047245.198875:0:66222:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:1.0:1784047245.198897:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf35d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:2398:x1870705689393024:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 55us (451us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047245.198905:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 216 00000020:00080000:3.0:1784047245.198946:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047245.199041:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:3.0:1784047245.199048:0:85180:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:3.0:1784047245.199055:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047245.199078:0:85180:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689393024 t98784247815 from 192.168.204.40@tcp req@ffff99ccf35d0450 x1870705689393024/t0(98784247815) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 392/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047245.199905:0:85180:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784047245.200737:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047245.200744:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:3.0:1784047245.200751:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047245.200753:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:2.0:1784047245.204701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047245.204831:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398528 00000100:00100000:3.0:1784047245.204842:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398528 00000100:00100000:3.0:1784047245.204896:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1058 00000100:00100000:3.0:1784047245.204907:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+13:2398:x1870705689398528:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784047245.204933:0:66220:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cd00458000 x1870705689398528/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 224/0 e 0 to 0 dl 1784047256 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047245.204961:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+13:2398:x1870705689398528:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 Request processed in 56us (268us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047245.204976:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1058 00000020:00080000:2.0:1784047245.205037:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.205041:0:85180:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:2.0:1784047245.205045:0:85180:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1784047245.205048:0:85180:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047245.205054:0:85180:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1784047245.205057:0:85180:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1784047245.205157:0:85180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:3.0:1784047245.208319:0:85147:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00100000:3.0:1784047245.208330:0:85147:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784047245.208368:0:85147:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:1.0:1784047245.208491:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208504:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208513:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208526:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047245.208531:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208539:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208559:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208566:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c773c31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208590:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208597:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208632:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208639:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047245.208643:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208650:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208660:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.208674:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773c4d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85180 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784047245.208760:0:85180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1784047245.208801:0:85180:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1784047245.208818:0:85180:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99cd0045b800 x1870705709180416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:376/0 lens 224/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784047245.208945:0:85180:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.40@tcp: req@ffff99cd00458000 x1870705689398528/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:376/0 lens 224/0 e 0 to 0 dl 1784047256 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.209013:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1784047245.209023:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99cd0030d880 x1870705709180416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047261 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.209034:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99cd0030d880 x1870705709180416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047261 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047245.209043:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784047245.209056:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784047245.209062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709180416:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784047245.209152:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709180544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047245.209191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047245.209255:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180544 00000100:00100000:3.0:1784047245.209261:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180544 00000100:00100000:3.0:1784047245.209302:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1784047245.209311:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709180544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047245.209336:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:3.0:1784047245.209376:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709180544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.209382:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1784047245.209415:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709180544:0@lo:41:osp-pre-0-1.0 00010000:02000000:2.0:1784047245.210302:0:85180:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000020:00000004:0.0:1784047245.229853:0:85535:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784047245.230142:0:85535:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000004:00000080:3.0:1784047245.240920:0:85180:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc914846be10 00100000:10000000:3.0:1784047245.240949:0:85180:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1784047245.251319:0:85168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1784047245.251380:0:85168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85168:1870705709180672:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784047245.251756:0:85168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047245.251809:0:85168:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe6799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047245.251917:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180672 00000100:00100000:3.0:1784047245.251925:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180672 00000100:00100000:3.0:1784047245.251977:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4936 00000100:00100000:3.0:1784047245.251988:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:85168:x1870705709180672:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784047245.252016:0:26188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -63 00002000:02000040:3.0:1784047245.252021:0:26188:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1761) 00000004:00080000:0.0:1784047245.253064:0:85166:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:0.0:1784047245.253102:0:85166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85166:1870705709180800:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784047245.253161:0:85166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047245.253189:0:85166:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047245.253212:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180800 00000100:00100000:0.0:1784047245.253217:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180800 00000100:00100000:0.0:1784047245.253266:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:0.0:1784047245.253274:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:85166:x1870705709180800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784047245.253308:0:26186:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -561 00002000:02000040:0.0:1784047245.253313:0:26186:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1761) 00002000:00010000:1.0:1784047245.278934:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047245.279055:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279072:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:1.0:1784047245.279326:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047245.279336:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279355:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279366:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279378:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279409:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047245.279743:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047245.279750:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279770:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:1.0:1784047245.279774:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047245.279778:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279789:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279798:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279806:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279824:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047245.279836:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047245.279841:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279849:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047245.279854:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279864:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279892:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279900:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028e4c078/0x4426598c0c773c69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279915:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047245.279918:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279924:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047245.279927:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279941:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279963:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279971:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244f5337/0x4426598c0c773c70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.279982:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047245.279984:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047245.279997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047245.280123:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.280131:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280142:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.280145:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.280150:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280162:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280169:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280176:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280196:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047245.280382:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.280392:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280400:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.280404:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.280408:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280415:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280422:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280429:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280443:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047245.280490:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.280496:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280503:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.280506:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.280509:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280517:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280533:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280539:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280553:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784047245.280592:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.280597:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280621:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.280625:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.280628:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280637:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280646:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280653:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280676:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784047245.280683:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047245.280687:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280694:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.280697:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280705:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280716:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280724:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773c77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280740:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047245.280758:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280764:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.280767:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280785:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280796:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280804:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773c7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280814:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047245.280817:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280823:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.280825:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280832:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280842:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280849:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773c85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280870:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.280873:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280880:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.280883:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280891:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280899:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280907:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773c8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280918:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.280919:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.280925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047245.280966:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.280971:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.280979:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.280989:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.280994:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281003:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.281007:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.281011:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.281015:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.281022:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.281022:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.281040:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047245.281049:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.281053:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281060:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.281063:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281071:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281080:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281097:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773c93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281110:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.281112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.281114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047245.281156:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.281161:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281168:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.281171:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.281175:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281184:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281192:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.281198:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.282972:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047245.283233:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.283244:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.283259:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.283264:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.283271:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.283285:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.283295:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.283303:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.283645:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047245.283654:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.283655:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.283665:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.283668:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.283674:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.283681:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047245.283688:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.283689:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.283710:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.283719:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.283726:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.283729:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773c9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047245.283751:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047245.283754:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047245.283757:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.283760:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.283763:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.283766:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.283876:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.284040:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784047245.284046:0:26188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2fd355e/0x4426598c0c773ca1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784047245.285690:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1784047245.285748:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.285757:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285788:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.285793:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.285800:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285815:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285825:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285834:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285853:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047245.285920:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.285925:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285934:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.285937:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.285942:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285953:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285972:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285980:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.285996:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047245.286007:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047245.286014:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286022:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.286028:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286038:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286057:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286066:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa6f303/0x4426598c0c773ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286086:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.286096:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286102:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.286105:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286112:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286123:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286131:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a0b7e29/0x4426598c0c773caf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286143:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.286145:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.286147:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047245.286198:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.286204:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286212:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.286216:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.286233:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286255:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286262:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286269:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286285:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047245.286294:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.286298:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286305:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.286309:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286316:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286327:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286334:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc89cb39/0x4426598c0c773cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286469:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.286503:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.286505:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.286507:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047245.286552:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.286558:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286567:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.286570:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.286574:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286583:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286591:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286599:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286726:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047245.286770:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.286776:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286797:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.286800:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.286804:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286813:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286820:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.286826:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286860:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.286870:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286878:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.286881:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286890:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286902:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286909:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ccf00b/0x4426598c0c773cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286925:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.286929:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286935:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.286939:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286946:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286969:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.286978:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.286981:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.286983:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.287050:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784047245.287055:0:26188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab25407/0x4426598c0c773cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047245.287115:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.287120:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287128:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.287131:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.287134:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287148:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287156:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287164:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287189:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.287195:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287203:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.287207:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287216:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287237:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287246:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.287248:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.287250:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.287303:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784047245.287308:0:26188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadb2c94/0x4426598c0c773ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047245.287430:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.287435:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287442:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.287445:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.287502:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287512:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287530:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287537:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287558:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.287563:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287581:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.287584:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287593:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287604:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287629:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.287632:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.287634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.287694:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784047245.287699:0:26188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b3810ab/0x4426598c0c773cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047245.287746:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.287752:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287760:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.287763:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.287767:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287776:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287784:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.287802:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287826:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.287831:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287838:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.287847:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287855:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287868:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287885:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.287888:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.287892:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.287917:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.287923:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287931:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.287935:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.287939:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287948:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287956:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287964:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.287985:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.288043:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.288049:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288067:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.288070:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.288075:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288084:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288092:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288099:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288112:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047245.288119:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.288123:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288129:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbda00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.288132:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288138:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288160:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288168:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd21c5cc/0x4426598c0c773ce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288187:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.288191:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288210:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbce00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.288214:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288230:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288241:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288248:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e7bbac/0x4426598c0c773ce7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288259:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.288262:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.288271:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047245.288274:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.288321:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.288327:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288334:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.288337:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.288341:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288350:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288426:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288434:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288447:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047245.288453:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.288458:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288465:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.288468:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288486:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288497:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288503:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c83a9b/0x4426598c0c773cee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288516:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.288518:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.288521:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.288570:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.288576:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288585:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.288588:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.288592:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288601:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288638:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288652:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288681:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047245.288687:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.288691:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288698:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.288701:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288709:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288721:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288728:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4bf80f/0x4426598c0c773cf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1784047245.288734:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784047245.288745:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.288748:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.288751:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.288816:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.288827:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288836:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.288839:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.288843:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288853:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288860:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288868:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288890:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.288939:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.288945:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288953:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.288956:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.288960:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288969:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288984:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.288991:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.289005:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047245.289012:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.289015:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.289021:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.289024:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.289032:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.289043:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.289051:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001664981c/0x4426598c0c773cfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.289065:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047245.289166:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.290475:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290487:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.290491:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290502:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290519:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290527:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000873ba3fb/0x4426598c0c773d03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290546:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.290547:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.290550:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.290653:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.290659:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290669:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.290673:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.290678:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290699:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290708:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290717:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290740:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.290785:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.290791:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290798:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.290800:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.290804:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290812:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290819:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290836:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290853:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047245.290860:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.290865:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290873:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.290876:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290885:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290897:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290904:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef24f429/0x4426598c0c773d0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290918:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.290921:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290940:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.290944:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290952:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290962:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290970:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008afa8985/0x4426598c0c773d11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.290983:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.290984:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.290986:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.291032:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.291037:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291045:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.291048:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.291052:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291062:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291076:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291083:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291096:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047245.291103:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.291107:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291113:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.291116:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291123:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291133:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291141:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aac34f3/0x4426598c0c773d18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.291160:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.291162:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.291205:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.291209:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291217:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.291231:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.291235:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291245:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291252:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291259:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291270:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.291303:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.291308:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291315:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.291317:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.291321:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291336:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291345:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.291352:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291521:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047245.291528:0:26188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b0dd25/0x4426598c0c773cd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047245.291647:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.291653:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291661:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.291664:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.291668:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291680:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291687:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291694:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291720:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047245.291765:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.291770:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291778:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.291781:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.291785:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291793:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291801:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291807:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291822:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784047245.291863:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.291869:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291877:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.291885:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.291891:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291901:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291910:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291916:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291925:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784047245.291969:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.291973:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291979:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.291982:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.291986:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291992:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.291999:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292013:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292022:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784047245.292061:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.292066:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292074:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.292077:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.292081:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292090:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292097:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292104:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292112:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784047245.292148:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.292153:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292166:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.292169:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.292173:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292182:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292190:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292198:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292206:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1784047245.292259:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.292264:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292272:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.292275:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.292278:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292287:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292305:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292313:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.292322:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1784047245.292336:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784047245.292345:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292356:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbcc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292360:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292378:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292393:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292412:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053794284/0x4426598c0c773d1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292431:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784047245.292435:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292442:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292445:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292458:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292463:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784047245.292471:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292473:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292489:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292491:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365cbc9f/0x4426598c0c773d2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292494:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292505:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292523:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784047245.292523:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292530:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292536:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f6aa2c8/0x4426598c0c773d34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292544:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292555:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292569:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292574:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784047245.292579:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292582:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292592:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292598:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f9cc1ba/0x4426598c0c773d3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292599:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292626:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292640:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292641:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784047245.292648:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292653:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034ddfc50/0x4426598c0c773d42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292662:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292668:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292673:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047245.292677:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292679:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292699:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3547e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.292705:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292705:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292729:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb1c45c8/0x4426598c0c773d49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292740:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292755:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292763:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec8b392/0x4426598c0c773d50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292770:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047245.292775:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292777:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292780:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292783:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292790:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292795:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292804:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047245.292810:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.292814:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292821:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.292825:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292832:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292851:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292859:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c773d26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292872:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292873:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.292875:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.292927:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047245.292931:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc3546e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.292934:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292937:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292952:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:2.0:1784047245.292955:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292956:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.292966:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292975:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.292977:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.292998:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bccbb48/0x4426598c0c773d57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.293000:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.293021:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.293027:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.293030:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.293032:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.293043:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.293048:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047245.293057:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.293061:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047245.293205:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293210:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293228:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293231:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293235:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293245:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293253:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293260:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293295:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047245.293336:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293341:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293350:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293352:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293419:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293431:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293439:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293446:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293458:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047245.293491:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293495:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293503:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293511:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293516:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293525:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293533:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293541:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293552:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784047245.293587:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293592:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293599:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293601:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293623:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293632:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293640:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293652:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293663:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784047245.293700:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293705:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293713:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293716:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293720:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293730:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293738:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293746:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293754:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784047245.293783:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293788:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293800:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293803:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293807:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293817:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293824:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293832:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293841:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1784047245.293876:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293880:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293887:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293890:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293894:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293902:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293922:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293928:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293936:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1784047245.293978:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.293983:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.293990:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.293993:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.293996:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294005:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294012:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294019:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294037:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1784047245.294076:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.294081:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294088:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.294091:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.294094:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294103:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294110:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294116:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294124:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1784047245.294158:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047245.294162:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294169:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:3.0:1784047245.294177:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047245.294181:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294190:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294198:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294205:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.294213:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:2.0:1784047245.294453:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1784047245.294460:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294468:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.294480:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294488:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294514:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294523:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c773d65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294545:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1784047245.294550:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294556:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.294560:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294567:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294575:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294582:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c773d6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294600:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784047245.294603:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294626:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.294629:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294636:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294647:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294654:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceea2b83/0x4426598c0c773d73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294665:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784047245.294669:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294676:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.294680:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294700:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294714:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.294719:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294721:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294737:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008474ab11/0x4426598c0c773d7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294743:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294756:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784047245.294760:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294762:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294782:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc97306/0x4426598c0c773d5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.294783:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.294806:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784047245.294811:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294818:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.294822:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294842:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294853:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294860:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f6bca11/0x4426598c0c773d88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294873:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784047245.294876:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294883:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.294886:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294893:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294903:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294911:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17cb25e/0x4426598c0c773d8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294935:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784047245.294939:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294945:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.294948:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294956:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294966:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294972:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053d09c94/0x4426598c0c773d96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294983:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.294986:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.294992:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.294995:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295013:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295024:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295030:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c773d9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295040:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.295043:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295048:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.295051:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295058:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295066:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295072:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6b8fed8/0x4426598c0c773da4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295093:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295095:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295097:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295106:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.295163:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295175:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295187:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295195:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c3aff12/0x4426598c0c773d81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047245.295199:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.295206:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295238:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.295242:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047245.295243:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.295246:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.295249:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295250:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295257:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295263:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295266:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295276:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295284:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295313:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.295355:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.295439:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295457:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.295460:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.295464:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295473:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295481:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295483:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047245.295491:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295493:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295512:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.295512:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047245.295517:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295522:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047245.295528:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295529:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295551:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.295557:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295557:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295577:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295578:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004981cfd7/0x4426598c0c773dab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295626:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.295629:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.295631:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295635:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295643:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a18406/0x4426598c0c773db2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295658:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295661:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.295663:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.295707:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.295712:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295720:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.295723:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.295727:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295736:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295742:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295749:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295769:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.295806:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.295811:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295818:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.295821:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.295824:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295832:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295839:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295846:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295856:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047245.295890:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1784047245.295897:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047245.295902:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295904:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295923:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.295925:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:2.0:1784047245.295928:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295938:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295940:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.295951:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295957:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295963:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295970:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c773db9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.295977:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295987:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.295987:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.295995:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296004:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.296008:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296009:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047245.296019:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296043:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296051:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b1b55f8/0x4426598c0c773dc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047245.296061:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047245.296066:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.296068:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296072:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296083:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.296087:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.296092:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296101:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296109:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296122:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296135:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.296177:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.296182:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296191:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.296194:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.296198:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296207:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296215:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296234:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296243:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.296249:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296255:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047245.296258:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296264:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.296270:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296271:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296289:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0c3db4/0x4426598c0c773dc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296295:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.296301:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296305:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047245.296312:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296314:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.296335:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.296336:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.296346:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b7421cb/0x4426598c0c773dce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784047245.296752:0:26188:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00000100:00100000:3.0:1784047245.296858:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:85168:x1870705709180672:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44867us (45377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.296868:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4936 00010000:00010000:0.0:1784047245.296995:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.296997:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.296999:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.297055:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.297062:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297183:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.297187:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.297193:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297204:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297230:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297237:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297294:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.297340:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.297347:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297355:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.297371:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.297376:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297386:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297395:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297402:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297514:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047245.297520:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297528:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.297531:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297540:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297561:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297570:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e830ddc/0x4426598c0c773ddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297586:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.297590:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297597:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.297600:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297629:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297641:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297650:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.297651:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.297653:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.297731:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047245.297736:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de42f3dc/0x4426598c0c773de3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047245.297795:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.297801:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297810:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.297813:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.297818:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297828:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297836:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.297844:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297877:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.297883:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.297891:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297915:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047245.297916:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297921:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297936:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.297937:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047245.297955:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d79c89/0x4426598c0c773dd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297958:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.297974:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.297976:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.297978:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.297979:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.297991:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047245.297995:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047245.298042:0:85168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85168:1870705709180672:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1784047245.298047:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047245.298053:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b10770/0x4426598c0c773dea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047245.298057:0:85168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00002000:00010000:0.0:1784047245.298123:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1784047245.298127:0:85168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85168:1870705709181056:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1784047245.298131:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298140:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.298143:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.298147:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298158:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298166:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298173:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047245.298180:0:85168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047245.298205:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784047245.298207:0:85168:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe6799c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784047245.298211:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.298228:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.298232:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.298241:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047245.298253:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709180928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784047245.298259:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.298276:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.298278:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.298281:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047245.298296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047245.298313:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047245.298319:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068b72505/0x4426598c0c773df1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047245.298358:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181056 00000100:00100000:2.0:1784047245.298365:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181056 00000100:00100000:2.0:1784047245.298412:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00000100:00100000:2.0:1784047245.298420:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:85168:x1870705709181056:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784047245.298451:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709180928 00000100:00100000:3.0:1784047245.298457:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709180928 00002000:00080000:2.0:1784047245.298467:0:8824:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00000100:00100000:3.0:1784047245.298494:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1784047245.298503:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709180928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047245.298518:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047245.298573:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709180928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047245.298582:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00010000:00010000:3.0:1784047245.298654:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.298659:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.298665:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.298672:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.298746:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.298753:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298772:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.298775:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.298780:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298789:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298797:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298804:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298854:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.298907:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.298913:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298921:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.298924:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.298928:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298938:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298959:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.298967:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299009:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047245.299015:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299022:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.299026:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299033:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299059:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299066:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058415d9d/0x4426598c0c773df8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299083:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.299087:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299094:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.299098:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299106:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299118:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.299127:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.299130:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.299133:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.299747:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047245.299754:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4fe21c8/0x4426598c0c773dff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047245.299844:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.299852:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.299861:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.299866:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.299871:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.299882:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.299892:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.299913:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.299927:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.299977:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.299984:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.299992:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.299996:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.300000:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300011:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300020:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300027:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300042:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047245.300088:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.300094:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300107:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.300110:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.300115:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047245.300123:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:85168:x1870705709181056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1700us (1943us total) trans 4294968749 rc 0/0 00010000:00010000:0.0:1784047245.300128:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047245.300136:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00010000:00010000:0.0:1784047245.300142:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300152:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300169:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784047245.300180:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784047245.300185:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300192:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.300200:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300208:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300243:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300250:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a570514e/0x4426598c0c773e06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300264:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047245.300268:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300275:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.300278:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300286:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300294:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300301:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000655fc994/0x4426598c0c773e0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300311:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047245.300314:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300327:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047245.300331:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300339:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300350:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.300456:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.300462:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.300466:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.300499:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e36b27c3/0x4426598c0c773e14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300585:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.300588:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047245.300591:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047245.300708:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.300715:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300725:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.300728:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.300733:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300743:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300760:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300768:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300822:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047245.300873:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047245.300878:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300886:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=3343s v=(0 0) 00010000:00010000:0.0:1784047245.300890:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047245.300894:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300903:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300911:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047245.300919:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047245.300969:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709180928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784047245.300974:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047245.300981:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.300989:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.300993:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301001:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301013:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301020:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e811a5/0x4426598c0c773e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301037:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047245.301040:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301046:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047245.301049:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301057:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301093:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.301101:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.301102:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047245.301105:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047245.301254:0:85168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85168:1870705709181056:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784047245.301266:0:85168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00010000:00010000:0.0:1784047245.301291:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047245.301298:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30e17a3/0x4426598c0c773e22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047245.303619:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784047245.310353:0:26186:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:0.0:1784047245.311546:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:85166:x1870705709180800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 58266us (58377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047245.311561:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00000100:00100000:2.0:1784047245.311681:0:85166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85166:1870705709180800:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784047245.311700:0:85166:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:2.0:1784047245.311782:0:85166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85166:1870705709181312:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784047245.311822:0:85166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047245.311848:0:85166:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe6799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047245.311863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047245.311873:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709181184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047245.311902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047245.311934:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181184 00000100:00100000:2.0:1784047245.311941:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181184 00000100:00100000:2.0:1784047245.311984:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1784047245.311992:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709181184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047245.312024:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047245.312065:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709181184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047245.312082:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1784047245.312515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709181184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047245.313584:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181312 00000100:00100000:2.0:1784047245.313593:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181312 00000100:00100000:2.0:1784047245.313685:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4939 00000100:00100000:2.0:1784047245.313695:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:85166:x1870705709181312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784047245.313738:0:26189:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00000100:00100000:2.0:1784047245.319900:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:85166:x1870705709181312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6199us (8069us total) trans 4294968749 rc 0/0 00000100:00100000:2.0:1784047245.319915:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4939 00000100:00100000:2.0:1784047245.320133:0:85166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85166:1870705709181312:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784047245.320151:0:85166:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00010000:00010000:3.0:1784047245.586876:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784047245.588654:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784047245.957137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047245.957190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047245.957204:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398656 00000100:00100000:2.0:1784047245.957227:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398656 00000100:00100000:1.0:1784047245.957335:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398784 00000100:00100000:1.0:1784047245.957341:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398784 00000100:00080000:3.0:1784047245.957438:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047245.960744:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:0.0:1784047245.960775:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689398656:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047245.960884:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689398656:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 126us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047245.960893:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:1.0:1784047245.965360:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1059 00000100:00100000:1.0:1784047245.965387:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689398784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047245.965492:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689398784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 118us (8302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047245.965527:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1059 00000100:00100000:2.0:1784047246.610982:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047246.611060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047246.611379:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047246.611420:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181440 00000100:00100000:0.0:1784047246.611432:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181440 00000100:00100000:0.0:1784047246.611488:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:0.0:1784047246.611498:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709181440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047246.611522:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047246.611590:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709181440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047246.611601:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:0.0:1784047246.612438:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709181568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047246.612497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047246.612662:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047246.612735:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181568 00000100:00100000:2.0:1784047246.612741:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181568 00000100:00100000:2.0:1784047246.612782:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:2.0:1784047246.612790:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709181568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047246.612805:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047246.612858:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709181568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047246.612865:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1784047246.613131:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709181568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047246.910375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047246.910547:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689398912 00000100:00100000:1.0:1784047246.910559:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689398912 00000100:00100000:1.0:1784047246.910800:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1079 00000100:00100000:1.0:1784047246.910814:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689398912:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047246.910846:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047246.910890:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae133 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047246.910976:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773e30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047246.910993:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047246.911009:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047246.911069:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047246.911074:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047246.911100:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047246.911128:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae133 expref: 8 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047246.911152:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773e30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae133 expref: 7 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047246.911184:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:1.0:1784047246.911201:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047246.911206:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031e00, rc 0) 00000100:00100000:1.0:1784047246.911294:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:65245:x1870705689398912:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 483us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047246.911302:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1079 00000100:00100000:0.0:1784047246.915783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047246.915899:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399040 00000100:00100000:3.0:1784047246.915913:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399040 00000100:00100000:3.0:1784047246.916018:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1080 00000100:00100000:3.0:1784047246.916031:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:65245:x1870705689399040:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047246.916082:0:68026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:3.0:1784047246.916168:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:65245:x1870705689399040:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047246.916176:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1080 00000100:00100000:2.0:1784047246.918347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047246.918429:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399168 00000100:00100000:1.0:1784047246.918471:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399168 00000100:00100000:1.0:1784047246.918536:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1081 00000100:00100000:1.0:1784047246.918549:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689399168:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047246.918598:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047246.918703:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689399168:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 156us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047246.918711:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1081 00000100:00100000:1.0:1784047246.920909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047246.921015:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399296 00000100:00100000:0.0:1784047246.921026:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399296 00000100:00100000:0.0:1784047246.921078:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4940 00000100:00100000:0.0:1784047246.921088:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2398:x1870705689399296:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:0.0:1784047246.921129:0:26182:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3345 last 0 00000020:00000080:0.0:1784047246.921176:0:26182:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c773e37 00002000:00100000:0.0:1784047246.921205:0:26182:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99ccc6da8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047246.921228:0:26182:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784047246.921315:0:26182:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784047246.921349:0:26182:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047246.921431:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689399296:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 343us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047246.921439:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4940 00000100:00100000:0.0:1784047246.923926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047246.924027:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399424 00000100:00100000:3.0:1784047246.924038:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399424 00000100:00100000:3.0:1784047246.924168:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1940 00000100:00100000:3.0:1784047246.924181:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689399424:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047246.924226:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047246.924334:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689399424:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 155us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047246.924342:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1940 00000100:00080000:2.0:1784047246.924723:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047246.927239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047246.927332:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399552 00000100:00100000:0.0:1784047246.927344:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399552 00000100:00100000:0.0:1784047246.927403:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4941 00000100:00100000:0.0:1784047246.927413:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2398:x1870705689399552:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:0.0:1784047246.927456:0:26183:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3345 last 0 00000020:00000080:0.0:1784047246.927498:0:26183:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c773e3e 00002000:00100000:0.0:1784047246.927515:0:26183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99ccc6dac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047246.927539:0:26183:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784047246.927690:0:26183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047246.927728:0:26183:0:(import.c:65:import_set_state_nolock()) ffff99ccc6dae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047246.927822:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689399552:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 408us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047246.927831:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4941 00000100:00100000:1.0:1784047246.933082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047246.933197:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399680 00000100:00100000:2.0:1784047246.933211:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399680 00000100:00100000:2.0:1784047246.933389:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1941 00000100:00100000:2.0:1784047246.933410:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689399680:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047246.933446:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047246.933548:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:65245:x1870705689399680:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 149us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047246.933569:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1941 00000100:00080000:3.0:1784047246.935027:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784047247.635304:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047248.659852:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047249.688573:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047250.196087:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709181696:0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.196180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047250.196380:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181696 00000100:00100000:3.0:1784047250.196400:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181696 00000100:00100000:3.0:1784047250.196459:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784047250.196469:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709181696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.196656:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709181952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047250.196693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047250.196747:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709181824:0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.196776:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047250.196827:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181952 00000100:00100000:2.0:1784047250.196831:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181952 00000100:00100000:2.0:1784047250.196872:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:2.0:1784047250.196879:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709181952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047250.196908:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047250.196954:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709181952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047250.196961:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:2.0:1784047250.197004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709181952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047250.197042:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709181824 00000100:00100000:2.0:1784047250.197046:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709181824 00000100:00100000:2.0:1784047250.197082:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1784047250.197087:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709181824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.197162:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709181824:12345-0@lo:400:kworker.0 Request processed in 74us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047250.197169:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1784047250.197208:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709181824:0@lo:400:kworker.0 00000100:00080000:2.0:1784047250.197233:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047250.197471:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709181696:12345-0@lo:400:kworker.0 Request processed in 1003us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047250.197480:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784047250.197486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709181696:0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.197630:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709182080:0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.197659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047250.197718:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182080 00000100:00100000:3.0:1784047250.197723:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182080 00000100:00100000:3.0:1784047250.197771:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1784047250.197778:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709182080:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784047250.197845:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047250.197880:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709182208:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.197901:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709182336:0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.197916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047250.197944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047250.197984:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182208 00000100:00100000:1.0:1784047250.197995:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182208 00000100:00100000:1.0:1784047250.198028:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182336 00000100:00100000:1.0:1784047250.198031:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182336 00000100:00100000:1.0:1784047250.198050:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1784047250.198056:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709182208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.198096:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709182208:12345-0@lo:400:kworker.0 Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047250.198113:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1784047250.198141:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1784047250.198148:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709182336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.198181:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709182336:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047250.198186:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1784047250.198203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709182464:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.198229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047250.198272:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709182336:0@lo:400:kworker.0 00000100:00080000:1.0:1784047250.198288:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047250.198291:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047250.198315:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709182208:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.198337:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182464 00000100:00100000:1.0:1784047250.198341:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182464 00000100:00100000:1.0:1784047250.198368:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1784047250.198374:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709182464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.198502:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709182464:12345-0@lo:400:kworker.0 Request processed in 129us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047250.198510:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1784047250.198534:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709182464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047250.198672:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709182080:12345-0@lo:400:kworker.0 Request processed in 894us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047250.198679:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1784047250.198733:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709182080:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.201426:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047250.201492:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047250.201512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709182720:0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.201579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047250.201657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709182848:0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.201685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047250.201718:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182848 00000100:00100000:0.0:1784047250.201724:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182848 00000100:00100000:0.0:1784047250.201773:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1784047250.201782:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.201832:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709182848:12345-0@lo:400:kworker.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047250.201839:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1784047250.201880:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709182848:0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.202009:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047250.202020:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709182976:0@lo:400:kworker.0 00000100:00100000:2.0:1784047250.202051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047250.202165:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182720 00000100:00100000:3.0:1784047250.202170:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182720 00000100:00100000:3.0:1784047250.202219:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182976 00000100:00100000:3.0:1784047250.202223:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182976 00000100:00100000:3.0:1784047250.202242:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1784047250.202249:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709182720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047250.202322:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709182720:12345-0@lo:400:kworker.0 Request processed in 73us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047250.202328:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1784047250.202342:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:3.0:1784047250.202348:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709182976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047250.202376:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709182976:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047250.202381:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:3.0:1784047250.202438:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709182720:0@lo:400:kworker.0 00000100:00080000:2.0:1784047250.202550:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047250.202554:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047250.202574:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709182976:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.205048:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709182592:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.205223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047250.205599:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709182592 00000100:00100000:3.0:1784047250.205633:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709182592 00000100:00100000:3.0:1784047250.205759:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:3.0:1784047250.205769:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709182592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047250.205827:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709182592:12345-0@lo:400:kworker.0 Request processed in 60us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047250.205835:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1784047250.205920:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709182592:0@lo:400:kworker.0 00000100:00080000:2.0:1784047250.206052:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047250.206347:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047250.206358:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709183232:0@lo:400:kworker.0 00000100:00100000:3.0:1784047250.206394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047250.206443:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047250.206452:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709183104:0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.206486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047250.206515:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183104 00000100:00100000:1.0:1784047250.206520:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183104 00000100:00100000:0.0:1784047250.206537:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183232 00000100:00100000:0.0:1784047250.206548:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183232 00000100:00100000:1.0:1784047250.206564:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:1.0:1784047250.206570:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709183104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.206574:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1784047250.206579:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709183232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047250.206624:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709183104:12345-0@lo:400:kworker.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047250.206627:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709183232:12345-0@lo:400:kworker.0 Request processed in 49us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047250.206631:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:0.0:1784047250.206633:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1784047250.206659:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709183232:0@lo:400:kworker.0 00000100:00100000:0.0:1784047250.206699:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709183104:0@lo:400:kworker.0 00000100:00080000:3.0:1784047250.206906:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047250.708420:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709183360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047250.709534:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709183488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047250.709830:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709183616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047250.712418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047250.715329:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047250.715644:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183360 00000100:00100000:2.0:1784047250.715655:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183360 00000100:00100000:2.0:1784047250.715715:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1784047250.715724:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709183360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047250.715756:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047250.723782:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047250.724681:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709183360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8922us (12236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047250.724792:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183488 00000100:00100000:1.0:1784047250.725027:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709183360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047250.725090:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1784047250.725183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047250.725212:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183616 00000100:00100000:0.0:1784047250.726061:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183488 00000100:00100000:0.0:1784047250.726127:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:0.0:1784047250.726139:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709183488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047250.726177:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000001:00100000:1.0:1784047250.726264:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:1.0:1784047250.726277:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968749 is committed 00000100:00100000:2.0:1784047250.726895:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183616 00000100:00100000:2.0:1784047250.726930:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:2.0:1784047250.726937:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709183616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047250.726961:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047250.733522:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709183488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7375us (9740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047250.733538:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:1.0:1784047250.733706:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709183488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047250.735747:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709183616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8800us (10554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047250.735761:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1784047250.735937:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709183616:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1784047250.738276:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:3.0:1784047250.738292:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968749 is committed 00000100:00100000:1.0:1784047251.087117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047251.087169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047251.087193:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399936 00000100:00100000:0.0:1784047251.087207:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399936 00000100:00100000:1.0:1784047251.087220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047251.087248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047251.087278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047251.087303:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400064 00000100:00100000:1.0:1784047251.087308:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689399808 00000100:00100000:0.0:1784047251.087308:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400064 00000100:00100000:1.0:1784047251.087315:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689399808 00000100:00100000:0.0:1784047251.087346:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1066 00000100:00100000:0.0:1784047251.087360:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689399936:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047251.087367:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:1.0:1784047251.087379:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689399808:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:3.0:1784047251.087477:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047251.087483:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047251.087487:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400192 00000100:00100000:2.0:1784047251.087494:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400192 00000100:00100000:2.0:1784047251.087539:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400320 00000100:00100000:2.0:1784047251.087542:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400320 00000100:00100000:2.0:1784047251.087567:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2384 00000100:00100000:2.0:1784047251.087576:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689400192:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047251.087662:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689399808:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 285us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047251.087670:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:1.0:1784047251.087707:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1067 00000100:00100000:1.0:1784047251.087715:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689400064:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047251.088176:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689399936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 817us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047251.088185:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1066 00000100:00100000:0.0:1784047251.088269:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2385 00000100:00100000:0.0:1784047251.088279:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689400320:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047251.088310:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689400320:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047251.088317:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2385 00000100:00080000:0.0:1784047251.088659:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047251.088663:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047251.090482:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689400192:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2895us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047251.090501:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2384 00000100:00100000:1.0:1784047251.096448:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689400064:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 8714us (9179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047251.096470:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1067 00000100:00100000:3.0:1784047251.730839:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709183744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047251.730912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047251.730966:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047251.730973:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709183872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047251.730996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047251.732128:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183744 00000100:00100000:3.0:1784047251.732139:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183744 00000100:00100000:3.0:1784047251.732190:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709183872 00000100:00100000:3.0:1784047251.732193:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709183872 00000100:00100000:3.0:1784047251.732218:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1784047251.732227:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709183744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047251.732252:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047251.732314:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709183744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047251.732321:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1784047251.732339:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:3.0:1784047251.732345:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709183872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047251.732355:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047251.732383:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709183872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047251.732388:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:3.0:1784047251.732442:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709183872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047251.732456:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709183744:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784047251.743455:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784047251.808488:0:85729:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1784047252.754787:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784047253.114972:0:85777:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1784047253.779721:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047254.709535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047254.709734:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400448 00000100:00100000:0.0:1784047254.709745:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400448 00000100:00100000:0.0:1784047254.709905:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1082 00000100:00100000:0.0:1784047254.709917:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:65714:x1870705689400448:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047254.709960:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:0.0:1784047254.710110:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:65714:x1870705689400448:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 195us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047254.710119:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1082 00000100:00080000:3.0:1784047254.712139:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047254.717977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047254.718091:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400576 00000100:00100000:2.0:1784047254.718100:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400576 00000100:00100000:2.0:1784047254.718217:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1083 00000100:00100000:2.0:1784047254.718228:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:65714:x1870705689400576:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047254.718266:0:67153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047254.718341:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:65714:x1870705689400576:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047254.718350:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1083 00000100:00080000:3.0:1784047254.719955:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047254.726372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047254.726688:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400704 00000100:00100000:3.0:1784047254.726698:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400704 00000100:00100000:3.0:1784047254.726790:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1946 00000100:00100000:3.0:1784047254.726801:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:65714:x1870705689400704:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047254.726836:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047254.726906:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:65714:x1870705689400704:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 107us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047254.726914:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1946 00000100:00080000:0.0:1784047254.727036:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047254.730273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047254.730344:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689400832 00000100:00100000:3.0:1784047254.730353:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689400832 00000100:00100000:3.0:1784047254.730430:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1947 00000100:00100000:3.0:1784047254.730443:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:65714:x1870705689400832:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047254.730477:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047254.730559:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:65714:x1870705689400832:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047254.730567:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1947 00000100:00080000:0.0:1784047254.730842:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047254.789469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047254.789652:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401088 00000100:00100000:1.0:1784047254.789663:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401088 00000100:00100000:1.0:1784047254.789742:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1084 00000100:00100000:1.0:1784047254.789754:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:65731:x1870705689401088:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047254.789779:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047254.789810:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae13a expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.789899:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.789913:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.789926:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.789962:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.789970:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.789978:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790076:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790095:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790102:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790108:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790114:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047254.790118:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790125:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790136:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:1.0:1784047254.790139:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047254.790143:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790156:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790169:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790175:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790181:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790186:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047254.790189:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790195:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790202:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99ccc37d2e00) 00010000:00010000:1.0:1784047254.790204:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047254.790206:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790213:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773e53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790242:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773e45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae13a expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790272:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:1.0:1784047254.790274:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784047254.790278:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae13a expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047254.790287:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030200, rc 0) 00000100:00100000:1.0:1784047254.790350:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:65731:x1870705689401088:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 597us (893us total) trans 0 rc 301/301 00000100:00100000:1.0:1784047254.790357:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1084 00000100:00100000:2.0:1784047254.796263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047254.796410:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401216 00000100:00100000:0.0:1784047254.796420:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401216 00000100:00100000:0.0:1784047254.796476:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1085 00000100:00100000:0.0:1784047254.796486:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:65731:x1870705689401216:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:0.0:1784047254.796563:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796579:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796590:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796641:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796649:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796657:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796738:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796747:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796754:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047254.796796:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047254.796835:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796851:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796858:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796864:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796871:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796878:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047254.796883:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796890:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796904:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:0.0:1784047254.796907:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047254.796911:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796918:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c773e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796931:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796936:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796949:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796954:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047254.796957:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796964:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796972:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff99ccc648eb00) 00010000:00010000:0.0:1784047254.796974:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047254.796977:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796983:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4800/0x4426598c0c773e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.796997:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.797003:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.797009:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.797014:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047254.797016:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.797030:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.797052:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff99ccc648e000) 00010000:00010000:0.0:1784047254.797055:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047254.797058:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047254.797064:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5c00/0x4426598c0c773e68 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047254.797503:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:65731:x1870705689401216:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 1016us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047254.797512:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1085 00010000:00010000:3.0:1784047254.805767:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047255.315256:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709184384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.315327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.315358:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709184896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.315383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.315400:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709185408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.315420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.315442:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784047255.315447:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709184256:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.315480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.315493:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709184768:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.315511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.315739:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709185280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.315763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.315792:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184896 00000100:00100000:3.0:1784047255.315800:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184896 00000100:00100000:3.0:1784047255.315876:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185408 00000100:00100000:3.0:1784047255.315880:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185408 00000100:00100000:3.0:1784047255.315901:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184768 00000100:00100000:3.0:1784047255.315904:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184768 00000100:00100000:3.0:1784047255.315920:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185280 00000100:00100000:3.0:1784047255.315922:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185280 00000100:00100000:3.0:1784047255.315941:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:3.0:1784047255.315949:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709184896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.316001:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709184896:12345-0@lo:400:kworker.0 Request processed in 52us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.316009:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:3.0:1784047255.316025:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:3.0:1784047255.316043:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709185408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.316194:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709185408:12345-0@lo:400:kworker.0 Request processed in 40us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.316200:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:3.0:1784047255.316212:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:3.0:1784047255.316218:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709184768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.316308:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709184768:12345-0@lo:400:kworker.0 Request processed in 89us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.316324:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00100000:3.0:1784047255.316338:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1784047255.316340:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709184000:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.316344:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709185280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.316419:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709184128:0@lo:400:kworker.0 00000100:00100000:2.0:1784047255.316803:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184384 00000100:00100000:2.0:1784047255.316809:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184384 00000100:00100000:2.0:1784047255.316844:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184256 00000100:00100000:2.0:1784047255.316853:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184256 00000100:00100000:2.0:1784047255.316879:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1784047255.316886:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709184384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.317585:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709185280:12345-0@lo:400:kworker.0 Request processed in 1238us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.317594:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:3.0:1784047255.317667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709184768:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.317679:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 2 00000100:00100000:3.0:1784047255.317696:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709185280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.317709:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709184896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.317719:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 2 00000100:00100000:3.0:1784047255.317730:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709185408:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.318115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.318170:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709184512:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.318223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.318245:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709185024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.318266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.318278:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709185536:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.318303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.318319:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047255.318326:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709185664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047255.318351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047255.319412:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184512 00000100:00100000:3.0:1784047255.319422:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184512 00000100:00100000:3.0:1784047255.319461:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185024 00000100:00100000:3.0:1784047255.319464:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185024 00000100:00100000:3.0:1784047255.319476:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185536 00000100:00100000:3.0:1784047255.319478:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185536 00000100:00100000:3.0:1784047255.319491:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1784047255.319499:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709184256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.319711:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709184256:12345-0@lo:400:kworker.0 Request processed in 212us (4229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.319719:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1784047255.319735:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1784047255.319741:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709184512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.319779:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709184512:12345-0@lo:400:kworker.0 Request processed in 39us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.319785:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1784047255.319796:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1784047255.319802:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709185024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.319825:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709185024:12345-0@lo:400:kworker.0 Request processed in 24us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.319830:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1784047255.319839:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1784047255.319844:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709185536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.319935:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709185536:12345-0@lo:400:kworker.0 Request processed in 90us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047255.319941:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00080000:3.0:1784047255.319958:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047255.319962:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047255.319965:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047255.319968:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047255.319995:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709184256:0@lo:400:kworker.0 00000100:00100000:3.0:1784047255.320041:0:85152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184000 00000100:00100000:3.0:1784047255.320045:0:85152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184000 00000100:00100000:0.0:1784047255.320193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047255.320224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709184640:0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047255.320272:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709185152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047255.320338:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184128 00000100:00100000:0.0:1784047255.320341:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184128 00000100:00100000:0.0:1784047255.320371:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1784047255.320377:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709184128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320414:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709184128:12345-0@lo:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047255.320421:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1784047255.320466:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709184128:0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320498:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185664 00000100:00100000:0.0:1784047255.320502:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185664 00000100:00100000:0.0:1784047255.320543:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709184640 00000100:00100000:0.0:1784047255.320546:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709184640 00000100:00100000:0.0:1784047255.320557:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185152 00000100:00100000:0.0:1784047255.320559:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185152 00000100:00100000:0.0:1784047255.320570:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1784047255.320576:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709185664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047255.320623:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047255.320660:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709185664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047255.320666:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1784047255.320678:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1784047255.320683:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709184640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320714:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709184640:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047255.320720:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1784047255.320731:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1784047255.320737:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709185152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320762:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709185152:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047255.320768:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1784047255.320790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709184640:0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320798:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709185152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320855:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784047255.320882:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709184000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047255.320912:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709184000:12345-0@lo:400:kworker.0 Request processed in 32us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047255.320918:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784047255.320949:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047255.327354:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709185664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047255.327386:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709184000:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.327402:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709184512:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.327438:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709185024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.327451:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709185536:0@lo:400:kworker.0 00000100:00100000:2.0:1784047255.327645:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709184384:12345-0@lo:400:kworker.0 Request processed in 10757us (12315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047255.327657:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1784047255.327721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709184384:0@lo:400:kworker.0 00000100:00100000:1.0:1784047255.826784:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709185792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047255.826867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.826940:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185792 00000100:00100000:1.0:1784047255.826947:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185792 00000100:00100000:1.0:1784047255.826995:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1784047255.827004:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709185792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047255.827046:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047255.827088:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709185792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047255.827095:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1784047255.827143:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709185792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784047255.828951:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047255.829059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047255.829075:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709186048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047255.829135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.829173:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186048 00000100:00100000:1.0:1784047255.829178:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186048 00000100:00100000:1.0:1784047255.829216:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:1.0:1784047255.829222:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709186048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047255.829252:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:1.0:1784047255.829295:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709186048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047255.829302:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:1.0:1784047255.829336:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709185920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047255.829363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047255.829410:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709186048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047255.829448:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709185920 00000100:00100000:1.0:1784047255.829452:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709185920 00000100:00100000:1.0:1784047255.829476:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1784047255.829481:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709185920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047255.829499:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047255.829531:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709185920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047255.829537:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1784047255.829565:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709185920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047256.202230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047256.202275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047256.202552:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401344 00000100:00100000:1.0:1784047256.202563:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401344 00000100:00100000:1.0:1784047256.202632:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:2.0:1784047256.202846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047256.203122:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401600 00000100:00100000:3.0:1784047256.203127:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401600 00000100:00100000:1.0:1784047256.203380:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689401344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047256.203453:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689401344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 80us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047256.203461:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:2.0:1784047256.203726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047256.204068:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401472 00000100:00100000:3.0:1784047256.204073:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401472 00000100:00100000:3.0:1784047256.204102:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1074 00000100:00100000:3.0:1784047256.204109:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689401600:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047256.204398:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689401600:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 288us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047256.204406:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1074 00000100:00100000:3.0:1784047256.204422:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1075 00000100:00100000:3.0:1784047256.204430:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689401472:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047256.204453:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689401472:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047256.204459:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1075 00000100:00100000:2.0:1784047256.205120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047256.205470:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401856 00000100:00100000:0.0:1784047256.205477:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401856 00000100:00100000:0.0:1784047256.205517:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401728 00000100:00100000:0.0:1784047256.205520:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401728 00000100:00100000:0.0:1784047256.205552:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2390 00000100:00100000:0.0:1784047256.205561:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689401856:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047256.206123:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2391 00000100:00100000:2.0:1784047256.206135:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689401728:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047256.208064:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689401728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1918us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047256.208077:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2391 00000100:00100000:0.0:1784047256.208376:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689401856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2814us (5527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047256.208385:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2390 00000100:00080000:3.0:1784047256.212724:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047256.212735:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047256.212805:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047256.212809:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047256.851071:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047256.851354:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709186176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047256.851425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047256.851631:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186176 00000100:00100000:3.0:1784047256.851640:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186176 00000100:00100000:3.0:1784047256.851761:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1784047256.851772:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709186176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047256.851795:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047256.851895:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709186176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047256.851903:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1784047256.852791:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709186304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047256.852834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047256.852940:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186304 00000100:00100000:0.0:1784047256.852947:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186304 00000100:00100000:0.0:1784047256.852990:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:0.0:1784047256.853009:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709186304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047256.853027:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047256.853069:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709186304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047256.853075:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1784047256.853285:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709186304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047256.856542:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709186176:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047257.874975:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047258.898952:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047259.922992:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047260.435596:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709186432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047260.435720:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709186944:0@lo:400:kworker.0 00000100:00100000:0.0:1784047260.435840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047260.436013:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709186816:0@lo:400:kworker.0 00000100:00100000:2.0:1784047260.436064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.436071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047260.436108:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047260.436118:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709186688:0@lo:400:kworker.0 00000100:00100000:2.0:1784047260.436149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.436162:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709186560:0@lo:400:kworker.0 00000100:00100000:2.0:1784047260.436214:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186944 00000100:00100000:2.0:1784047260.436225:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186944 00000100:00100000:1.0:1784047260.436241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047260.436340:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186816 00000100:00100000:1.0:1784047260.436351:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186688 00000100:00100000:1.0:1784047260.436360:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186688 00000100:00100000:2.0:1784047260.436365:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186816 00000100:00100000:2.0:1784047260.436414:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1784047260.436436:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709186944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.436436:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1784047260.436461:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709186816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.436541:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709186816:12345-0@lo:400:kworker.0 Request processed in 84us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.436550:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1784047260.436568:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1784047260.436575:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709186688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.436638:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709186688:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.436645:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1784047260.436697:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186432 00000100:00100000:1.0:1784047260.436702:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186432 00000100:00100000:1.0:1784047260.436730:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1784047260.436735:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709186432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047260.436764:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047260.436801:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709186432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.436807:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1784047260.436852:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709186432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047260.436898:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709186560 00000100:00100000:1.0:1784047260.436903:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709186560 00000100:00100000:1.0:1784047260.436945:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784047260.436952:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709186560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.436988:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709186560:12345-0@lo:400:kworker.0 Request processed in 37us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.436994:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784047260.437028:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709186560:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.437084:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709186688:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.437096:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709186816:0@lo:400:kworker.0 00000100:00080000:1.0:1784047260.437131:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047260.437136:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047260.439528:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709187200:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.439691:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709187072:0@lo:400:kworker.0 00000100:00100000:3.0:1784047260.440022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.440030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047260.440120:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709187456:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.440227:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709187584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.440256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.440305:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187072 00000100:00100000:1.0:1784047260.440313:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187072 00000100:00100000:1.0:1784047260.440364:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187584 00000100:00100000:1.0:1784047260.440366:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187584 00000100:00100000:1.0:1784047260.440385:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1784047260.440393:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709187072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047260.440442:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709186944:12345-0@lo:400:kworker.0 Request processed in 4013us (4597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047260.440456:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1784047260.440493:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1784047260.440504:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709187584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047260.440542:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709187712:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.441710:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709187072:12345-0@lo:400:kworker.0 Request processed in 1313us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.441722:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:1.0:1784047260.441772:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047260.441809:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709187072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.441857:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709187328:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.441889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.441908:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709187840:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.441927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.441974:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187328 00000100:00100000:1.0:1784047260.441979:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187328 00000100:00100000:1.0:1784047260.442011:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187840 00000100:00100000:1.0:1784047260.442013:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187840 00000100:00100000:1.0:1784047260.442030:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:1.0:1784047260.442037:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709187328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.442075:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709187328:12345-0@lo:400:kworker.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.442081:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:1.0:1784047260.442091:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:1.0:1784047260.442097:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709187840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.442127:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709187840:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.442133:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00080000:1.0:1784047260.442148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047260.442150:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047260.442164:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709187328:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.442172:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709187840:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.442214:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187200 00000100:00100000:1.0:1784047260.442218:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187200 00000100:00100000:1.0:1784047260.442248:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1784047260.442253:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709187200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.442284:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709187200:12345-0@lo:400:kworker.0 Request processed in 31us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.442291:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:0.0:1784047260.443554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047260.444750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709187968:0@lo:400:kworker.0 00000100:00100000:0.0:1784047260.444816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047260.444893:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709186944:0@lo:400:kworker.0 00000100:00100000:0.0:1784047260.444977:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187968 00000100:00100000:0.0:1784047260.444984:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187968 00000100:00100000:0.0:1784047260.445042:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1784047260.445053:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709187968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047260.445115:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709187968:12345-0@lo:400:kworker.0 Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047260.445124:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1784047260.445161:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709187968:0@lo:400:kworker.0 00000100:00100000:2.0:1784047260.445303:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709187584:12345-0@lo:400:kworker.0 Request processed in 4799us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047260.445322:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1784047260.445743:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187456 00000100:00100000:1.0:1784047260.445758:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187456 00000100:00100000:1.0:1784047260.445849:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:1.0:1784047260.445861:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709187456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.445966:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709187456:12345-0@lo:400:kworker.0 Request processed in 107us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.445974:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00080000:2.0:1784047260.446062:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047260.447513:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709187584:0@lo:400:kworker.0 00000100:00100000:0.0:1784047260.447592:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709187456:0@lo:400:kworker.0 00000100:00100000:3.0:1784047260.447908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047260.448034:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709187200:0@lo:400:kworker.0 00000100:00100000:0.0:1784047260.448887:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709187712 00000100:00100000:0.0:1784047260.448899:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709187712 00000100:00100000:1.0:1784047260.453588:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:1.0:1784047260.453622:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709187712:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784047260.453724:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047260.453765:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709187712:12345-0@lo:400:kworker.0 Request processed in 162us (5857us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.453775:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:0.0:1784047260.453871:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709187712:0@lo:400:kworker.0 00000100:00100000:1.0:1784047260.947097:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709188096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047260.947166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.947217:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709188224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047260.947246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.947284:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188096 00000100:00100000:1.0:1784047260.947291:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188096 00000100:00100000:1.0:1784047260.947338:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:1.0:1784047260.947347:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709188096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047260.947381:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444999168 avail 1298759680 00000100:00100000:1.0:1784047260.947437:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709188096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.947444:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:1.0:1784047260.947467:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188224 00000100:00100000:1.0:1784047260.947471:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188224 00000100:00100000:1.0:1784047260.947496:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1784047260.947502:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709188224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047260.947521:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047260.947555:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709188224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.947562:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1784047260.947633:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709188224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047260.947679:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709188096:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784047260.950587:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047260.951273:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047260.951294:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709188352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047260.953497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047260.954455:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188352 00000100:00100000:1.0:1784047260.954466:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188352 00000100:00100000:1.0:1784047260.954522:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:1.0:1784047260.954533:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709188352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047260.954579:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047260.954669:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709188352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047260.954677:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:1.0:1784047260.959168:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709188352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047261.322200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047261.322250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047261.322322:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689401984 00000100:00100000:1.0:1784047261.322348:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689401984 00000100:00100000:1.0:1784047261.322414:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:1.0:1784047261.322425:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689401984:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047261.322529:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689401984:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047261.322537:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:2.0:1784047261.323106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047261.323148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047261.323187:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689402496 00000100:00100000:1.0:1784047261.323193:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689402496 00000100:00100000:1.0:1784047261.323241:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2396 00000100:00100000:1.0:1784047261.323248:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689402496:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047261.323292:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689402496:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 44us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047261.323298:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2396 00000100:00080000:1.0:1784047261.323317:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047261.325513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047261.325552:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689402368 00000100:00100000:2.0:1784047261.325562:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689402368 00000100:00100000:2.0:1784047261.325656:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2397 00000100:00100000:2.0:1784047261.325669:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689402368:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047261.325755:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689402368:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047261.325763:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2397 00000100:00080000:2.0:1784047261.325787:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047261.329462:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689402240 00000100:00100000:0.0:1784047261.329531:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689402240 00000100:00100000:0.0:1784047261.329642:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689402112 00000100:00100000:0.0:1784047261.329647:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689402112 00000100:00100000:0.0:1784047261.329681:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1082 00000100:00100000:0.0:1784047261.329692:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689402240:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047261.329796:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689402240:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 105us (7545us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047261.329814:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1082 00000100:00100000:0.0:1784047261.329833:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1083 00000100:00100000:0.0:1784047261.329839:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689402112:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047261.329863:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689402112:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (6715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047261.329870:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1083 00000100:00080000:2.0:1784047261.330303:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047261.330318:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1784047261.653432:0:85972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 12:40:59 (1784047259) 00000100:00100000:2.0:1784047261.749771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047261.749920:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689402624 00000100:00100000:3.0:1784047261.749933:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689402624 00000100:00100000:3.0:1784047261.750048:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1086 00000100:00100000:3.0:1784047261.750061:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:66320:x1870705689402624:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047261.750091:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047261.750134:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae141 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750224:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750242:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750258:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750275:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750283:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750290:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750346:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750360:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750367:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750375:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750382:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047261.750387:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750395:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750409:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:3.0:1784047261.750412:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047261.750417:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750424:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750436:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750443:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750448:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750460:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047261.750463:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750468:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750477:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99ccd8400d00) 00010000:00010000:3.0:1784047261.750480:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047261.750482:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750489:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773e7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750528:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773e6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae141 expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750540:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:3.0:1784047261.750542:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047261.750546:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae141 expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.750555:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418800, rc 0) 00000100:00100000:3.0:1784047261.750664:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:66320:x1870705689402624:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 605us (906us total) trans 0 rc 301/301 00000100:00100000:3.0:1784047261.750673:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1086 00000100:00100000:0.0:1784047261.755055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047261.755243:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689402880 00000100:00100000:2.0:1784047261.755256:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689402880 00000100:00100000:2.0:1784047261.755489:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1087 00000100:00100000:2.0:1784047261.755503:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:66320:x1870705689402880:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:2.0:1784047261.755586:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047261.755645:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773e30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae133 expref: 7 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047261.755662:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc12aa100) 00010000:00010000:2.0:1784047261.755678:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047261.755771:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047261.755787:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047261.755798:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047261.755816:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047261.755824:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047261.755831:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760015:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760049:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760065:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047261.760086:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059680b15 reply state 000000004fe4ae94 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760101:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760242:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:0.0:1784047261.760247:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047261.760253:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784047261.760261:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784047261.760274:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760289:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760296:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760304:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760311:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047261.760316:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760325:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760341:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:0.0:1784047261.760344:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047261.760348:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760356:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c773e84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047261.760375:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059680b15 reply state 000000004fe4ae94 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760384:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047261.760390:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99ccc34a7600) 00010000:00010000:0.0:1784047261.760400:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047261.760403:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784047261.760534:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:66320:x1870705689402880:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 5028us (5486us total) trans 103079215105 rc 0/0 00000100:00100000:0.0:1784047261.760545:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1087 00000100:00100000:3.0:1784047261.784713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047261.785024:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689403008 00000100:00100000:1.0:1784047261.785042:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689403008 00000100:00100000:1.0:1784047261.785144:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1088 00000100:00100000:1.0:1784047261.785157:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:66321:x1870705689403008:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047261.785189:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047261.785219:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030e00/0x4426598c0c773e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae148 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.785296:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773ea0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.785311:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.785339:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047261.785387:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047261.785392:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047261.785414:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.785440:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030e00/0x4426598c0c773e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae148 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.785462:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae148 expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.785471:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7200) 00010000:00010000:1.0:1784047261.785474:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047261.785478:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030200, rc 0) 00000100:00100000:1.0:1784047261.785561:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:66321:x1870705689403008:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 406us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047261.785568:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1088 00000100:00100000:1.0:1784047261.790559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047261.790698:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689403136 00000100:00100000:3.0:1784047261.790712:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689403136 00000100:00100000:3.0:1784047261.790785:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1089 00000100:00100000:3.0:1784047261.790798:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:66321:x1870705689403136:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047261.790826:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047261.790854:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae14f expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.790948:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.790967:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.790981:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.790993:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.791001:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.791008:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.791183:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773ebc lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.791193:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773ebc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.791294:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773ebc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047261.791348:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784047261.791352:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047261.792481:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773ebc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792509:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792516:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792523:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792530:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792537:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047261.792542:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792549:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792565:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7200) 00010000:00010000:3.0:1784047261.792568:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047261.792573:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.792599:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793123:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793132:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793138:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793144:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047261.793148:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793154:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793164:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99ccc34a7600) 00010000:00010000:3.0:1784047261.793166:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047261.793169:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793175:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773eb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793293:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae14f expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793325:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773ebc lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae14f expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.793334:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:3.0:1784047261.793336:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047261.793339:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419800, rc 0) 00000100:00100000:3.0:1784047261.793551:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:66321:x1870705689403136:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2752us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047261.793562:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1089 00000100:00100000:0.0:1784047261.797651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047261.797747:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689403392 00000100:00100000:1.0:1784047261.797773:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689403392 00000100:00100000:1.0:1784047261.797851:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1090 00000100:00100000:1.0:1784047261.797865:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:66321:x1870705689403392:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047261.797894:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047261.797928:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae156 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047261.798159:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784047261.798538:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773ec3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae156 expref: 12 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.798557:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7200) 00010000:00010000:1.0:1784047261.798560:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784047261.798567:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c773ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae156 expref: 12 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047261.798582:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031200, rc 0) 00000100:00100000:1.0:1784047261.799433:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:66321:x1870705689403392:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1342us (1568us total) trans 103079215106 rc 301/301 00000100:00100000:1.0:1784047261.799445:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1090 00000100:00100000:1.0:1784047261.803363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047261.803500:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689403648 00000100:00100000:3.0:1784047261.803512:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689403648 00000100:00100000:3.0:1784047261.803836:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1091 00000100:00100000:3.0:1784047261.803848:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+11:66321:x1870705689403648:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:3.0:1784047261.803935:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047261.803981:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773ebc lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae14f expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.803999:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:3.0:1784047261.804005:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047261.804033:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.804049:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.804060:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047261.804598:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1f0c4d7 reply state 00000000370a5571 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.804643:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047261.804650:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:3.0:1784047261.804653:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1784047261.804656:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784047261.804665:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1784047261.804788:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:66321:x1870705689403648:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 941us (1491us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1784047261.804798:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1091 00000100:00100000:2.0:1784047261.815938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047261.816453:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689403904 00000100:00100000:1.0:1784047261.816468:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689403904 00000100:00100000:1.0:1784047261.816593:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 217 00000100:00100000:1.0:1784047261.816641:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:66321:x1870705689403904:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1784047261.817090:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+13:66321:x1870705689403904:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 484us (1555us total) trans 103079215108 rc 0/0 00000100:00100000:1.0:1784047261.817100:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 217 00000100:00100000:3.0:1784047261.972299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709188480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047261.972425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047261.972728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709188608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047261.972805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047261.972846:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188480 00000100:00100000:3.0:1784047261.972859:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188480 00000100:00100000:2.0:1784047261.972896:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188608 00000100:00100000:2.0:1784047261.972914:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188608 00000100:00100000:3.0:1784047261.972947:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1784047261.972962:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709188480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047261.972993:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047261.973302:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709188480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 342us (876us total) trans 0 rc 0/0 00010000:00010000:0.0:1784047261.977852:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047261.978014:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1784047261.982457:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709188480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047261.986946:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:2.0:1784047261.986972:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709188608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047261.987006:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047261.987098:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709188608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (14289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047261.987107:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:2.0:1784047261.993274:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709188608:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1784047262.811278:0:85147:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:0.0:1784047262.811415:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811428:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811435:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811441:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047262.811446:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811454:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811475:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99ccc34a7600) 00010000:00010000:0.0:1784047262.811479:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047262.811484:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811492:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1200/0x4426598c0c773e8b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811530:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811537:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811544:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811566:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047262.811568:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811574:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811582:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:0.0:1784047262.811585:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047262.811587:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.811594:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5a00/0x4426598c0c773e92 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812079:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812088:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812094:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812114:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047262.812117:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812123:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812133:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:0.0:1784047262.812135:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047262.812138:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.812144:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c773ed1 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047262.871993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047262.872223:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404032 00000100:00100000:3.0:1784047262.872237:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404032 00000100:00100000:3.0:1784047262.872310:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1092 00000100:00100000:3.0:1784047262.872322:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:66331:x1870705689404032:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047262.872390:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:3.0:1784047262.872480:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:66331:x1870705689404032:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 160us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047262.872488:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1092 00000100:00100000:0.0:1784047262.878031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047262.878171:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404160 00000100:00100000:2.0:1784047262.878190:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404160 00000100:00100000:2.0:1784047262.878282:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1093 00000100:00100000:2.0:1784047262.878295:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:66331:x1870705689404160:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047262.878352:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047262.878457:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:66331:x1870705689404160:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 163us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047262.878465:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1093 00000100:00100000:2.0:1784047262.889335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047262.889423:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404288 00000100:00100000:3.0:1784047262.889445:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404288 00000100:00100000:3.0:1784047262.889523:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1956 00000100:00100000:3.0:1784047262.889535:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:66331:x1870705689404288:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047262.889567:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047262.889685:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:66331:x1870705689404288:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 151us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047262.889693:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1956 00000100:00100000:0.0:1784047262.898790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047262.898861:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404416 00000100:00100000:2.0:1784047262.898871:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404416 00000100:00100000:2.0:1784047262.898964:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1957 00000100:00100000:2.0:1784047262.898976:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:66331:x1870705689404416:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047262.899012:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047262.899085:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:66331:x1870705689404416:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047262.899438:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1957 00000100:00100000:3.0:1784047262.952188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047262.952228:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404672 00000100:00100000:3.0:1784047262.952238:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404672 00000100:00100000:3.0:1784047262.952292:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1094 00000100:00100000:3.0:1784047262.952303:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:66338:x1870705689404672:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00010000:3.0:1784047262.952359:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047262.952556:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773ea0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae148 expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.952577:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7200) 00010000:00010000:3.0:1784047262.952590:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047262.952668:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.952694:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.952705:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.952718:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.952725:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.952732:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953556:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953567:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953574:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953581:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953588:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047262.953592:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953600:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953645:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400f00) 00010000:00010000:3.0:1784047262.953647:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047262.953652:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953657:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ed8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047262.953671:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000169257e0 reply state 0000000020baf987 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953682:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.953689:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccd8400800) 00010000:00010000:3.0:1784047262.953691:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047262.953693:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047262.953786:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:66338:x1870705689404672:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 1482us (1605us total) trans 103079215109 rc 0/0 00000100:00100000:3.0:1784047262.953794:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1094 00000100:00100000:0.0:1784047262.979865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047262.979913:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404800 00000100:00100000:0.0:1784047262.979922:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404800 00000100:00100000:0.0:1784047262.979971:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1095 00000100:00100000:0.0:1784047262.979980:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:66341:x1870705689404800:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:0.0:1784047262.980002:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047262.984615:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae15d expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.984697:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c773eed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.984725:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c773eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.984738:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c773eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047262.984786:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047262.984791:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047262.984813:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c773eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.984839:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae15d expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.984857:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c773eed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae15d expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047262.984865:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:0.0:1784047262.984868:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047262.984871:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5400, rc 0) 00000100:00100000:0.0:1784047262.984957:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+9:66341:x1870705689404800:12345-192.168.204.40@tcp:101:rm.0 Request processed in 4978us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047262.984967:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1095 00000100:00100000:3.0:1784047262.989138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047262.989176:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404928 00000100:00100000:3.0:1784047262.989186:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404928 00000100:00100000:3.0:1784047262.989237:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1096 00000100:00100000:3.0:1784047262.989247:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:66341:x1870705689404928:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:3.0:1784047262.989268:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047262.989291:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae164 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989373:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989388:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989399:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989409:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989416:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989423:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989498:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989507:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989514:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047262.989555:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784047262.989559:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047262.989580:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.989602:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991164:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991172:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991179:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991186:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991193:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047262.991198:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991205:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991218:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:3.0:1784047262.991222:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047262.991226:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991233:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c773efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991245:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991262:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991268:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991274:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047262.991277:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991283:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991293:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccd8400800) 00010000:00010000:3.0:1784047262.991295:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047262.991298:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991304:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991340:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae164 expref: 11 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991354:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae164 expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047262.991362:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99ccd8400f00) 00010000:00010000:3.0:1784047262.991364:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047262.991373:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418600, rc 0) 00000100:00100000:3.0:1784047262.991442:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:66341:x1870705689404928:12345-192.168.204.40@tcp:101:rm.0 Request processed in 2195us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047262.991451:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1096 00000100:00100000:0.0:1784047263.003364:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047263.003409:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405184 00000100:00100000:0.0:1784047263.003419:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405184 00000100:00100000:0.0:1784047263.003481:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1097 00000100:00100000:0.0:1784047263.003492:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:66341:x1870705689405184:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:0.0:1784047263.003556:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784047263.003586:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418600/0x4426598c0c773f09 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae164 expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003631:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99ccd8400f00) 00010000:00010000:0.0:1784047263.003650:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c773eed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae15d expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003660:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc648eb00) 00010000:00010000:0.0:1784047263.003666:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047263.003689:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003702:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003712:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003722:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003729:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003737:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003821:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003841:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.003847:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005391:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005406:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005415:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005422:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005428:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005434:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005462:0:66220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047263.005482:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005487:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005493:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005508:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047263.005513:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005520:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005531:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99ccc648e300) 00010000:00010000:0.0:1784047263.005533:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784047263.005537:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005542:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c773f1e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005560:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005566:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005572:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005577:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005582:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047263.005585:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005600:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005635:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc648e100) 00010000:00010000:0.0:1784047263.005638:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047263.005641:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005647:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5600/0x4426598c0c773f10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047263.005662:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc8ea39a reply state 00000000bef8e9c1 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005674:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005679:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccd8400800) 00010000:00010000:0.0:1784047263.005681:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047263.005684:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047263.005764:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:66341:x1870705689405184:12345-192.168.204.40@tcp:36:rm.0 Request processed in 2271us (2408us total) trans 103079215110 rc 0/0 00000100:00100000:0.0:1784047263.005772:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1097 00000100:00080000:0.0:1784047263.005805:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784047263.005860:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047263.005867:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005873:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047263.005877:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005904:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.005913:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99ccc648e300) 00010000:00010000:0.0:1784047263.005916:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784047263.005919:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047263.006036:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047263.007285:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c773f25 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047263.007316:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047263.007318:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047263.007321:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047264.019761:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047265.047207:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047265.554815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047265.554845:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709188864:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.554910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047265.554926:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709188992:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.554945:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709188736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047265.554957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.554966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047265.554984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709189504:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.554985:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709189376:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.555003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047265.555004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.555017:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709189888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047265.555017:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709190016:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.555035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047265.555035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.555046:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709190400:0@lo:400:kworker.0 00000100:00100000:1.0:1784047265.555048:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784047265.555053:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709189120:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.555064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047265.555082:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188864 00000100:00100000:2.0:1784047265.555085:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784047265.555089:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709189248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047265.555089:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188864 00000100:00100000:2.0:1784047265.555108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.555121:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709189760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047265.555130:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784047265.555139:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709188864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.555140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.555153:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709190272:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.555170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047265.555177:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709188864:12345-0@lo:400:kworker.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047265.555184:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784047265.555197:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709188864:0@lo:400:kworker.0 00000100:00100000:1.0:1784047265.555213:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188992 00000100:00100000:1.0:1784047265.555217:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188992 00000100:00100000:2.0:1784047265.555220:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189376 00000100:00100000:2.0:1784047265.555222:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189376 00000100:00100000:3.0:1784047265.555280:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189888 00000100:00100000:3.0:1784047265.555284:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189888 00000100:00100000:1.0:1784047265.555315:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190400 00000100:00100000:1.0:1784047265.555319:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190400 00000100:00100000:2.0:1784047265.557444:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189248 00000100:00100000:2.0:1784047265.557454:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189248 00000100:00100000:2.0:1784047265.557493:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1784047265.557502:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709188992:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784047265.557541:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec979180 x1870705709188992/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1784047276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047265.557604:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709188992:12345-0@lo:400:kworker.0 Request processed in 103us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.557627:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1784047265.557643:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1784047265.557650:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709189376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.557690:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709189376:12345-0@lo:400:kworker.0 Request processed in 41us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.557697:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1784047265.557711:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1784047265.557717:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709189248:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784047265.557728:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc44f2680 x1870705709189248/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1784047276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047265.557769:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709189248:12345-0@lo:400:kworker.0 Request processed in 52us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.557775:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1784047265.557803:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189760 00000100:00100000:2.0:1784047265.557807:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189760 00000100:00100000:2.0:1784047265.557847:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190272 00000100:00100000:2.0:1784047265.557851:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190272 00000100:00100000:2.0:1784047265.557872:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:2.0:1784047265.557877:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709189760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.557909:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709189760:12345-0@lo:400:kworker.0 Request processed in 31us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.557920:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:2.0:1784047265.557933:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:2.0:1784047265.557938:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709190272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.557971:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709190272:12345-0@lo:400:kworker.0 Request processed in 33us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.557976:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:2.0:1784047265.558019:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709189248:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.558031:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709189760:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.558040:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709190272:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.558050:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709189376:0@lo:400:kworker.0 00000100:00100000:3.0:1784047265.562151:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1784047265.562178:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709189888:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047265.562209:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc44f3b80 x1870705709189888/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1784047276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047265.562301:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709189888:12345-0@lo:400:kworker.0 Request processed in 138us (7264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047265.562309:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1784047265.562368:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709189888:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.565906:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709188736 00000100:00100000:2.0:1784047265.565922:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709188736 00000100:00100000:2.0:1784047265.565979:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189504 00000100:00100000:2.0:1784047265.565982:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189504 00000100:00100000:2.0:1784047265.565996:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190016 00000100:00100000:2.0:1784047265.565998:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190016 00000100:00100000:2.0:1784047265.566013:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:2.0:1784047265.566021:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709188736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047265.566070:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047265.566151:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709188736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (11183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.566159:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:2.0:1784047265.566177:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:2.0:1784047265.566182:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709189504:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784047265.566207:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec97b480 x1870705709189504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1784047276 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047265.566241:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709189504:12345-0@lo:400:kworker.0 Request processed in 58us (11235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.566247:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:2.0:1784047265.566260:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1784047265.566266:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709190016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566291:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709190016:12345-0@lo:400:kworker.0 Request processed in 27us (11256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.566297:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1784047265.566342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.566378:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709189632:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566411:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.566435:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709190144:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047265.566489:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709188992:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566502:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709189504:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566512:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709190016:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566542:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189632 00000100:00100000:2.0:1784047265.566546:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189632 00000100:00100000:2.0:1784047265.566575:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190144 00000100:00100000:2.0:1784047265.566578:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190144 00000100:00100000:2.0:1784047265.566597:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:2.0:1784047265.566634:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709189632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566682:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709189632:12345-0@lo:400:kworker.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.566689:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:00100000:2.0:1784047265.566701:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1784047265.566708:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709190144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566735:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709190144:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.566741:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1784047265.566760:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709189120 00000100:00100000:2.0:1784047265.566764:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709189120 00000100:00100000:2.0:1784047265.566790:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1784047265.566796:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709189120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566828:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709189120:12345-0@lo:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047265.566845:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1784047265.566876:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709189120:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709189632:0@lo:400:kworker.0 00000100:00100000:2.0:1784047265.566893:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709190144:0@lo:400:kworker.0 00000100:00080000:2.0:1784047265.566925:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047265.566930:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047265.566933:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047265.566935:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047265.569092:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709188736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047265.577084:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1784047265.577106:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709190400:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047265.577136:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc44f2a00 x1870705709190400/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1784047276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047265.577222:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709190400:12345-0@lo:400:kworker.0 Request processed in 125us (22155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047265.577230:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1784047265.577437:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709190400:0@lo:400:kworker.0 00000100:00100000:3.0:1784047266.069019:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047266.069049:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709190528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047266.069132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047266.069348:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047266.070447:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709190656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047266.070537:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047266.070856:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190656 00000100:00100000:0.0:1784047266.070868:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190656 00000100:00100000:0.0:1784047266.070939:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:0.0:1784047266.070949:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709190656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047266.070987:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047266.071046:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709190656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047266.071054:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1784047266.071148:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709190656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047266.071486:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190528 00000100:00100000:2.0:1784047266.071491:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190528 00000100:00100000:2.0:1784047266.071524:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:2.0:1784047266.071531:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709190528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047266.071566:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00010000:00000080:2.0:1784047266.071581:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0030ca80 x1870705709190528/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/368 e 0 to 0 dl 1784047277 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047266.071639:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709190528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047266.071645:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:2.0:1784047266.071661:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047266.071670:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709190784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047266.071701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047266.071787:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190784 00000100:00100000:3.0:1784047266.071797:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190784 00000100:00100000:3.0:1784047266.071842:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1784047266.071849:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709190784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047266.071866:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047266.071904:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709190784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047266.071910:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1784047266.071943:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709190784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047266.071970:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709190528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047266.436867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047266.436933:0:85158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405312 00000100:00100000:3.0:1784047266.436942:0:85158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405312 00000100:00100000:3.0:1784047266.437419:0:85158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:3.0:1784047266.437431:0:85158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689405312:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047266.437502:0:85158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689405312:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 73us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047266.437510:0:85158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:1.0:1784047266.453434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047266.453518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047266.458773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047266.458837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047266.460254:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405440 00000100:00100000:2.0:1784047266.460266:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405440 00000100:00100000:2.0:1784047266.460335:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405568 00000100:00100000:2.0:1784047266.460339:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405568 00000100:00100000:2.0:1784047266.460366:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1090 00000100:00100000:2.0:1784047266.460374:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:2402:x1870705689405440:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:2.0:1784047266.460406:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec97a680 x1870705689405440/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:397/0 lens 224/224 e 0 to 0 dl 1784047277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047266.460740:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:2402:x1870705689405440:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 365us (7317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047266.460749:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1090 00000100:00100000:2.0:1784047266.460768:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1091 00000100:00100000:2.0:1784047266.460775:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689405568:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047266.460802:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689405568:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (7285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047266.460808:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1091 00000100:00080000:2.0:1784047266.460887:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047266.460891:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047266.461140:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405696 00000100:00100000:1.0:1784047266.461146:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405696 00000100:00100000:1.0:1784047266.461180:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2402 00000100:00100000:1.0:1784047266.461188:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689405696:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:2.0:1784047266.461276:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047266.461390:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689405696:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 203us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047266.461397:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2402 00000100:00100000:1.0:1784047266.461409:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405824 00000100:00100000:1.0:1784047266.461413:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405824 00000100:00100000:1.0:1784047266.461441:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2403 00000100:00100000:1.0:1784047266.461465:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689405824:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047266.461720:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689405824:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 272us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047266.461727:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2403 00000100:00080000:3.0:1784047266.461858:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047267.094818:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709190912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047267.094902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047267.095008:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047267.095512:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709190912 00000100:00100000:3.0:1784047267.095520:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709190912 00000100:00100000:3.0:1784047267.095629:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1784047267.095640:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709190912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047267.095665:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047267.095716:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709190912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047267.095723:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1784047267.097903:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709191040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047267.097971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047267.098022:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191040 00000100:00100000:3.0:1784047267.098028:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191040 00000100:00100000:3.0:1784047267.098081:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1784047267.098091:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709191040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047267.098115:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047267.098154:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709191040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047267.098161:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1784047267.099189:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709191040:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784047267.101659:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047267.101668:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047267.101730:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709190912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784047268.114726:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784047268.627059:0:85147:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:3.0:1784047268.627642:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627656:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627664:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627670:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047268.627674:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627682:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627699:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccd8400800) 00010000:00010000:3.0:1784047268.627701:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047268.627706:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627720:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773edf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627738:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627744:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627749:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627754:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047268.627756:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627762:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627771:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccd8400800) 00010000:00010000:3.0:1784047268.627773:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047268.627788:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047268.627794:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c773f17 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.150819:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784047269.509595:0:86368:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1784047269.577823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047269.577898:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405952 00000100:00100000:3.0:1784047269.577918:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405952 00000100:00100000:3.0:1784047269.578003:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1098 00000100:00100000:3.0:1784047269.578014:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:66408:x1870705689405952:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047269.578036:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047269.578060:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae16b expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.578130:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773f33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.578144:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.578157:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047269.578202:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047269.578206:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047269.578239:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.578263:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c773f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae16b expref: 8 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.578280:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773f33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae16b expref: 7 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.578288:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400800) 00010000:00010000:3.0:1784047269.578291:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047269.578294:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419800, rc 0) 00010000:00000080:3.0:1784047269.578309:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec97b800 x1870705689405952/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:400/0 lens 576/688 e 0 to 0 dl 1784047280 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047269.578364:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:66408:x1870705689405952:12345-192.168.204.40@tcp:101:touch.0 Request processed in 351us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047269.578388:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1098 00000100:00080000:1.0:1784047269.578818:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047269.581675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047269.581766:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406080 00000100:00100000:1.0:1784047269.581776:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406080 00000100:00100000:1.0:1784047269.581838:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1099 00000100:00100000:1.0:1784047269.581848:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:66408:x1870705689406080:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047269.581869:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047269.581889:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae172 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.581951:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.581991:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582003:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582018:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582025:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582031:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582114:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c773f4f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582121:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c773f4f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582129:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c773f4f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047269.582165:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784047269.582169:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047269.582188:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c773f4f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582200:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582215:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582222:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582229:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582235:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047269.582239:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582246:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582258:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400800) 00010000:00010000:1.0:1784047269.582262:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047269.582265:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582271:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c773f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582301:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582307:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582313:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582324:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047269.582327:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582333:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582340:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99cbc89ff100) 00010000:00010000:1.0:1784047269.582343:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047269.582345:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582351:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c773f48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582391:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c773f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae172 expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582405:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c773f4f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae172 expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.582412:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99cbc89ff900) 00010000:00010000:1.0:1784047269.582414:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784047269.582416:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031a00, rc 0) 00010000:00000080:1.0:1784047269.582424:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00d9f480 x1870705689406080/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:400/0 lens 592/688 e 0 to 0 dl 1784047280 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047269.582485:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:66408:x1870705689406080:12345-192.168.204.40@tcp:101:touch.0 Request processed in 638us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047269.582500:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1099 00000100:00100000:3.0:1784047269.586382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047269.586600:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406336 00000100:00100000:1.0:1784047269.586634:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406336 00000100:00100000:1.0:1784047269.586691:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1100 00000100:00100000:1.0:1784047269.586700:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:66408:x1870705689406336:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047269.586720:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047269.586743:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773f56 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae179 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.586873:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.586888:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.586899:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.586912:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.586918:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.586925:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587390:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587413:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587421:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047269.587457:0:67153:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1784047269.587461:0:67153:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1784047268 00000004:00010000:1.0:1784047269.587463:0:67153:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1784047268 00000004:00010000:1.0:1784047269.587466:0:67153:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1784047268 00000004:00010000:1.0:1784047269.587468:0:67153:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1784047269.587472:0:67153:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1784047269.587477:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587484:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587490:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587496:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587501:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047269.587506:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587512:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587558:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99cbc89ff900) 00010000:00010000:1.0:1784047269.587561:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047269.587564:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587571:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c773f5d lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047269.587584:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb0c604d reply state 0000000082a87cb6 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587594:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587600:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99cbc89ff700) 00010000:00010000:1.0:1784047269.587602:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047269.587619:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047269.587646:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c773f56 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587659:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047269.587666:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99cbc89ff500) 00010000:00010000:1.0:1784047269.587668:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1784047269.587670:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030a00, rc 0) 00010000:00000080:1.0:1784047269.587678:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00d9fb80 x1870705689406336/t103079215111(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:400/0 lens 752/824 e 0 to 0 dl 1784047280 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047269.587743:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:66408:x1870705689406336:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1044us (1382us total) trans 103079215111 rc 0/0 00000100:00100000:1.0:1784047269.587767:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1100 00000100:00100000:1.0:1784047269.596540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047269.596635:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406592 00000100:00100000:3.0:1784047269.596644:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406592 00000100:00100000:3.0:1784047269.596698:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1101 00000100:00100000:3.0:1784047269.596709:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+11:66408:x1870705689406592:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:3.0:1784047269.596848:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.596866:0:66220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.596874:0:66220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.596906:0:66220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.596920:0:66220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 11 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047269.596934:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66220:1870705709191168:192.168.204.40@tcp:104: 00000100:00100000:3.0:1784047269.597244:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8cef240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047269.603279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047269.603323:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406720 00000100:00100000:3.0:1784047269.603331:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406720 00010000:00010000:3.0:1784047269.603369:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047269.603408:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2533 00000100:00100000:3.0:1784047269.603419:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf349e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+12:2402:x1870705689406720:12345-192.168.204.40@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1784047269.603439:0:26194:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.603449:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.603460:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.603468:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99cbc89ff500) 00010000:00010000:3.0:1784047269.603471:0:26194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1784047269.603475:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.603486:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.603494:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047269.603517:0:26194:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047269.603583:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf349e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+12:2402:x1870705689406720:12345-192.168.204.40@tcp:102:ldlm_bl.0 Request processed in 165us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047269.603591:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2533 00000100:00100000:0.0:1784047269.603869:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66220:1870705709191168:192.168.204.40@tcp:104: 00010000:00010000:0.0:1784047269.603889:0:66220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047269.603898:0:66220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047269.603904:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047269.604041:0:66220:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1784047269.604045:0:66220:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1784047268 -> 1784047268 00000004:00010000:0.0:1784047269.604048:0:66220:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1784047268 -> 1784047268 00000004:00010000:0.0:1784047269.604050:0:66220:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1784047268 -> 1784047268 00000004:00010000:0.0:1784047269.604053:0:66220:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1784047269.604065:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b96bd1d5 reply state 00000000164987e3 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047269.604080:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047269.604087:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99cbc89ff500) 00010000:00010000:0.0:1784047269.604090:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047269.604100:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1784047269.604157:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec979500 x1870705689406592/t103079215112(0) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:400/0 lens 488/456 e 0 to 0 dl 1784047280 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047269.604205:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+13:66408:x1870705689406592:12345-192.168.204.40@tcp:36:touch.0 Request processed in 7498us (7674us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1784047269.604212:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1101 00000100:00100000:3.0:1784047269.607733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047269.607908:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406976 00000100:00100000:1.0:1784047269.607918:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406976 00000100:00100000:1.0:1784047269.607987:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 218 00000100:00100000:1.0:1784047269.607998:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+13:66408:x1870705689406976:12345-192.168.204.40@tcp:35:touch.0 00010000:00000080:1.0:1784047269.608189:0:66222:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00d9e680 x1870705689406976/t103079215113(0) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:400/0 lens 392/456 e 0 to 0 dl 1784047280 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047269.608261:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+14:66408:x1870705689406976:12345-192.168.204.40@tcp:35:touch.0 Request processed in 265us (537us total) trans 103079215113 rc 0/0 00000100:00100000:1.0:1784047269.608269:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 218 00010000:00010000:3.0:1784047270.163634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047270.684653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709191680:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.684717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.684758:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709192192:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.684780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.684795:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709192704:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.684811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.684831:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1784047270.684835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709191296:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.684859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.684887:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709191808:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.684908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.684922:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709192320:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.685147:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709192832:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.685189:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709191424:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.685223:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709191936:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.685282:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709192448:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.685316:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784047270.685321:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709191552:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.685345:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709192064:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.685361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.688221:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709192576:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.688286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047270.688344:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191680 00000100:00100000:0.0:1784047270.688351:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191680 00000100:00100000:0.0:1784047270.688417:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191808 00000100:00100000:0.0:1784047270.688421:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191808 00000100:00100000:0.0:1784047270.688434:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192320 00000100:00100000:0.0:1784047270.688436:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192320 00000100:00100000:0.0:1784047270.688446:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192832 00000100:00100000:0.0:1784047270.688448:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192832 00000100:00100000:0.0:1784047270.688456:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191424 00000100:00100000:0.0:1784047270.688459:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191424 00000100:00100000:0.0:1784047270.688470:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191552 00000100:00100000:0.0:1784047270.688472:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191552 00000100:00100000:0.0:1784047270.688490:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1784047270.688497:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709191680:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047270.688524:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef9fad80 x1870705709191680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:401/0 lens 224/224 e 0 to 0 dl 1784047281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047270.688564:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709191680:12345-0@lo:400:kworker.0 Request processed in 67us (3847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.688586:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1784047270.688603:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1784047270.688624:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709191808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.688654:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709191808:12345-0@lo:400:kworker.0 Request processed in 32us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.688660:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1784047270.688670:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1784047270.688676:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709192320:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047270.688687:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef9fb480 x1870705709192320/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:401/0 lens 224/224 e 0 to 0 dl 1784047281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047270.688711:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709192320:12345-0@lo:400:kworker.0 Request processed in 35us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.688717:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1784047270.688726:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1784047270.688731:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709192832:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047270.688753:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef9fbb80 x1870705709192832/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:401/0 lens 224/224 e 0 to 0 dl 1784047281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047270.688778:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709192832:12345-0@lo:400:kworker.0 Request processed in 47us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.688785:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1784047270.688795:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1784047270.688801:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709191424:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047270.688813:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef9fa300 x1870705709191424/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:401/0 lens 224/224 e 0 to 0 dl 1784047281 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047270.688854:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709191424:12345-0@lo:400:kworker.0 Request processed in 53us (3643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.688860:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1784047270.688872:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1784047270.688878:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709191552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.688903:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709191552:12345-0@lo:400:kworker.0 Request processed in 26us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.688908:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1784047270.688927:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192192 00000100:00100000:0.0:1784047270.688931:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192192 00000100:00100000:0.0:1784047270.694195:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192704 00000100:00100000:0.0:1784047270.694208:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192704 00000100:00100000:0.0:1784047270.694246:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192064 00000100:00100000:0.0:1784047270.694249:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192064 00000100:00100000:0.0:1784047270.694267:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192576 00000100:00100000:0.0:1784047270.694270:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192576 00000100:00100000:0.0:1784047270.694290:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:0.0:1784047270.694299:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709192192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.694386:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709192192:12345-0@lo:400:kworker.0 Request processed in 88us (9604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694393:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:0.0:1784047270.694408:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:0.0:1784047270.694413:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709192704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.694436:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709192704:12345-0@lo:400:kworker.0 Request processed in 24us (9625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694441:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:0.0:1784047270.694465:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:0.0:1784047270.694470:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709192064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.694495:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709192064:12345-0@lo:400:kworker.0 Request processed in 25us (9133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694501:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:0.0:1784047270.694509:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1784047270.694514:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709192576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.694534:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709192576:12345-0@lo:400:kworker.0 Request processed in 21us (6248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694539:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1784047270.694565:0:85153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191296 00000100:00100000:0.0:1784047270.694569:0:85153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191296 00000100:00100000:0.0:1784047270.694593:0:85153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784047270.694598:0:85153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709191296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.694642:0:85153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709191296:12345-0@lo:400:kworker.0 Request processed in 44us (9782us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694649:0:85153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784047270.694692:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709191936 00000100:00100000:0.0:1784047270.694695:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709191936 00000100:00100000:0.0:1784047270.694717:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192448 00000100:00100000:0.0:1784047270.694719:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192448 00000100:00100000:0.0:1784047270.694734:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1784047270.694753:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709191936:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047270.694767:0:83733:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef9fb100 x1870705709191936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:401/0 lens 224/224 e 0 to 0 dl 1784047281 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047270.694794:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709191936:12345-0@lo:400:kworker.0 Request processed in 42us (9535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694806:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1784047270.694816:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1784047270.694821:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709192448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.694847:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709192448:12345-0@lo:400:kworker.0 Request processed in 26us (9546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047270.694853:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00080000:0.0:1784047270.694876:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047270.694881:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047270.694884:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047270.694886:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047270.703662:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709191296:0@lo:400:kworker.0 00000100:00100000:1.0:1784047270.703685:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709191808:0@lo:400:kworker.0 00000100:00100000:1.0:1784047270.703697:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709192320:0@lo:400:kworker.0 00000100:00100000:1.0:1784047270.703709:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709192832:0@lo:400:kworker.0 00000100:00100000:1.0:1784047270.703719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709191680:0@lo:400:kworker.0 00000100:00100000:1.0:1784047270.703729:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709192192:0@lo:400:kworker.0 00000100:00100000:1.0:1784047270.703750:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709192704:0@lo:400:kworker.0 00000100:00100000:0.0:1784047270.703911:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047270.703937:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709192960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047270.704005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047270.704151:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709192960 00000100:00100000:1.0:1784047270.704157:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709192960 00000100:00100000:1.0:1784047270.704206:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:1.0:1784047270.704214:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709192960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047270.704260:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047270.704304:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709192960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047270.704311:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:1.0:1784047270.704342:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709192960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047270.704646:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709191552:0@lo:400:kworker.0 00000100:00100000:3.0:1784047270.704658:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709192064:0@lo:400:kworker.0 00000100:00100000:3.0:1784047270.704669:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709192576:0@lo:400:kworker.0 00000100:00100000:3.0:1784047270.704679:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709191424:0@lo:400:kworker.0 00000100:00100000:3.0:1784047270.704689:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709191936:0@lo:400:kworker.0 00000100:00100000:3.0:1784047270.704697:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709192448:0@lo:400:kworker.0 00000100:00100000:3.0:1784047271.186766:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709193088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047271.186847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047271.186911:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193088 00000100:00100000:3.0:1784047271.186918:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193088 00000100:00100000:3.0:1784047271.186962:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1784047271.186971:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709193088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047271.187006:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00010000:00000080:3.0:1784047271.187023:0:23872:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00d9d880 x1870705709193088/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:402/0 lens 224/368 e 0 to 0 dl 1784047282 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047271.187063:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709193088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047271.187076:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1784047271.187124:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709193088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047271.187281:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047271.187291:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709193216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047271.187357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047271.187553:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709193344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047271.187580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047271.187709:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193216 00000100:00100000:2.0:1784047271.187713:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193216 00000100:00100000:2.0:1784047271.187756:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193344 00000100:00100000:2.0:1784047271.187759:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193344 00000100:00100000:2.0:1784047271.187843:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:2.0:1784047271.187851:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709193216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047271.187871:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047271.187904:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709193216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047271.187911:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:2.0:1784047271.187924:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1784047271.187930:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709193344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047271.187945:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047271.187970:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709193344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047271.187976:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:1.0:1784047271.188048:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709193344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047271.188061:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709193216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784047271.191047:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784047271.498747:0:86466:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784047271.498816:0:86466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.498832:0:86466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.498841:0:86466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.498848:0:86466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.498873:0:86466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784047271.498879:0:86466:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784047271.498907:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784047271.498912:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784047271.498917:0:86466:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784047271.498943:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a69000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1784047271.499066:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047271.499073:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.499081:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047271.499085:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.499094:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047271.499102:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047271.499108:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047271.499125:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784047271.499128:0:16469:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784047271.499156:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.499162:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047271.499208:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.499216:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc600/0x4426598c0c773af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773afd expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.499227:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.499229:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.499230:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047271.499238:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047271.499257:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709193600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047271.499320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047271.499462:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709193472:0@lo:39:umount.0 00000100:00100000:2.0:1784047271.499495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047271.499677:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193472 00000100:00100000:0.0:1784047271.499685:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193472 00000100:00100000:0.0:1784047271.499738:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1784047271.499747:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709193472:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784047271.499860:0:68026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773c15 00000100:00080000:0.0:1784047271.499876:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccebebb000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1784047271.499908:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc44f1c00 x1870705709193472/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1784047282 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047271.499948:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870705709193472:12345-0@lo:39:umount.0 Request processed in 201us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.499955:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000020:00000080:0.0:1784047271.499972:0:68026:0:(genops.c:906:class_export_put()) final put ffff99ccebebd800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1784047271.500040:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784047271.500048:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebebd800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047271.500097:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccebebb000 for lustre-MDT0000 00000100:00080000:2.0:1784047271.500131:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a69000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784047271.500141:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709193472:0@lo:39:umount.0 00000100:00080000:3.0:1784047271.500231:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784047271.500234:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784047271.500238:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1784047271.500360:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193600 00000100:00100000:1.0:1784047271.500366:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193600 00000100:00100000:1.0:1784047271.500547:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1784047271.500556:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709193600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047271.500567:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047271.500583:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c773afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773af6 expref: 24 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047271.500599:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047271.500652:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+23:3646:x1870705709193600:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047271.500659:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1784047271.500695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709193600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047271.507718:0:86466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.507755:0:86466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511542:0:86466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511552:0:86466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511635:0:86466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047271.511644:0:86466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511652:0:86466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511660:0:86466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511666:0:86466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511682:0:86466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047271.511693:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047271.511699:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511707:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047271.511711:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511718:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047271.511750:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047271.511756:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047271.511759:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1784047271.511804:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511811:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047271.511835:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511843:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c773a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773a1d expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511858:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047271.511861:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511867:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047271.511870:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511877:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047271.511883:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047271.511889:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047271.511896:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784047271.511899:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784047271.511913:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511919:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047271.511932:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511939:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c773b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773b27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.511948:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047271.511950:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047271.511952:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047271.511961:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047271.511981:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709193728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047271.512047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047271.512098:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709193856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047271.512121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047271.512147:0:86466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512156:0:86466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512162:0:86466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512169:0:86466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512197:0:86466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047271.512212:0:86466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512219:0:86466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512225:0:86466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512232:0:86466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.512247:0:86466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1784047271.512251:0:86466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784047271.512254:0:86466:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1784047271.512290:0:86466:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784047271.512294:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1784047271.512299:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1784047271.512305:0:86466:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1784047271.512904:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047271.512911:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.512918:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047271.512921:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.512929:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047271.512935:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047271.512940:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784047271.512943:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784047271.512945:0:16469:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784047271.512965:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.512971:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047271.512983:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.512991:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c773ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773aef expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513002:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047271.513005:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513022:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047271.513025:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513032:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047271.513039:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047271.513044:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047271.513046:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784047271.513048:0:16469:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784047271.513060:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513065:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047271.513074:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513080:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46000/0x4426598c0c773a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773a0f expref: -99 pid: 85146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513091:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.513092:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.513094:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047271.513103:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047271.513111:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709193984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047271.513142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047271.513182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709194112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047271.513215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047271.513250:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193728 00000100:00100000:0.0:1784047271.513257:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193728 00000100:00100000:0.0:1784047271.513300:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193856 00000100:00100000:0.0:1784047271.513303:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193856 00000100:00100000:0.0:1784047271.513321:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709193984 00000100:00100000:0.0:1784047271.513324:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709193984 00000100:00100000:0.0:1784047271.513340:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709194112 00000100:00100000:0.0:1784047271.513343:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709194112 00000100:00100000:0.0:1784047271.513359:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1784047271.513368:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709193728:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047271.513372:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00010000:00010000:0.0:1784047271.513385:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784047271.513386:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+26:3647:x1870705709193856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047271.513399:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047271.513405:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24ac00/0x4426598c0c773a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773a16 expref: 26 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047271.513412:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24a400/0x4426598c0c773b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b20 expref: 26 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.513420:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047271.513426:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047271.513462:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709193728:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.513472:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1784047271.513473:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709193856:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047271.513483:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1784047271.513492:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1784047271.513501:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709193984:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047271.513506:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00010000:00010000:0.0:1784047271.513511:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784047271.513516:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+22:3645:x1870705709194112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047271.513523:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24be00/0x4426598c0c773aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773ae8 expref: 22 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047271.513525:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047271.513537:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047271.513539:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c773a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773a01 expref: 21 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047271.513551:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047271.513565:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+20:3647:x1870705709193984:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047271.513581:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+20:3645:x1870705709194112:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.513585:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1784047271.513593:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1784047271.513652:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709194112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047271.513656:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709193984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047271.513672:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709193728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047271.513674:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709193856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047271.514927:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047271.514935:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1784047271.526493:0:86466:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1784047271.527199:0:85147:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:3.0:1784047271.527309:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527324:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527332:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527350:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047271.527355:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527363:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527381:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99cbc89ff700) 00010000:00010000:3.0:1784047271.527384:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047271.527389:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527396:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c773f64 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527421:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527428:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527434:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527439:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047271.527442:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527448:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527467:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99cbc89ff500) 00010000:00010000:3.0:1784047271.527469:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047271.527472:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.527478:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c773f79 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784047271.527740:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1784047271.527830:0:86466:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccfe78d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047271.527836:0:86466:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbc7a6f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047271.527842:0:86466:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc3565800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047271.527846:0:86466:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc3558000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047271.527854:0:86466:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc355b000 2a2569b5-a558-4441-a96a-1d77608df16b 192.168.204.40@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215113 stale:0 00000020:00080000:0.0:1784047271.527860:0:86466:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99cbc76c8000) has exports, disconnecting them 00000020:00080000:0.0:1784047271.527865:0:86466:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccfe78d000), last request at 1784047245 00000020:00000080:0.0:1784047271.527872:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773c0e 00000100:00080000:0.0:1784047271.527881:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99ccebebd000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047271.527912:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccfe78d000): rc 0 00000020:00000080:0.0:1784047271.527915:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccfe78d000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1784047271.527943:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784047271.527959:0:86466:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbc7a6f000), last request at 1784047270 00000020:00000080:0.0:1784047271.527963:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773c07 00000100:00080000:0.0:1784047271.527967:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047271.527980:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc7a6f000): rc 0 00000020:00000080:0.0:1784047271.527982:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cbc7a6f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784047271.527997:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe78d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1784047271.528009:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047271.528050:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccebebd000 for lustre-MDT0000 00000020:00080000:0.0:1784047271.528386:0:86466:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccc3565800), last request at 1784047270 00000020:00000080:0.0:1784047271.528390:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773c00 00000100:00080000:0.0:1784047271.528397:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a68800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784047271.528422:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047271.528454:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7a6f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047271.528549:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7a6c000 for lustre-MDT0000 00000020:00080000:1.0:1784047271.528561:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc3565800): rc 0 00000020:00000080:1.0:1784047271.528563:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc3565800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784047271.528576:0:86466:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccc3558000), last request at 1784047239 00000020:00000080:1.0:1784047271.528586:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a6a 00000100:00080000:1.0:1784047271.528596:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99cbcd4b2800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047271.528598:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3565800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:1.0:1784047271.528693:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc3558000): rc 0 00000020:00000080:1.0:1784047271.528696:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc3558000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1784047271.528703:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047271.528744:0:86466:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.40@tcp (ffff99ccc355b000), last request at 1784047269 00000020:00000080:1.0:1784047271.528757:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a63 00000020:00010000:1.0:1784047271.528763:0:86466:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccc355b000: total 2 00000100:00080000:1.0:1784047271.528766:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99ccff383800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047271.528777:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccc355b000): rc 0 00000004:00000080:1.0:1784047271.528783:0:86466:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc9141d7fae0 00000100:00080000:1.0:1784047271.528801:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784047271.528805:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:3.0:1784047271.529742:0:16468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccc355b000: total 2 00010000:00010000:3.0:1784047271.529905:0:16468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccc355b000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1784047271.530101:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c773f6b lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 4 pid: 67153 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.530129:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c773f33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae16b expref: 3 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.530147:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c773f4f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae172 expref: 2 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047271.530160:0:16468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccc355b000, canceled 3 locks, left on hash table 0. 00000100:00080000:1.0:1784047271.530983:0:86466:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784047271.531011:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99cd00328800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784047271.531403:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784047271.531407:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 3 00000004:00080000:1.0:1784047271.531420:0:86466:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784047271.531800:0:86466:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784047271.531811:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99ccec804800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784047271.531818:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784047271.531820:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 3 00000004:00080000:1.0:1784047271.531830:0:86466:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784047271.531891:0:86466:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784047271.531910:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99ccec319000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784047271.531971:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cbc76c8000) has no exports 00000100:00100000:0.0:1784047271.533154:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709194240:0@lo:39:umount.0 00000100:00100000:0.0:1784047271.533251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047271.533286:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709194368:0@lo:9:umount.0 00000100:00100000:0.0:1784047271.533311:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047271.533337:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709194496:0@lo:9:umount.0 00000100:00100000:0.0:1784047271.533357:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047271.533397:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709194240 00000100:00100000:0.0:1784047271.533404:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709194240 00000100:00100000:0.0:1784047271.533446:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1784047271.533454:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709194240:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784047271.533496:0:83733:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a9b 00000100:00080000:0.0:1784047271.533504:0:83733:0:(import.c:65:import_set_state_nolock()) ffff99ccd001c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047271.533523:0:83733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411435 00000100:00100000:0.0:1784047271.533679:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3644:x1870705709194240:12345-0@lo:39:umount.0 Request processed in 225us (435us total) trans 77309411436 rc 0/0 00000100:00100000:0.0:1784047271.533687:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1784047271.533709:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709194368 00000100:00100000:0.0:1784047271.533713:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709194368 00000100:00100000:0.0:1784047271.533752:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709194496 00000100:00100000:0.0:1784047271.533755:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709194496 00000100:00100000:0.0:1784047271.533773:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:0.0:1784047271.533779:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709194368:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784047271.533793:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773ac5 00000100:00080000:0.0:1784047271.533798:0:26182:0:(import.c:65:import_set_state_nolock()) ffff99cce4924000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047271.533832:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968749 00000100:00100000:0.0:1784047271.533917:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709194368:12345-0@lo:9:umount.0 Request processed in 137us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.533924:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00100000:0.0:1784047271.533942:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943 00000100:00100000:0.0:1784047271.533947:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709194496:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784047271.533958:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773ad3 00000100:00080000:0.0:1784047271.533963:0:26182:0:(import.c:65:import_set_state_nolock()) ffff99ccff384000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047271.533983:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968749 00000020:00000080:2.0:1784047271.534016:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3558000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047271.534058:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7a68800 for lustre-MDT0000 00000020:00000080:2.0:1784047271.534064:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcd4b2800 for lustre-MDT0000 00000100:00100000:0.0:1784047271.534068:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709194496:12345-0@lo:9:umount.0 Request processed in 112us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.534077:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943 00010000:00010000:0.0:1784047271.534115:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047271.534143:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cd00328800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784047271.534149:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709194240:0@lo:39:umount.0 00000100:00080000:0.0:1784047271.534162:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec804800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784047271.534181:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784047271.534183:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047271.534185:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709194368:0@lo:9:umount.0 00000100:00080000:0.0:1784047271.534194:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec319000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784047271.534201:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784047271.534202:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047271.534204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709194496:0@lo:9:umount.0 00000020:00080000:1.0:1784047271.534998:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cbc76c8000) has no exports 00010000:00010000:0.0:1784047271.535657:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047271.535997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047271.563423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047271.563476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047271.563499:0:85154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689407104 00000100:00100000:2.0:1784047271.563510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047271.563511:0:85154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689407104 00000100:00100000:2.0:1784047271.563539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047271.563573:0:85154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:2.0:1784047271.563575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047271.563587:0:85154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689407104:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047271.563651:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689407360 00000100:00100000:2.0:1784047271.563657:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689407360 00000100:00100000:0.0:1784047271.563673:0:85154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689407104:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.563682:0:85154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:2.0:1784047271.563709:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689407232 00000100:00100000:2.0:1784047271.563714:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689407232 00000100:00100000:2.0:1784047271.563750:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1098 00000100:00100000:2.0:1784047271.563759:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689407360:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047271.563796:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689407360:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 39us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047271.563803:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1098 00000100:00100000:2.0:1784047271.563819:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1103 00000100:00100000:2.0:1784047271.563823:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1870705689407232:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:2.0:1784047271.563830:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:2.0:1784047271.563854:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1870705689407232:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (315us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047271.563881:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1103 00000100:00100000:2.0:1784047271.563903:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689407616 00000100:00100000:2.0:1784047271.563907:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689407616 00000100:00100000:2.0:1784047271.563945:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689407488 00000100:00100000:2.0:1784047271.563948:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689407488 00000100:00100000:2.0:1784047271.563973:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2408 00000100:00100000:2.0:1784047271.563979:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689407616:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047271.564011:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2409 00000100:00100000:2.0:1784047271.564012:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689407616:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047271.564025:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2408 00000100:00100000:0.0:1784047271.564027:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689407488:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:2.0:1784047271.564053:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047271.564058:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047271.564062:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047271.564062:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689407488:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 41us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047271.564073:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2409 00000100:00100000:0.0:1784047271.581391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047271.581709:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689407744 00000100:00100000:2.0:1784047271.581730:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689407744 00000100:00100000:2.0:1784047271.581845:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1104 00000100:00100000:2.0:1784047271.582009:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689407744:12345-192.168.204.40@tcp:38:ptlrpcd_01_00.0 00010000:02000000:2.0:1784047271.582035:0:68026:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.204.40@tcp (stopping) 00000020:00000080:3.0:1784047271.584584:0:16468:0:(genops.c:906:class_export_put()) final put ffff99ccc355b000/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:0.0:1784047271.585237:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc355b000/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-MDT0000 00000020:00000080:0.0:1784047271.585338:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccff383800 for lustre-MDT0000 00010000:00010000:3.0:1784047271.586030:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047271.586034:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047271.586037:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047271.597921:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689407744:12345-192.168.204.40@tcp:38:ptlrpcd_01_00.0 Request processed in 16058us (16533us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047271.598002:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1104 00000020:00000080:1.0:1784047271.642299:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a7f 00000020:00000080:1.0:1784047271.642317:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccec31e800/lustre-QMT0000_UUID 00000020:01000000:1.0:1784047271.645081:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784047271.649091:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec31e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784047271.649137:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047271.649152:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784047271.649157:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99cd00d799c0) has no exports 00000020:00000080:0.0:1784047271.652145:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a78 00000020:00000080:0.0:1784047271.652158:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccfe667800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047271.652201:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe667800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784047271.652233:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.652255:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784047271.652258:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccfe664800/lustre-QMT0000_UUID 00000020:00000080:0.0:1784047271.652261:0:86466:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe664800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784047271.652267:0:86466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1784047271.652536:0:86466:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc5a32420 - data ffff99ccf78fdaf8/ffff99ccfe6d9c00 00000020:01000000:0.0:1784047271.652751:0:86466:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc10b63c0 - data ffff99ccf7b12438/ffff99cbd054bc00 00000100:00080000:2.0:1784047271.740089:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047271.740100:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784047271.740118:0:86466:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99ccec97ad80 x1870705709194240/t77309411436(77309411436) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047281 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047271.740164:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784047271.742029:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047271.742035:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 4 00000004:00080000:2.0:1784047271.742054:0:86466:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047271.742056:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784047271.742839:0:85165:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784047271.742844:0:85165:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1784047271.742855:0:85165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:2.0:1784047271.744065:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047271.744070:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 4 00000004:00080000:2.0:1784047271.744086:0:86466:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047271.744088:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047271.745104:0:85167:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047271.745109:0:85167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:1.0:1784047271.745152:0:85167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:2.0:1784047271.748109:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a39 00000020:00000080:2.0:1784047271.748121:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccfddd4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047271.749116:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a4e 00000020:00000080:2.0:1784047271.749124:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc3559800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047271.749129:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784047271.749135:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047271.749146:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047271.749150:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99cbc76cb380) has no exports 00000020:00000080:1.0:1784047271.749450:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047271.749459:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3559800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1784047271.749677:0:86466:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784047271.749686:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773acc 00000020:00000080:2.0:1784047271.749760:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc5e53000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047271.749817:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784047271.749822:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047271.749830:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784047271.749833:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99ccfebb4d40) has no exports 00000020:00000080:2.0:1784047271.749839:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773abe 00000020:00000080:2.0:1784047271.749842:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccec31d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047271.750457:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784047271.750662:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec31d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784047271.751100:0:86466:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784047271.751104:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047271.751109:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968749 gen 5 00000004:00080000:2.0:1784047271.751114:0:86466:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047271.751116:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047271.751232:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047271.751250:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047271.751256:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773ab0 00000020:00000080:2.0:1784047271.751262:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc5e53800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047271.751422:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec319000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784047271.751428:0:81515:0:(genops.c:906:class_export_put()) final put ffff99ccc5e57800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047271.751430:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e57800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784047271.751435:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784047271.754830:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784047271.754841:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047271.754856:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784047271.754861:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99cce497cd40) has no exports 00000020:00000080:2.0:1784047271.754872:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773aa9 00000020:00000080:2.0:1784047271.754881:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cd00cff800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047271.755316:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e53800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784047271.755334:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd00cff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784047271.755468:0:86466:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784047271.755473:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047271.755477:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 5 00000004:00080000:2.0:1784047271.755484:0:86466:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047271.755486:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047271.755531:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047271.755540:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1784047271.755555:0:86466:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784047271.755561:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a94 00000020:00000080:2.0:1784047271.755565:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cbcadfa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047271.755569:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1784047271.755573:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047271.755577:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784047271.755579:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99cceff38000) has no exports 00000020:00000080:2.0:1784047271.755583:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a8d 00000020:00000080:2.0:1784047271.755586:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cd0032c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047271.756419:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec804800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784047271.756428:0:81515:0:(genops.c:906:class_export_put()) final put ffff99cbcadfd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047271.756431:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcadfd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784047271.756436:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047271.756524:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcadfa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784047271.756529:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd0032c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784047271.757677:0:86466:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784047271.757683:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784047271.757686:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784047271.757702:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047271.757769:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.757784:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047271.757813:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.757816:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047271.757820:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cd0032b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047271.757823:0:86466:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd0032b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784047271.757829:0:86466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047271.757917:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a55 00000020:00000080:0.0:1784047271.757924:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc355a000/lustre-MDD0000_UUID 00000020:01000000:0.0:1784047271.757944:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784047271.757948:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047271.757953:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784047271.757956:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cbc76ccd40) has no exports 00000020:00000080:0.0:1784047271.757975:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.757978:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784047271.757981:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773a5c 00000020:00000080:0.0:1784047271.757984:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccc355a800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784047271.757990:0:86466:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccfddd1000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784047271.757994:0:86466:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccfddd1000 3 00000020:01000004:0.0:1784047271.757997:0:86466:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccfddd1000 from lustre-MDT0000 00000020:00000080:0.0:1784047271.758013:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.758017:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784047271.758019:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cd00329000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784047271.758021:0:86466:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd00329000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784047271.758027:0:86466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784047271.758056:0:86466:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784047271.758059:0:86466:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784047271.758062:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784047271.758064:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047271.758067:0:86466:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784047271.758076:0:86466:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccff383000 d42aef96-772a-4ce2-a768-bea713505b5b 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047271.758082:0:86466:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99cbcaee4800 6e36843b-2016-43fe-8842-da5818d68597 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047271.758091:0:86466:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff99cd00104d40) has exports, disconnecting them 00000020:00080000:0.0:1784047271.758095:0:86466:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.40@tcp (ffff99ccff383000), last request at 1784047240 00000020:00000080:0.0:1784047271.758116:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773b19 00000020:00010000:0.0:1784047271.758119:0:86466:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccff383000: total 2 00000100:00080000:0.0:1784047271.758123:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047271.758136:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccff383000): rc 0 00000020:00080000:0.0:1784047271.758139:0:86466:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99cbcaee4800), last request at 1784047239 00000020:00000080:0.0:1784047271.758180:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7739fa 00000020:00010000:0.0:1784047271.758195:0:86466:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cbcaee4800: total 2 00000100:00080000:0.0:1784047271.758197:0:86466:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047271.758205:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbcaee4800): rc 0 00000020:00080000:0.0:1784047271.758209:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99cd00104d40) has no exports 00000020:00010000:0.0:1784047271.758218:0:16469:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccff383000: total 2 00010000:00010000:0.0:1784047271.758221:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.758547:0:16469:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccff383000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784047271.758584:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1600/0x4426598c0c773beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae11e expref: 5 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758601:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47200/0x4426598c0c773bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae12c expref: 4 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758637:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46a00/0x4426598c0c773be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae117 expref: 3 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758647:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0200/0x4426598c0c773bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae125 expref: 2 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758658:0:16469:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccff383000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784047271.758676:0:16469:0:(genops.c:906:class_export_put()) final put ffff99ccff383000/d42aef96-772a-4ce2-a768-bea713505b5b 00000020:00010000:0.0:1784047271.758750:0:16469:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cbcaee4800: total 3 00010000:00010000:0.0:1784047271.758770:0:16469:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cbcaee4800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784047271.758786:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24b600/0x4426598c0c773b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b2e expref: 14 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758798:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c773bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773bac expref: 13 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758808:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24a200/0x4426598c0c773b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b3c expref: 12 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758819:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24a800/0x4426598c0c773ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b9e expref: 11 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758829:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47400/0x4426598c0c773b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b58 expref: 10 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758840:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46600/0x4426598c0c773bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773bba expref: 9 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758849:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24aa00/0x4426598c0c773b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b4a expref: 8 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758860:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0400/0x4426598c0c773bcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773bc8 expref: 7 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758871:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c773bdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773bd6 expref: 6 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758881:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c773b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b66 expref: 5 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758903:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24a000/0x4426598c0c773b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b74 expref: 4 pid: 85153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758913:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46200/0x4426598c0c773b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b82 expref: 3 pid: 85154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758924:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24b800/0x4426598c0c773b97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773b90 expref: 2 pid: 85158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047271.758933:0:16469:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cbcaee4800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784047271.758945:0:16469:0:(genops.c:906:class_export_put()) final put ffff99cbcaee4800/6e36843b-2016-43fe-8842-da5818d68597 00010000:00010000:0.0:1784047271.758950:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.758951:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047271.758953:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047271.759019:0:85153:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ccfa3b0200:85153] 1 exiting: rc = 0 00000100:00100000:0.0:1784047271.759114:0:85152:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ccfa3b1400:85152] 0 exiting: rc = 1 00000100:00100000:0.0:1784047271.759159:0:85154:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ccd9abbe00:85154] 2 exiting: rc = 0 00000020:00000080:1.0:1784047271.759292:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cd00328800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784047271.759299:0:81515:0:(genops.c:906:class_export_put()) final put ffff99cbc1d80800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047271.759301:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc1d80800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784047271.759312:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047271.759371:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc355a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784047271.759376:0:81515:0:(genops.c:906:class_export_put()) final put ffff99cbc1d84000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784047271.759378:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc1d84000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784047271.759381:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784047271.759406:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc355a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047271.759410:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccff383000/d42aef96-772a-4ce2-a768-bea713505b5b for MGS 00000020:00000080:1.0:1784047271.759434:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee4800/6e36843b-2016-43fe-8842-da5818d68597 for MGS 00000020:00000080:1.0:1784047271.759446:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccff387000 for MGS 00000020:00000080:1.0:1784047271.759449:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcaee6000 for MGS 00000100:00100000:0.0:1784047271.773873:0:85158:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99cbc79b5400:85158] 3 exiting: rc = 0 00000100:00100000:1.0:1784047271.774044:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774053:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774060:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774065:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774071:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774076:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774082:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774087:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774094:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774100:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774106:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774114:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774120:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774126:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774132:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774137:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774144:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774150:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774155:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774161:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774168:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774175:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774203:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774212:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774218:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774224:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774231:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774249:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774257:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774263:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774268:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774275:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774281:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774287:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774293:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774298:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774303:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774309:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774315:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774329:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774334:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774341:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774346:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774351:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774356:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774361:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774366:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774372:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774377:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774381:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774386:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774391:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774396:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774402:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774406:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774411:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774416:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774469:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774475:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774481:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774485:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774490:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774495:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047271.774501:0:86466:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1784047271.776108:0:86466:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc10b62a0 - data ffff99ccf79f01b0/ffff99cbd0549800 00000020:01000000:1.0:1784047271.776237:0:86466:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccfdc88cc0 - data ffff99ccf33621b0/ffff99ccfe675800 00000020:00000080:1.0:1784047271.776879:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7739f3 00000020:00000080:1.0:1784047271.776887:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cbcaee0000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784047271.777007:0:86466:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccfddd1000 from MGS, refs=2 00000020:01000004:1.0:1784047271.777012:0:86466:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccfddd1000 2 00000020:01000004:1.0:1784047271.777014:0:86466:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccfddd1000 from MGS 00000020:00000080:1.0:1784047271.777035:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047271.777042:0:86466:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784047271.777045:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cbcaee0800/MGS 00000020:00000080:1.0:1784047271.777048:0:86466:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee0800/MGS for MGS 00000020:01000000:1.0:1784047271.777054:0:86466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784047271.777118:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784047271.777121:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047271.777131:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784047271.777137:0:86466:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ccf759b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047271.777144:0:86466:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99cceff3b380) has exports, disconnecting them 00000020:00080000:1.0:1784047271.777148:0:86466:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ccf759b000), last request at 1784047239 00000020:00000080:1.0:1784047271.777152:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773b0b 00000020:00080000:1.0:1784047271.777161:0:86466:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccf759b000): rc 0 00000020:00000080:1.0:1784047271.777165:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccf759b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784047271.778172:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784047271.778791:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf759b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784047271.779723:0:86466:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784047271.779729:0:86466:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784047271.779733:0:86466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784047271.779739:0:86466:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047271.779762:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7a69000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784047271.779887:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.779900:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784047271.779905:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccf7598000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784047271.779918:0:86466:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7598000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784047271.779925:0:86466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784047271.780015:0:86466:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccfddd1000 1 00000020:00000080:0.0:1784047271.780021:0:86466:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7739e5 00000020:00000080:0.0:1784047271.780026:0:86466:0:(genops.c:906:class_export_put()) final put ffff99cbcaee2000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784047271.780034:0:86466:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784047271.780041:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784047271.780049:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047271.780054:0:86466:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784047271.780057:0:86466:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99ccfebb19c0) has no exports 00010000:00010000:0.0:1784047271.785073:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784047271.877164:0:86466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047271.877233:0:86466:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784047271.877240:0:86466:0:(genops.c:906:class_export_put()) final put ffff99ccfddd2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047271.877245:0:86466:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784047271.877257:0:86466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784047271.877431:0:86466:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ccfddd7800 00000020:02000400:0.0:1784047271.877491:0:86466:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1784047272.212739:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1784047272.212772:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047272.212773:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709194624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047272.212846:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047272.212895:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709194624 00000100:00100000:0.0:1784047272.212905:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709194624 00000100:00100000:0.0:1784047272.212970:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1784047272.212980:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709194624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047272.213002:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047272.213045:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709194624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047272.213054:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1784047272.213636:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709194624:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784047272.213735:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047272.214955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047272.214971:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709194752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047272.215025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047272.215074:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709194752 00000100:00100000:1.0:1784047272.215080:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709194752 00000100:00100000:1.0:1784047272.215127:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1784047272.215136:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709194752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047272.215155:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047272.215196:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709194752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047272.215203:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1784047272.215319:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709194752:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784047272.215566:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784047273.244158:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047274.260655:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047275.283527:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047275.796217:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709195264:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.796446:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709194880:0@lo:400:kworker.0 00000100:00100000:0.0:1784047275.796534:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709195008:0@lo:400:kworker.0 00000400:00000100:1.0:1784047275.796772:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709194880 offset 0 length 224: 4 00000100:00100000:1.0:1784047275.796814:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709195392:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.796845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047275.797159:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709195904:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047275.797239:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195392 00000100:00100000:2.0:1784047275.797247:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195392 00000100:00100000:1.0:1784047275.797248:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047275.797253:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709195776:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047275.797296:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195904 00000100:00100000:2.0:1784047275.797299:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195904 00000100:00100000:1.0:1784047275.797305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709195136:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047275.797399:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195136 00000100:00100000:2.0:1784047275.797403:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195136 00000100:00100000:1.0:1784047275.797411:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709195648:0@lo:400:kworker.0 00000100:00100000:2.0:1784047275.797424:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1784047275.797432:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709195392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047275.797464:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195776 00000100:00100000:1.0:1784047275.797467:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195776 00000100:00100000:2.0:1784047275.797489:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709195392:12345-0@lo:400:kworker.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047275.797491:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195648 00000100:00100000:2.0:1784047275.797496:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1784047275.797502:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195648 00000100:00100000:2.0:1784047275.797513:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1784047275.797519:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709195136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797525:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:1.0:1784047275.797530:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709195776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047275.797549:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709195136:12345-0@lo:400:kworker.0 Request processed in 30us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047275.797555:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1784047275.797557:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709195776:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047275.797562:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00100000:2.0:1784047275.797567:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1784047275.797571:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870705709195904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797571:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000020:00080000:2.0:1784047275.797576:0:66221:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047275.797576:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709195648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047275.797598:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870705709195904:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047275.797598:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709195648:12345-0@lo:400:kworker.0 Request processed in 21us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047275.797622:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:2.0:1784047275.797625:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00080000:2.0:1784047275.797652:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047275.797657:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047275.797659:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047275.797685:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709195136:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709195648:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797723:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709195776:0@lo:400:kworker.0 00000100:00100000:1.0:1784047275.797733:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709195392:0@lo:400:kworker.0 00000100:00080000:1.0:1784047275.797742:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047275.797746:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047275.797750:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047275.797756:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047275.797759:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3343 00000100:00080000:1.0:1784047275.797765:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047275.797796:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2eabb80 x1870705709196032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047275.797843:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709195904:0@lo:400:kworker.0 00000100:00100000:2.0:1784047275.799030:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709196032:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047275.799086:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047275.799234:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196032 00000100:00100000:1.0:1784047275.799240:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196032 00000100:00100000:1.0:1784047275.799271:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1784047275.799278:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709196032:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1784047275.799296:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047275.800096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047275.800235:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195264 00000100:00100000:2.0:1784047275.800242:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195264 00000100:00100000:2.0:1784047275.800277:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1784047275.800283:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1870705709195264:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047275.800291:0:67153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047275.800346:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1870705709195264:12345-0@lo:400:kworker.0 Request processed in 61us (251us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047275.800352:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1784047275.806501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047275.806783:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195008 00000100:00100000:0.0:1784047275.806796:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195008 00000100:00100000:2.0:1784047275.807778:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1784047275.807788:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870705709195008:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047275.807798:0:66220:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:3.0:1784047275.807944:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784047275.807951:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784047275.807955:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784047275.807961:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047275.807965:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3343 00000100:00080000:3.0:1784047275.807972:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047275.808010:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfde0d180 x1870705709196160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047275.808036:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709195264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047275.808070:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709196160:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784047275.809289:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709195520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047275.816049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047275.818041:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196160 00000100:00100000:3.0:1784047275.818055:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196160 00000100:00100000:2.0:1784047275.818824:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870705709195008:12345-0@lo:400:kworker.0 Request processed in 11029us (12324us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047275.818837:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1784047275.819524:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1784047275.819533:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709196160:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784047275.819557:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047275.819667:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709196160:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 133us (3625us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047275.819673:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00080000:3.0:1784047275.819737:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047275.819743:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047275.819748:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709196160:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784047275.821618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047275.821689:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047275.821695:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047275.821699:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784047275.821704:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047275.821708:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3343 00000100:00080000:0.0:1784047275.821715:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047275.821746:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e8380 x1870705709196288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047275.821772:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709195008:0@lo:400:kworker.0 00000100:00100000:2.0:1784047275.821870:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709196288:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784047275.821884:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709195520 00000100:00100000:3.0:1784047275.821902:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709195520 00000100:00100000:2.0:1784047275.821906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047275.821941:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1784047275.821948:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870705709195520:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784047275.821955:0:23872:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784047275.822006:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870705709195520:12345-0@lo:400:kworker.0 Request processed in 57us (407us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047275.822012:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00080000:2.0:1784047275.822110:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784047275.822114:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784047275.822117:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784047275.822122:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047275.822125:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3343 00000100:00080000:2.0:1784047275.822130:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047275.822144:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef50b800 x1870705709196416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047275.822183:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709195520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047275.822243:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709196416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784047275.822269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047275.822460:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196416 00000100:00100000:2.0:1784047275.822465:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196416 00000100:00100000:2.0:1784047275.822497:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:2.0:1784047275.822503:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709196416:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784047275.822521:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047275.822553:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709196416:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 49us (283us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047275.822560:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00080000:3.0:1784047275.822658:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047275.822664:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047275.822667:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709196416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784047275.822820:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196288 00000100:00100000:0.0:1784047275.822825:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196288 00000100:00100000:0.0:1784047275.822857:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1784047275.822863:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709196288:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1784047275.822873:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047275.822911:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709196288:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 46us (1002us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047275.822916:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00080000:2.0:1784047275.823318:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047275.823323:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047275.823326:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709196288:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784047275.839216:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709196032:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 39920us (40111us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047275.839233:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00080000:2.0:1784047275.839720:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047275.839727:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047275.839732:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709196032:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1784047276.306757:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1784047276.690153:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689407872 offset 0 length 224: 4 00000100:00100000:2.0:1784047276.690198:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047276.690238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047276.690278:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408128 00000100:00100000:2.0:1784047276.690279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047276.690289:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408128 00000100:00100000:2.0:1784047276.690322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00080000:2.0:1784047276.690347:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047276.690363:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408000 00000100:00100000:2.0:1784047276.690368:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408000 00000100:00100000:3.0:1784047276.690372:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1101 00000100:00100000:3.0:1784047276.690386:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689408128:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047276.690404:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1111 00000100:00100000:1.0:1784047276.690414:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408256 00000100:00100000:1.0:1784047276.690421:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408256 00000100:00100000:2.0:1784047276.690429:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689408000:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047276.690451:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047276.690475:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408384 00000100:00100000:1.0:1784047276.690491:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408384 00000100:00100000:1.0:1784047276.690524:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2412 00000100:00100000:1.0:1784047276.690539:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689408256:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047276.690568:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689408128:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047276.690577:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1101 00000100:00100000:2.0:1784047276.696665:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689408000:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 6225us (6330us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047276.696682:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1111 00000100:00100000:1.0:1784047276.697375:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689408256:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 6833us (7131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047276.701920:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2413 00000100:00100000:0.0:1784047276.701953:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689408384:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047276.702545:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689408384:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 610us (12264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047276.702555:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2413 00000100:00080000:0.0:1784047276.708583:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047276.708594:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047276.722736:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2412 00010000:00010000:0.0:1784047277.330781:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047277.331222:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709196544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047277.331807:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047277.331859:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047277.331868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709196672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047277.331895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047277.338542:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196544 00000100:00100000:1.0:1784047277.338559:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196544 00000100:00100000:1.0:1784047277.338686:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196672 00000100:00100000:1.0:1784047277.338690:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196672 00000100:00100000:1.0:1784047277.338723:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:1.0:1784047277.338734:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709196544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047277.338769:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047277.338857:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1784047277.338870:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709196672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047277.338889:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047277.338973:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709196544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 241us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047277.338982:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00080000:2.0:1784047277.339272:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047277.339277:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047277.342927:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709196672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4045us (11015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047277.342944:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1784047277.343198:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709196672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047277.343224:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709196544:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1784047277.845183:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047277.845193:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccd8410800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047277.845298:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd8410800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784047277.845363:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccff384000 for lustre-OST0001 00000001:00100000:1.0:1784047277.848254:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047277.848263:0:8425:0:(genops.c:906:class_export_put()) final put ffff99cbc753c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047277.848414:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc753c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784047277.848481:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce4924000 for lustre-OST0000 00000001:00100000:3.0:1784047277.849281:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784047277.849293:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411436 is committed 00000020:00000080:3.0:1784047277.849297:0:75662:0:(genops.c:906:class_export_put()) final put ffff99ccd0019800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047277.849422:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd0019800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1784047277.849654:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd001c000 for lustre-MDT0001 00010000:00010000:2.0:1784047278.367577:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047279.378992:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047280.402800:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047280.918159:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047280.918166:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047280.918171:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047280.918181:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3374 00000100:00080000:2.0:1784047280.918188:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784047280.918195:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047280.918234:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef508700 x1870705709196928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047280.918270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709196928:0@lo:38:kworker.0 00000100:00100000:1.0:1784047280.918278:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047280.918296:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709196800:0@lo:400:kworker.0 00000400:00000100:0.0:1784047280.922789:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709196800 offset 0 length 224: 4 00000100:00100000:0.0:1784047280.922866:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709197056:0@lo:400:kworker.0 00000100:00100000:0.0:1784047280.922922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047280.923126:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197056 00000100:00100000:3.0:1784047280.923135:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197056 00000100:00080000:0.0:1784047280.923369:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047280.923416:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1784047280.923429:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709197056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047280.923505:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709197056:12345-0@lo:400:kworker.0 Request processed in 79us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047280.923513:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1784047280.923579:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709197056:0@lo:400:kworker.0 00000100:00080000:1.0:1784047280.925211:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047280.925219:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047280.925223:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047280.925231:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3374 00000100:00080000:1.0:1784047280.925237:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047280.925245:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047280.925283:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2ea9c00 x1870705709197184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047280.925352:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047280.925356:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047280.925357:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047280.925361:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3374 00000100:00080000:1.0:1784047280.925364:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047280.925368:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047280.925379:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2eaa680 x1870705709197440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047280.925431:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047280.925435:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047280.925437:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047280.925440:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3374 00000100:00080000:1.0:1784047280.925443:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784047280.925447:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047280.925457:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2eab100 x1870705709197824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047280.925521:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709197696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047280.925775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047280.925846:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709197312:0@lo:400:kworker.0 00000100:00100000:1.0:1784047280.925958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047280.925980:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047280.925986:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709197568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047280.926009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047280.926043:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197696 00000100:00100000:1.0:1784047280.926050:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197696 00000100:00100000:1.0:1784047280.926098:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197568 00000100:00100000:1.0:1784047280.926101:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197568 00000100:00100000:1.0:1784047280.926122:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:1.0:1784047280.926131:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709197696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047280.926184:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709197696:12345-0@lo:400:kworker.0 Request processed in 53us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047280.926191:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:1.0:1784047280.926207:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1784047280.926224:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709197568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047280.926259:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709197568:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047280.926265:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1784047280.926301:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709197696:0@lo:400:kworker.0 00000100:00100000:3.0:1784047280.927275:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197312 00000100:00100000:3.0:1784047280.927284:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197312 00000100:00100000:3.0:1784047280.927323:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1784047280.927331:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709197312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047280.927388:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709197312:12345-0@lo:400:kworker.0 Request processed in 58us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047280.927396:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:3.0:1784047280.927719:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047280.927724:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047280.927727:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047280.927778:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709197568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047280.927791:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709197312:0@lo:400:kworker.0 00000100:00100000:2.0:1784047280.938402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047280.938488:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709197184:0@lo:38:kworker.0 00000100:00100000:0.0:1784047280.938506:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709196928 00000100:00100000:0.0:1784047280.938517:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709196928 00000100:00100000:0.0:1784047280.938624:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1784047280.938631:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709196928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047280.938653:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047280.938695:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709196928:12345-0@lo:38:kworker.0 Request processed in 63us (302us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047280.938703:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1784047280.938906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047280.941523:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709197440:0@lo:38:kworker.0 00000100:00100000:2.0:1784047280.942080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047280.942114:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197440 00000100:00100000:2.0:1784047280.942121:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197440 00000100:00100000:2.0:1784047280.942166:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1784047280.942174:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709197440:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047280.942198:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047280.942243:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709197440:12345-0@lo:38:kworker.0 Request processed in 67us (161us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047280.942250:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00080000:2.0:1784047280.942302:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047280.942308:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047280.942312:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709197440:0@lo:38:kworker.0 00000100:00100000:2.0:1784047280.942320:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709197824:0@lo:38:kworker.0 00000100:00100000:2.0:1784047280.942347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047280.945295:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197184 00000100:00100000:0.0:1784047280.945307:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197184 00000100:00100000:0.0:1784047280.945370:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1784047280.945378:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709197184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047280.945985:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047280.946197:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709197184:12345-0@lo:38:kworker.0 Request processed in 817us (7288us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047280.946208:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00080000:2.0:1784047280.948227:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047280.948238:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047280.948245:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709196928:0@lo:38:kworker.0 00000100:00080000:2.0:1784047280.948316:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784047280.948318:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197824 00000100:00080000:2.0:1784047280.948322:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047280.948326:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197824 00000100:00100000:2.0:1784047280.948327:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709197184:0@lo:38:kworker.0 00000100:00100000:3.0:1784047280.948822:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1784047280.948830:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709197824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047280.948942:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047280.949021:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709197824:12345-0@lo:38:kworker.0 Request processed in 189us (6672us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047280.949038:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00080000:2.0:1784047280.949063:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047280.949071:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047280.949074:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709197824:0@lo:38:kworker.0 00010000:00010000:0.0:1784047281.427274:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784047281.803668:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689408512 offset 0 length 224: 4 00000100:00100000:0.0:1784047281.803729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047281.803766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047281.803796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047281.803840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047281.803870:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408896 00000100:00100000:0.0:1784047281.803878:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408896 00000100:00100000:2.0:1784047281.804339:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689409024 00000100:00100000:2.0:1784047281.804344:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689409024 00000100:00100000:2.0:1784047281.804382:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2416 00000100:00100000:2.0:1784047281.804392:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689408896:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047281.804467:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689408896:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047281.804475:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2416 00000100:00100000:2.0:1784047281.804492:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2417 00000100:00100000:2.0:1784047281.804499:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689409024:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047281.804536:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689409024:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047281.804543:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2417 00000100:00100000:1.0:1784047281.805120:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408640 00000100:00100000:1.0:1784047281.805128:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408640 00000100:00100000:1.0:1784047281.805174:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689408768 00000100:00100000:1.0:1784047281.805177:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689408768 00000100:00100000:1.0:1784047281.805210:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1104 00000100:00100000:1.0:1784047281.805217:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689408768:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047281.805267:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689408768:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 42us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047281.805274:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1104 00000100:00100000:1.0:1784047281.805289:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1115 00000100:00100000:1.0:1784047281.805293:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689408640:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:1.0:1784047281.805314:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047281.805341:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689408640:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 46us (1613us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047281.805348:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1115 00000100:00080000:3.0:1784047281.805741:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047281.805746:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047281.805749:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047282.450863:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047282.454354:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047282.454391:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709197952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047282.454475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047282.454646:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047282.454656:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709198080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047282.454684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047282.473044:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709197952 00000100:00100000:0.0:1784047282.473061:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709197952 00000100:00100000:0.0:1784047282.473169:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198080 00000100:00100000:0.0:1784047282.473173:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198080 00000100:00100000:0.0:1784047282.473210:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1784047282.473221:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709197952:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047282.473225:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:1.0:1784047282.473233:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709198080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047282.473265:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784047282.473268:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1784047282.473340:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047282.473345:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047282.478169:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709197952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4939us (23683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047282.478184:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1784047282.478337:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709197952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047282.484672:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709198080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11430us (29976us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047282.484687:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1784047282.484793:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709198080:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784047283.476680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047284.500778:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047285.527359:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047286.035167:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047286.035175:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047286.035179:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047286.035188:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3379 00000100:00080000:2.0:1784047286.035195:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047286.035210:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047286.035235:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef50a300 x1870705709198336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047286.035287:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047286.035290:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047286.035292:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047286.035296:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3379 00000100:00080000:2.0:1784047286.035299:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047286.035303:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047286.035315:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd30000 x1870705709198592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047286.035331:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047286.035334:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047286.035336:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047286.035339:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3379 00000100:00080000:2.0:1784047286.035341:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047286.035344:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047286.035382:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd30a80 x1870705709198848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047286.035404:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047286.035407:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047286.035409:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047286.035412:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3379 00000100:00080000:2.0:1784047286.035421:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047286.035431:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047286.035441:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd30e00 x1870705709199232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047286.035478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709198464:0@lo:400:kworker.0 00000100:00100000:0.0:1784047286.035622:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709198976:0@lo:400:kworker.0 00000100:00100000:0.0:1784047286.035697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047286.035736:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784047286.035742:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709198208:0@lo:400:kworker.0 00000400:00000100:0.0:1784047286.035761:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709198208 offset 0 length 224: 4 00000100:00100000:0.0:1784047286.035783:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709199104:0@lo:400:kworker.0 00000100:00100000:0.0:1784047286.035805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047286.035840:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198976 00000100:00100000:0.0:1784047286.035846:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198976 00000100:00100000:0.0:1784047286.035896:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709199104 00000100:00100000:0.0:1784047286.035899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709199104 00000100:00100000:0.0:1784047286.035936:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:0.0:1784047286.035946:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709198976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047286.035993:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709198976:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047286.036001:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:0.0:1784047286.036015:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1784047286.036022:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709199104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047286.036048:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709199104:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047286.036054:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00080000:0.0:1784047286.036072:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047286.036076:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047286.036109:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709199104:0@lo:400:kworker.0 00000100:00100000:0.0:1784047286.036120:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709198976:0@lo:400:kworker.0 00000100:00100000:2.0:1784047286.036322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047286.036351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047286.036356:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709198720:0@lo:400:kworker.0 00000100:00100000:2.0:1784047286.036376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047286.036405:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198464 00000100:00100000:2.0:1784047286.036408:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198464 00000100:00100000:2.0:1784047286.036456:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198720 00000100:00100000:2.0:1784047286.036460:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198720 00000100:00100000:2.0:1784047286.036479:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1784047286.036484:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709198464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047286.036639:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709198464:12345-0@lo:400:kworker.0 Request processed in 155us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047286.036645:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1784047286.036716:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1784047286.036722:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709198720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047286.036747:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709198720:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047286.036753:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1784047286.036785:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709198720:0@lo:400:kworker.0 00000100:00100000:2.0:1784047286.036795:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709198464:0@lo:400:kworker.0 00000100:00100000:1.0:1784047286.036921:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709198336:0@lo:38:kworker.0 00000100:00100000:1.0:1784047286.036951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047286.036978:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709198592:0@lo:38:kworker.0 00000100:00100000:1.0:1784047286.036998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047286.037020:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709198848:0@lo:38:kworker.0 00000100:00100000:1.0:1784047286.037048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047286.037064:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709199232:0@lo:38:kworker.0 00000100:00100000:1.0:1784047286.037084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047286.037194:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198848 00000100:00100000:3.0:1784047286.037203:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198848 00000100:00100000:3.0:1784047286.037238:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:3.0:1784047286.037243:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709198848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047286.037263:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047286.037305:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709198848:12345-0@lo:38:kworker.0 Request processed in 60us (256us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047286.037310:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00080000:3.0:1784047286.037844:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047286.037850:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047286.037854:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709198848:0@lo:38:kworker.0 00000100:00100000:3.0:1784047286.037875:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198336 00000100:00100000:3.0:1784047286.037879:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198336 00000100:00100000:3.0:1784047286.037894:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709198592 00000100:00100000:3.0:1784047286.037905:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709198592 00000100:00100000:3.0:1784047286.037979:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709199232 00000100:00100000:3.0:1784047286.037982:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709199232 00000100:00100000:3.0:1784047286.037993:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1784047286.037997:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709198336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047286.038008:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047286.038043:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709198336:12345-0@lo:38:kworker.0 Request processed in 44us (1090us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047286.038049:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1784047286.038062:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1784047286.038065:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709198592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047286.038079:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047286.038103:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709198592:12345-0@lo:38:kworker.0 Request processed in 36us (1104us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047286.038108:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1784047286.038118:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:3.0:1784047286.038122:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709199232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047286.038130:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047286.038153:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709199232:12345-0@lo:38:kworker.0 Request processed in 29us (1068us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047286.038158:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00080000:3.0:1784047286.038180:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047286.038184:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047286.038187:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709198336:0@lo:38:kworker.0 00000100:00080000:3.0:1784047286.038195:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047286.038204:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047286.038207:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709198592:0@lo:38:kworker.0 00000100:00080000:3.0:1784047286.038218:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047286.038221:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047286.038224:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709199232:0@lo:38:kworker.0 00000100:00080000:0.0:1784047286.038641:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047286.547496:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047286.919942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:1.0:1784047286.919977:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689409152 offset 0 length 224: 4 00000100:00100000:3.0:1784047286.920073:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689409408 00000100:00100000:3.0:1784047286.920083:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689409408 00000100:00100000:3.0:1784047286.920237:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1107 00000100:00100000:3.0:1784047286.920248:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689409408:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047286.920324:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689409408:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 79us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047286.920332:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1107 00000100:00100000:3.0:1784047286.920370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047286.920494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047286.920516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047286.920580:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689409280 00000100:00100000:3.0:1784047286.920584:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689409280 00000100:00100000:3.0:1784047286.920643:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1119 00000100:00100000:3.0:1784047286.920648:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689409280:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047286.920668:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047286.920704:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689409280:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 54us (333us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047286.920711:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1119 00000100:00100000:3.0:1784047286.920728:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689409536 00000100:00100000:3.0:1784047286.920732:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689409536 00000100:00100000:3.0:1784047286.920772:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689409664 00000100:00100000:3.0:1784047286.920775:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689409664 00000100:00100000:3.0:1784047286.920796:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4944 00000100:00100000:3.0:1784047286.920803:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689409536:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:3.0:1784047286.920822:0:8824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773e37 00000100:00080000:3.0:1784047286.920829:0:8824:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047286.920869:0:8824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968749 00000100:00100000:3.0:1784047286.920985:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+2:2398:x1870705689409536:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 182us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047286.920991:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4944 00000100:00100000:3.0:1784047286.921003:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4945 00000100:00100000:3.0:1784047286.921009:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689409664:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:3.0:1784047286.921019:0:8824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773e3e 00000100:00080000:3.0:1784047286.921023:0:8824:0:(import.c:65:import_set_state_nolock()) ffff99ccc6dae000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047286.921048:0:8824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968749 00000100:00100000:3.0:1784047286.921121:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+2:2398:x1870705689409664:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 111us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047286.921128:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4945 00010000:00010000:3.0:1784047286.921157:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047286.921162:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047286.921729:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047286.921734:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047286.921736:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047287.570879:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047287.570901:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709199360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047287.570972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047287.571354:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709199360 00000100:00100000:3.0:1784047287.571361:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709199360 00000100:00100000:3.0:1784047287.571669:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1784047287.571680:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709199360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047287.571723:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047287.571784:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709199360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047287.571792:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1784047287.572156:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047287.572168:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709199488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047287.572203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047287.584695:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709199488 00000100:00100000:2.0:1784047287.584723:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709199488 00000100:00100000:1.0:1784047287.584793:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:3.0:1784047287.585023:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709199360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047287.585186:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709199488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047287.585275:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047287.585348:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709199488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 545us (13144us total) trans 0 rc 0/0 00010000:00010000:3.0:1784047287.585978:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047287.586668:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:1.0:1784047287.586858:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709199488:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784047288.595910:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047289.618953:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047290.647775:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047291.157281:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047291.157289:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047291.157293:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047291.157302:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3384 00000100:00080000:2.0:1784047291.157308:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047291.157316:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047291.157340:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd31f80 x1870705709199744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047291.157379:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047291.157383:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047291.157385:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047291.157388:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3384 00000100:00080000:2.0:1784047291.157391:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047291.157394:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047291.157404:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd32680 x1870705709200000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047291.157429:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047291.157433:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047291.157434:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047291.157438:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3384 00000100:00080000:2.0:1784047291.157440:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047291.157444:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047291.157455:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd31880 x1870705709200256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047291.157500:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047291.157504:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047291.157505:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047291.157509:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3384 00000100:00080000:2.0:1784047291.157512:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047291.157515:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047291.157526:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd30000 x1870705709200640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047291.157557:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709199872:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.157648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784047291.157696:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709199616:0@lo:400:kworker.0 00000400:00000100:2.0:1784047291.157715:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709199616 offset 0 length 224: 4 00000100:00100000:2.0:1784047291.157737:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709200512:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.157759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157784:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709199744:0@lo:38:kworker.0 00000100:00100000:2.0:1784047291.157806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157821:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709200000:0@lo:38:kworker.0 00000100:00100000:2.0:1784047291.157842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157854:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709200256:0@lo:38:kworker.0 00000100:00100000:2.0:1784047291.157875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157889:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709200640:0@lo:38:kworker.0 00000100:00100000:2.0:1784047291.157906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157940:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709200128:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.157963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.157980:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047291.157985:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709200384:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047291.158057:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709199872 00000100:00100000:2.0:1784047291.158065:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709199872 00000100:00100000:2.0:1784047291.158119:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709199744 00000100:00100000:2.0:1784047291.158122:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709199744 00000100:00100000:2.0:1784047291.158131:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200000 00000100:00100000:2.0:1784047291.158133:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200000 00000100:00100000:2.0:1784047291.158140:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200640 00000100:00100000:2.0:1784047291.158142:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200640 00000100:00100000:2.0:1784047291.158148:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200128 00000100:00100000:2.0:1784047291.158150:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200128 00000100:00100000:2.0:1784047291.158166:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1784047291.158174:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709199872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158221:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709199872:12345-0@lo:400:kworker.0 Request processed in 47us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047291.158228:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1784047291.158246:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1784047291.158252:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709200128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158281:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709200128:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047291.158287:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1784047291.158298:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1784047291.158302:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709199744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047291.158321:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047291.158379:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709199744:12345-0@lo:38:kworker.0 Request processed in 74us (570us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047291.158386:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1784047291.158399:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1784047291.158402:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709200000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047291.158412:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047291.158434:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709200000:12345-0@lo:38:kworker.0 Request processed in 30us (591us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047291.158440:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1784047291.158451:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1784047291.158455:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709200640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047291.158464:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047291.158485:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709200640:12345-0@lo:38:kworker.0 Request processed in 29us (578us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047291.158491:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1784047291.158510:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200512 00000100:00100000:2.0:1784047291.158513:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200512 00000100:00100000:2.0:1784047291.158543:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200384 00000100:00100000:2.0:1784047291.158546:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200384 00000100:00100000:2.0:1784047291.158565:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1784047291.158571:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709200512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158603:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709200512:12345-0@lo:400:kworker.0 Request processed in 31us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047291.158631:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1784047291.158642:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1784047291.158648:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709200384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158683:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709200384:12345-0@lo:400:kworker.0 Request processed in 34us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047291.158690:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1784047291.158708:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200256 00000100:00100000:2.0:1784047291.158712:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200256 00000100:00100000:2.0:1784047291.158732:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1784047291.158736:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709200256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047291.158746:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047291.158769:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709200256:12345-0@lo:38:kworker.0 Request processed in 32us (893us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047291.158775:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00080000:2.0:1784047291.158796:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047291.158800:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047291.158802:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047291.158839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709200384:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158849:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709200128:0@lo:400:kworker.0 00000100:00080000:2.0:1784047291.158881:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047291.158886:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047291.158889:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709199744:0@lo:38:kworker.0 00000100:00080000:2.0:1784047291.158897:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047291.158900:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047291.158903:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709200000:0@lo:38:kworker.0 00000100:00080000:2.0:1784047291.158910:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047291.158913:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047291.158922:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709200256:0@lo:38:kworker.0 00000100:00080000:2.0:1784047291.158932:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047291.158935:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047291.158938:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709200640:0@lo:38:kworker.0 00000100:00100000:2.0:1784047291.158966:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709200512:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.158975:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709199872:0@lo:400:kworker.0 00000100:00000400:2.0:1784047291.651024:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047275/real 1784047275] req@ffff99ccef50aa00 x1870705709194880/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047291.651068:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99ccef50aa00 x1870705709194880/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047291.651077:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784047291.651081:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1784047291.651084:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784047291.651086:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784047291.651090:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccef50aa00 x1870705709194880/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047291.651099:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccef508e00 x1870705709196800/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047296 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047291.651108:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccef508700 x1870705709198208/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047291.651132:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccfdd33100 x1870705709199616/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784047291.651146:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784047291.651149:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784047291.651163:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784047291.651165:0:3648:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1784047291.651193:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709196800:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.651198:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709194880:0@lo:400:kworker.0 00000100:00100000:2.0:1784047291.651236:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709199616:0@lo:400:kworker.0 00000100:00100000:0.0:1784047291.651370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709198208:0@lo:400:kworker.0 00000100:00080000:3.0:1784047291.651452:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047291.651458:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784047291.651461:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047291.651466:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3337 00000100:00080000:3.0:1784047291.651474:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047291.651505:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfde0ce00 x1870705709200768/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047291.651782:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709200768:0@lo:250:kworker.0 00000400:00000100:2.0:1784047291.651829:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709200768 offset 0 length 520: 4 00010000:00010000:3.0:1784047291.666790:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047292.045005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:2.0:1784047292.045042:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689409792 offset 0 length 224: 4 00000100:00100000:0.0:1784047292.045289:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410048 00000100:00100000:0.0:1784047292.045300:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410048 00000100:00100000:0.0:1784047292.045391:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1110 00000100:00100000:0.0:1784047292.045404:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689410048:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047292.045482:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689410048:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 81us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047292.045490:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1110 00000100:00080000:2.0:1784047292.045712:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047292.046448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047292.046513:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689409920 00000100:00100000:3.0:1784047292.046521:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689409920 00000100:00100000:3.0:1784047292.046572:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1123 00000100:00100000:3.0:1784047292.046578:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689409920:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047292.046599:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047292.046911:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689409920:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 330us (463us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047292.046921:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1123 00000100:00100000:2.0:1784047292.692404:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709200896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047292.692489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047292.692873:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047292.692884:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709201024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047292.692913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047292.692939:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047292.692953:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709200896 00000100:00100000:0.0:1784047292.692960:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709200896 00000100:00100000:0.0:1784047292.693004:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201024 00000100:00100000:0.0:1784047292.693008:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201024 00000100:00100000:0.0:1784047292.693038:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1784047292.693048:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709200896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047292.693076:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047292.693118:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1784047292.693127:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709201024:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047292.693134:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709200896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047292.693141:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00002000:00000024:2.0:1784047292.693143:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047292.693175:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709201024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047292.693181:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:0.0:1784047292.693198:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709200896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047292.693229:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709201024:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1784047292.695273:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047292.695284:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccc6dac000/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:0.0:1784047292.695473:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dac000/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0001 00000020:00000080:0.0:1784047292.695517:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6dae000 for lustre-OST0001 00000001:00100000:2.0:1784047292.696055:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047292.696060:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccc6da8800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:0.0:1784047292.696111:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6da8800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0000 00000020:00000080:0.0:1784047292.696134:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6da8000 for lustre-OST0000 00000400:00000100:0.0:1784047292.811557:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689410176 offset 0 length 520: 4 00010000:00010000:0.0:1784047293.714715:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047294.738777:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784047295.390138:0:87085:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784047295.390145:0:87085:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784047295.390152:0:87085:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784047295.390277:0:87085:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cbcae51000 00000020:01000004:2.0:1784047295.390294:0:87085:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784047295.390308:0:87085:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784047295.390324:0:87085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cce49799c0) 00000020:00000080:2.0:1784047295.390342:0:87085:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784047295.516640:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784047295.517367:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784047295.520003:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.521223:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784047295.522056:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.522314:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.522588:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.522826:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784047295.523080:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784047295.523338:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.523593:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.523969:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784047295.524279:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784047295.524554:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784047295.525014:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784047295.525656:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.525969:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.526166:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.526398:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.526699:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.526991:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.527228:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.527680:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.527966:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.528283:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.528647:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.528858:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.529204:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.529414:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.529806:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.530045:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.530325:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.530638:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.530988:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.531240:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.531445:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.531749:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.531990:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.532232:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.532419:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.532753:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.532998:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.533277:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.533548:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.533860:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.534081:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1784047295.534381:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1784047295.539137:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1784047295.539659:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1784047295.539842:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784047295.540450:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784047295.540853:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784047295.541289:0:87085:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1784047295.542062:0:87085:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784047295.542288:0:87085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784047295.542302:0:87085:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784047295.542315:0:87085:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773f87 00000020:01000004:1.0:1784047295.542322:0:87085:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784047295.542332:0:87085:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784047295.542337:0:87085:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbcae51000 from MGS 00000020:01000004:1.0:1784047295.542341:0:87085:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784047295.542350:0:87085:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cd00104d40) 00000020:00000080:1.0:1784047295.542361:0:87085:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1784047295.542420:0:87085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbcae51000 from MGS, refs=2 00080000:01000000:1.0:1784047295.542424:0:87085:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784047295.542429:0:87085:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773f95 00010000:00010000:1.0:1784047295.542537:0:87085:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784047295.547157:0:87085:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784047295.548154:0:87089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784047295.550874:0:87085:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784047295.550927:0:87085:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784047295.551846:0:87085:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784047295.552084:0:87085:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784047295.552346:0:87085:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784047295.552353:0:87085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784047295.553169:0:87085:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784047295.553176:0:87085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784047295.556972:0:87085:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784047295.556984:0:87085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784047295.557837:0:87085:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784047295.557862:0:87085:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784047295.557864:0:87085:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784047295.557957:0:87085:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1784047295.557963:0:87085:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 61, was 0): CONNECTING 00000100:00100000:1.0:1784047295.557968:0:87085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:3.0:1784047295.763112:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047296.786915:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047296.786966:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047296.786972:0:81515:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784047296.786975:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047296.786979:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047296.786983:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047296.786992:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3389 00000100:00080000:2.0:1784047296.786996:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047296.787003:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047296.787057:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482d500 x1870705709201152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047296.787123:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047296.787127:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047296.787129:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047296.787133:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3389 00000100:00080000:2.0:1784047296.787135:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047296.787139:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047296.787151:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482c380 x1870705709201408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047296.787178:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047296.787182:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047296.787183:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047296.787186:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3389 00000100:00080000:2.0:1784047296.787188:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047296.787192:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047296.787202:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482f800 x1870705709201664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047296.787221:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047296.787225:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047296.787226:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047296.787229:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3389 00000100:00080000:2.0:1784047296.787232:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047296.787235:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047296.787263:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482d180 x1870705709202048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047296.787292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709201536:0@lo:400:kworker.0 00000100:00100000:2.0:1784047296.787366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047296.787405:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047296.787413:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709201792:0@lo:400:kworker.0 00000100:00100000:2.0:1784047296.787441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047296.787487:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201536 00000100:00100000:2.0:1784047296.787494:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201536 00000100:00100000:2.0:1784047296.787548:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1784047296.787557:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709201536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047296.787641:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709201536:12345-0@lo:400:kworker.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047296.787648:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00080000:2.0:1784047296.787672:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047296.787710:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709201536:0@lo:400:kworker.0 00000100:00100000:3.0:1784047296.788021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709201920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047296.788052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047296.788083:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047296.788089:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709201280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047296.788110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047296.788135:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201280 00000100:00100000:3.0:1784047296.788139:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201280 00000100:00100000:3.0:1784047296.788169:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1784047296.788175:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709201280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047296.788209:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709201280:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047296.788215:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00080000:3.0:1784047296.788230:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047296.788256:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709201280:0@lo:400:kworker.0 00000100:00100000:1.0:1784047296.788553:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201792 00000100:00100000:1.0:1784047296.788558:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201792 00000100:00100000:1.0:1784047296.788633:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201920 00000100:00100000:1.0:1784047296.788637:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201920 00000100:00100000:1.0:1784047296.788662:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1784047296.788670:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709201792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047296.788712:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709201792:12345-0@lo:400:kworker.0 Request processed in 44us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047296.788731:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1784047296.788742:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1784047296.788748:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709201920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047296.788780:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709201920:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047296.788786:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1784047296.788819:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709201792:0@lo:400:kworker.0 00000100:00080000:3.0:1784047296.789268:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047296.789272:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047296.789294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709201920:0@lo:400:kworker.0 00000100:00100000:0.0:1784047296.790634:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709201152:0@lo:38:kworker.0 00000100:00100000:0.0:1784047296.790707:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047296.790748:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709201408:0@lo:38:kworker.0 00000100:00100000:0.0:1784047296.790771:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047296.790816:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709201664:0@lo:38:kworker.0 00000100:00100000:0.0:1784047296.790843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047296.790878:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709202048:0@lo:38:kworker.0 00000100:00100000:0.0:1784047296.790905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047296.790954:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201664 00000100:00100000:0.0:1784047296.790963:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201664 00000100:00100000:0.0:1784047296.791001:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1784047296.791008:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709201664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047296.791029:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047296.791071:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709201664:12345-0@lo:38:kworker.0 Request processed in 62us (226us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047296.791079:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1784047296.791105:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201152 00000100:00100000:0.0:1784047296.791108:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201152 00000100:00100000:0.0:1784047296.791124:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709201408 00000100:00100000:0.0:1784047296.791126:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709201408 00000100:00100000:0.0:1784047296.791140:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202048 00000100:00100000:0.0:1784047296.791142:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202048 00000100:00100000:0.0:1784047296.791152:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1784047296.791156:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709201152:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047296.791166:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047296.791194:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709201152:12345-0@lo:38:kworker.0 Request processed in 35us (485us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047296.791200:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1784047296.791213:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1784047296.791217:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709201408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047296.791226:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047296.791271:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709201408:12345-0@lo:38:kworker.0 Request processed in 51us (498us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047296.791277:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1784047296.791290:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1784047296.791294:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709202048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047296.791305:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047296.791328:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709202048:12345-0@lo:38:kworker.0 Request processed in 32us (421us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047296.791334:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:0.0:1784047296.791366:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047296.791372:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047296.791376:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709201152:0@lo:38:kworker.0 00000100:00080000:0.0:1784047296.791384:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047296.791388:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047296.791390:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709201408:0@lo:38:kworker.0 00000100:00080000:0.0:1784047296.791397:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047296.791400:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047296.791402:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709201664:0@lo:38:kworker.0 00000100:00080000:0.0:1784047296.791410:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047296.791413:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047296.791415:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709202048:0@lo:38:kworker.0 00010000:00010000:0.0:1784047297.811932:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047297.812069:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047297.812084:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709202176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047297.812171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047297.812583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047297.812594:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709202304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047297.812665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047297.812905:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202176 00000100:00100000:0.0:1784047297.812913:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202176 00000100:00100000:0.0:1784047297.812967:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202304 00000100:00100000:0.0:1784047297.812971:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202304 00000100:00100000:0.0:1784047297.812991:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:0.0:1784047297.813000:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709202176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047297.813029:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047297.813072:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709202176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047297.813079:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:0.0:1784047297.813095:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1784047297.813101:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709202304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047297.813115:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047297.813145:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709202304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047297.813152:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1784047297.813203:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709202304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047297.813298:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709202176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047298.181336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047298.181405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047298.181875:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410432 00000100:00100000:0.0:1784047298.181888:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410432 00000100:00100000:0.0:1784047298.182038:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410304 00000100:00100000:0.0:1784047298.182042:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410304 00000100:00100000:0.0:1784047298.182069:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1113 00000100:00100000:0.0:1784047298.182081:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689410432:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047298.182184:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689410432:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 105us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047298.182192:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1113 00000100:00100000:0.0:1784047298.182223:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1127 00000100:00100000:0.0:1784047298.182229:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689410304:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:0.0:1784047298.182281:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047298.182309:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689410304:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 80us (905us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047298.182317:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1127 00000100:00080000:3.0:1784047298.183746:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047298.834851:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047299.859535:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047300.882820:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047301.906917:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047301.907186:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047301.907192:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784047301.907196:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047301.907200:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047301.907205:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784047301.907209:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047291/real 1784047291] req@ffff99ccfde0ce00 x1870705709200768/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047301.907213:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3395 00000100:00080000:0.0:1784047301.907220:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047301.907230:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047301.907247:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ccfde0ce00 x1870705709200768/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047301.907274:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e9f80 x1870705709202432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047301.907289:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047301.907315:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00080000:0.0:1784047301.907316:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047301.907322:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047301.907324:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784047301.907326:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709200768:0@lo:250:kworker.0 00000100:00080000:0.0:1784047301.907330:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3395 00000100:00080000:0.0:1784047301.907335:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047301.907340:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047301.907354:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e8380 x1870705709202688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047301.907359:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709202432:0@lo:38:kworker.0 00000100:00080000:0.0:1784047301.907398:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047301.907409:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047301.907411:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047301.907416:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3395 00000100:00080000:0.0:1784047301.907419:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047301.907423:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047301.907429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.907439:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce3d22a00 x1870705709202944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047301.907465:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709202688:0@lo:38:kworker.0 00000100:00080000:0.0:1784047301.907466:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047301.907473:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047301.907475:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047301.907479:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3395 00000100:00080000:0.0:1784047301.907481:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047301.907485:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047301.907495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.907499:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce3d23b80 x1870705709203328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047301.907515:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784047301.907520:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709202944:0@lo:38:kworker.0 00000100:00080000:0.0:1784047301.907520:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784047301.907523:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047301.907530:0:52247:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3389 00000100:00080000:0.0:1784047301.907533:0:52247:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047301.907538:0:52247:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047301.907549:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce3d21f80 x1870705709203456/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047301.907555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047301.907579:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709203328:0@lo:38:kworker.0 00000100:00100000:0.0:1784047301.907623:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709202560:0@lo:400:kworker.0 00000100:00100000:2.0:1784047301.907627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00020000:2.0:1784047301.907650:0:3644:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff99cce3d21f80 x1870705709203456/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047301.907660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.907688:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047301.907695:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709203200:0@lo:400:kworker.0 00000100:00100000:0.0:1784047301.907718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.907744:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709203072:0@lo:400:kworker.0 00000100:00100000:0.0:1784047301.907765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.907784:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047301.907789:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709202816:0@lo:400:kworker.0 00000100:00100000:0.0:1784047301.907809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.907838:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202432 00000100:00100000:0.0:1784047301.907846:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202432 00000100:00100000:1.0:1784047301.907867:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202688 00000100:00100000:0.0:1784047301.907874:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203328 00000100:00100000:1.0:1784047301.907876:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202688 00000100:00100000:0.0:1784047301.907879:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203328 00000100:00100000:0.0:1784047301.907899:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202560 00000100:00100000:0.0:1784047301.907902:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202560 00000100:00100000:1.0:1784047301.907903:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202816 00000100:00100000:1.0:1784047301.907908:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202816 00000100:00100000:1.0:1784047301.907948:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1784047301.907964:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047301.908024:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709202816:12345-0@lo:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047301.908191:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709202944 00000100:00100000:3.0:1784047301.908196:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709202944 00000100:00100000:3.0:1784047301.908221:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:3.0:1784047301.908227:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709202944:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047301.908245:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047301.908281:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709202944:12345-0@lo:38:kworker.0 Request processed in 53us (729us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047301.908288:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00080000:3.0:1784047301.908328:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047301.908340:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203200 00000100:00100000:3.0:1784047301.908344:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203200 00000100:00100000:0.0:1784047301.908356:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1784047301.908369:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709202560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047301.908377:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203072 00000100:00100000:3.0:1784047301.908382:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203072 00000100:00100000:3.0:1784047301.908406:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1784047301.908415:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709203200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047301.908427:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709202560:12345-0@lo:400:kworker.0 Request processed in 61us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047301.908435:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1784047301.908455:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709203200:12345-0@lo:400:kworker.0 Request processed in 42us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047301.908461:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1784047301.908473:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:3.0:1784047301.908479:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709203072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047301.908507:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709203072:12345-0@lo:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047301.908513:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00100000:3.0:1784047301.908539:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784047301.908544:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709202432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047301.908555:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047301.908592:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709202432:12345-0@lo:38:kworker.0 Request processed in 46us (1163us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047301.908599:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784047301.908646:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1784047301.908651:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709202688:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047301.908661:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047301.908687:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709202688:12345-0@lo:38:kworker.0 Request processed in 36us (1194us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047301.908694:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1784047301.908706:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1784047301.908711:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709203328:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784047301.909958:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709203200:0@lo:400:kworker.0 00000100:00100000:0.0:1784047301.909974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709202560:0@lo:400:kworker.0 10000000:01000000:0.0:1784047301.910037:0:87085:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1784047301.910053:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910079:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910085:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784047301.910101:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910109:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c773bc8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773bcf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910126:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910133:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910138:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910154:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910159:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0800/0x4426598c0c773b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910169:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910175:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910181:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910184:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910188:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24ae00/0x4426598c0c773b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b51 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910206:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910213:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910218:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910221:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910225:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47800/0x4426598c0c773b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910232:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910239:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910245:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910247:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910251:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1800/0x4426598c0c773b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910258:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910265:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910270:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910277:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910281:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c773b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773ba5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910291:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910298:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910303:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910307:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910310:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24a600/0x4426598c0c773bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773bb3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910319:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910326:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910332:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910337:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910340:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47000/0x4426598c0c773bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773bdd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910353:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:3.0:1784047301.910355:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:00010000:0.0:1784047301.910364:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910379:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910383:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910388:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24b400/0x4426598c0c773b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910400:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910407:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910413:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047301.910417:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910421:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c773b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047301.910426:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709203328:12345-0@lo:38:kworker.0 Request processed in 1710us (2820us total) trans 0 rc -19/-19 00010000:00010000:0.0:1784047301.910434:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047301.910441:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 10000000:00010000:0.0:1784047301.910446:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910453:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047301.910456:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910459:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c773b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910468:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910483:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910488:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00080000:3.0:1784047301.910494:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047301.910498:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:3.0:1784047301.910500:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784047301.910503:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1000/0x4426598c0c773b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773b97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.910515:0:87085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047301.910521:0:87085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047301.910525:0:87085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047301.910531:0:87085:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047301.910535:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c773bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c773bc1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047301.910970:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709202816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047301.910993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709203072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047301.916692:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00080000:0.0:1784047301.949730:0:87085:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 62, was 0): CONNECTING 00000100:00080000:0.0:1784047301.949745:0:87085:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1784047301.951585:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047301.951640:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1784047301.951654:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:0:1870705709203456:0@lo:250:kworker.0 00000100:00080000:2.0:1784047301.951702:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047301.951707:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047301.951711:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709202688:0@lo:38:kworker.0 00000100:00080000:2.0:1784047301.951723:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047301.951726:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047301.951729:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709202944:0@lo:38:kworker.0 00000100:00080000:2.0:1784047301.951755:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047301.951775:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047301.951778:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709202432:0@lo:38:kworker.0 00000100:00080000:2.0:1784047301.952113:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047301.952118:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047301.952121:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709203328:0@lo:38:kworker.0 00000100:00080000:3.0:1784047301.952596:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047301.952602:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784047301.952640:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047301.952647:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1784047301.952651:0:81515:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784047301.952658:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047301.952702:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfde0ce00 x1870705709203584/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047301.953061:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709203584:0@lo:250:kworker.0 00000100:00100000:2.0:1784047301.953128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047301.956151:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203584 00000100:00100000:3.0:1784047301.956169:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203584 00000100:00100000:3.0:1784047301.956223:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784047301.956233:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870705709203584:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1784047301.956264:0:87091:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6e36843b-2016-43fe-8842-da5818d68597@0@lo t0 exp 0000000000000000 cur 3400 last 0 00000020:00000080:3.0:1784047301.956293:0:87091:0:(genops.c:1406:class_connect()) connect: client 6e36843b-2016-43fe-8842-da5818d68597, cookie 0x4426598c0c773f9c 00000100:00080000:3.0:1784047301.956460:0:87091:0:(import.c:65:import_set_state_nolock()) ffff99ccc5c06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047301.956562:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+5:3644:x1870705709203584:12345-0@lo:250:kworker.0 Request processed in 328us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047301.956569:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784047301.957300:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 25 00000100:00080000:0.0:1784047301.957311:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:0.0:1784047301.957320:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784047301.957326:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784047301.957329:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784047301.957332:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784047301.957371:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784047301.957382:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709203584:0@lo:250:kworker.0 00000020:01000000:1.0:1784047301.957434:0:81515:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.140@tcp 00000100:00080000:0.0:1784047301.957448:0:87085:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 10000000:01000000:1.0:1784047301.957455:0:81515:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784047301.957458:0:87085:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784047301.957459:0:81515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047301.957464:0:81515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784047301.957466:0:81515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047301.957467:0:81515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047301.957468:0:81515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047301.957475:0:81515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047301.957476:0:81515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047301.957478:0:81515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047301.957479:0:81515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:0.0:1784047301.957499:0:87085:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784047301.957505:0:87085:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:1.0:1784047301.957520:0:81515:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784047301.957528:0:81515:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784047301.957530:0:81515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047301.957531:0:81515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784047301.957532:0:81515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047301.957533:0:81515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047301.957535:0:81515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047301.957536:0:81515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047301.957537:0:81515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047301.957538:0:81515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047301.957539:0:81515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047301.957561:0:81515:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784047301.957566:0:81515:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784047301.957567:0:81515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047301.957569:0:81515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784047301.957570:0:81515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047301.957571:0:81515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047301.957572:0:81515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047301.957574:0:81515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047301.957575:0:81515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047301.957576:0:81515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047301.957577:0:81515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047301.957588:0:81515:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000040:01000000:0.0:1784047301.957644:0:87085:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000100:00100000:1.0:1784047301.957646:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709203712:0@lo:253:kworker.0 00000020:01000004:0.0:1784047301.957671:0:87085:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784047301.957675:0:87085:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784047301.957677:0:87085:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047301.957678:0:87085:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047301.957679:0:87085:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047301.957680:0:87085:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047301.957681:0:87085:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047301.957682:0:87085:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047301.957684:0:87085:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047301.957685:0:87085:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047301.957686:0:87085:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784047301.957688:0:87085:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784047301.957690:0:87085:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784047301.957692:0:87085:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047301.957693:0:87085:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047301.957694:0:87085:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047301.957696:0:87085:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047301.957697:0:87085:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047301.957698:0:87085:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047301.957699:0:87085:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047301.957700:0:87085:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047301.957701:0:87085:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784047301.957713:0:87085:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784047301.957722:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784047301.957769:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.957798:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc834ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047301.957824:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709203840:0@lo:253:kworker.0 00000100:00100000:1.0:1784047301.957828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.957865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.957879:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047301.957889:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709203968:0@lo:253:kworker.0 00000100:00100000:0.0:1784047301.957914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047301.957949:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204096 00000100:00100000:0.0:1784047301.957953:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204096 00000100:00100000:0.0:1784047301.957976:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203712 00000100:00100000:0.0:1784047301.957979:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203712 00000100:00100000:0.0:1784047301.957986:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203840 00000100:00100000:0.0:1784047301.957988:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203840 00000100:00100000:0.0:1784047301.957994:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709203968 00000100:00100000:0.0:1784047301.957996:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709203968 00000100:00100000:0.0:1784047301.958021:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784047301.958028:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:87085:x1870705709204096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784047301.958064:0:87091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784047301.958067:0:87091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784047301.958069:0:87091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1784047301.958383:0:87095:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784047301.958449:0:87091:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 109 00000100:00100000:3.0:1784047301.958717:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784047301.958729:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:3646:x1870705709203712:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784047301.958751:0:87093:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784047301.966032:0:87096:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784047301.966041:0:87096:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784047301.966045:0:87096:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784047301.966047:0:87096:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784047301.966318:0:87096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784047301.966692:0:87091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784047301.966712:0:87091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784047301.966799:0:87093:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784047301.967171:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:87085:x1870705709204096:12345-0@lo:253:mount.lustre.0 Request processed in 9138us (9397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047301.967183:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784047301.967226:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784047301.967238:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3647:x1870705709203840:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784047301.967268:0:87091:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1784047301.967409:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204096:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784047301.967423:0:87085:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784047301.967426:0:87085:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784047301.967428:0:87085:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784047301.967429:0:87085:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047301.967430:0:87085:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047301.967431:0:87085:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047301.967433:0:87085:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047301.967444:0:87085:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047301.967445:0:87085:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784047301.967447:0:87085:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047301.967448:0:87085:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784047301.967470:0:87085:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbcae51000 from lustre-MDT0000 10000000:01000000:1.0:1784047301.967497:0:87085:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784047301.967500:0:87085:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784047301.967509:0:87085:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cbcae51000 10000000:01000000:1.0:1784047301.967513:0:87085:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784047301.967517:0:87085:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cbcae51000 10000000:01000000:1.0:1784047301.967520:0:87085:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784047301.967524:0:87085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99cbcae51000 from 1 10000000:01000000:1.0:1784047301.967527:0:87085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784047301.967563:0:87085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.967574:0:87085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.967584:0:87085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047301.967604:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784047301.967663:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047301.967704:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784047301.967784:0:87092:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1784047301.967792:0:87092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1784047301.971364:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204224 00000100:00100000:2.0:1784047301.971378:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204224 00000100:00100000:1.0:1784047301.972013:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784047301.972025:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709203968:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784047301.972058:0:87097:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784047301.974923:0:87093:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047301.974947:0:87093:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784047301.974980:0:87091:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784047301.975354:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:3646:x1870705709203712:12345-0@lo:253:kworker.0 Request processed in 16616us (17516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047301.975367:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1784047301.975405:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784047301.975409:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047301.975410:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047301.975412:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047301.975413:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047301.975415:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047301.975417:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047301.975419:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047301.975421:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784047301.975426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709203712:0@lo:253:kworker.0 00000100:00100000:0.0:1784047301.975430:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784047301.975445:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+7:87085:x1870705709204224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047301.975459:0:87093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047301.975480:0:87093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5600/0x4426598c0c773faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773fa3 expref: -99 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.975506:0:87093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5600/0x4426598c0c773faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773fa3 expref: 8 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.975518:0:87093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5600/0x4426598c0c773faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773fa3 expref: 8 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.975527:0:87093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5600, rc 0) 00000100:00100000:0.0:1784047301.975568:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:87085:x1870705709204224:12345-0@lo:101:mount.lustre.0 Request processed in 128us (7904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047301.975574:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784047301.975755:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047301.975773:0:87085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.975792:0:87085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047301.975810:0:87085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784047301.975831:0:87085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.975839:0:87085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047301.975851:0:87085:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784047301.975856:0:87085:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784047301.975863:0:87085:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cbcae51000 10000000:01000000:1.0:1784047301.975866:0:87085:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784047301.975869:0:87085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784047301.975872:0:87085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784047301.975897:0:87085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.975905:0:87085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.975913:0:87085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047301.975933:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784047301.975971:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:3.0:1784047301.976017:0:87095:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784047301.976022:0:87095:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784047301.976037:0:87095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976045:0:87095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784047301.976053:0:87095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000031373s 00010000:00010000:3.0:1784047301.976063:0:87095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976069:0:87095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976076:0:87095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976084:0:87095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976090:0:87095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047301.976096:0:87095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976104:0:87095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976116:0:87095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976124:0:87095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.976131:0:87095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418000/0x4426598c0c773fb8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047301.976198:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204352 00000100:00100000:0.0:1784047301.976205:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204352 00000100:00100000:0.0:1784047301.976256:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784047301.976264:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:87085:x1870705709204352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047301.976271:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047301.976281:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4a00/0x4426598c0c773fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c773fb1 expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.976295:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4a00/0x4426598c0c773fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c773fb1 expref: 9 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.976304:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4a00/0x4426598c0c773fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c773fb1 expref: 9 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.976322:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4a00, rc 0) 00000100:00100000:0.0:1784047301.976365:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:87085:x1870705709204352:12345-0@lo:101:mount.lustre.0 Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047301.976372:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784047301.977182:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d600 going to sleep for 11 seconds 00000100:00100000:1.0:1784047301.977856:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047301.977880:0:87085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047301.977890:0:87085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047301.977967:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047301.978026:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047301.978325:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784047301.978394:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204480 00000100:00100000:0.0:1784047301.978400:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204480 00000100:00100000:0.0:1784047301.978444:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784047301.978454:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcafa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:87085:x1870705709204480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047301.979308:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcafa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709204480:12345-0@lo:501:mount.lustre.0 Request processed in 852us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047301.979318:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784047301.979456:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047301.979504:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047301.979553:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047301.979588:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9dd7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047301.979775:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204608 00000100:00100000:1.0:1784047301.979780:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204608 00000100:00100000:1.0:1784047301.979817:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784047301.979826:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcafa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709204608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047301.982696:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcafa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709204608:12345-0@lo:503:mount.lustre.0 Request processed in 2861us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047301.982711:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784047301.982846:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709204608:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1784047301.985688:0:87091:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047301.985705:0:87091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784047301.985966:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:3647:x1870705709203840:12345-0@lo:253:kworker.0 Request processed in 18726us (28094us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047301.985979:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:1.0:1784047301.986168:0:87097:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784047301.986319:0:87095:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784047301.986325:0:87095:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784047301.986403:0:87095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986438:0:87095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784047301.986447:0:87095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000123631s 00010000:00010000:3.0:1784047301.986453:0:87095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986459:0:87095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986466:0:87095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986473:0:87095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986479:0:87095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047301.986483:0:87095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986490:0:87095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986503:0:87095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986509:0:87095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047301.986515:0:87095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418000/0x4426598c0c773fc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784047301.986641:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784047301.986644:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784047301.986645:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047301.986647:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047301.986648:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047301.986649:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047301.986651:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784047301.986652:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047301.986654:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047301.986657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709203840:0@lo:253:kworker.0 00000100:00100000:2.0:1784047301.986812:0:87098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87098:1870705709204736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047301.986869:0:87098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047301.986897:0:87098:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8cef780 going to sleep for 11 seconds 00000100:00100000:1.0:1784047301.987048:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204736 00000100:00100000:1.0:1784047301.987055:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204736 00000100:00100000:1.0:1784047301.987172:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784047301.987182:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcafa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:87098:x1870705709204736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047301.988696:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcafa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:87098:x1870705709204736:12345-0@lo:502:llog_process_th.0 Request processed in 1508us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047301.988717:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784047301.988852:0:87098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87098:1870705709204736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047301.988884:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047301.988894:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047301.988897:0:87098:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784047301.988903:0:87098:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784047301.988906:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047301.988921:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cce497b380) 00000020:00000080:2.0:1784047301.988945:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1784047301.988950:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784047301.989055:0:87098:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784047301.989124:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773fd4 00000020:00000080:2.0:1784047301.989695:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784047301.989702:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047301.989708:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047301.989710:0:87098:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784047301.989714:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047301.989718:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047301.989719:0:87098:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784047301.989722:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047301.989732:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cce4978000) 00000020:00000080:2.0:1784047301.989745:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1784047301.989749:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784047301.989751:0:87098:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784047301.989753:0:87098:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784047301.989759:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784047301.989808:0:87098:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbcae51000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784047301.989819:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cce497cd40) 00000020:00000080:2.0:1784047301.989828:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1784047301.989876:0:87098:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784047301.989887:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c773fe9 00000020:00000080:2.0:1784047301.989982:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784047301.989989:0:87098:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784047301.989992:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4426598c0c773ff0 00080000:01000000:2.0:1784047301.989997:0:87098:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784047301.990011:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c773ff7 20000000:01000000:1.0:1784047301.995156:0:87097:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784047301.995183:0:87097:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784047301.995366:0:87095:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784047301.995372:0:87095:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784047301.995398:0:87095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995418:0:87095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047301.995454:0:87095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000123631s 00010000:00010000:0.0:1784047301.995460:0:87095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995467:0:87095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995475:0:87095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995482:0:87095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995488:0:87095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047301.995493:0:87095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995500:0:87095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995511:0:87095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995519:0:87095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047301.995526:0:87095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5400/0x4426598c0c773ffe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047301.996554:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709203968:12345-0@lo:253:kworker.0 Request processed in 24522us (38629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047301.996567:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1784047301.996763:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784047301.996774:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784047301.996776:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047301.996777:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047301.996779:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047301.996780:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047301.996782:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047301.996784:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047301.996785:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047301.996790:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709203968:0@lo:253:kworker.0 00010000:00010000:2.0:1784047302.138685:0:87098:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784047302.138842:0:87098:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a2569b5-a558-4441-a96a-1d77608df16b idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:2.0:1784047302.138889:0:87098:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:2.0:1784047302.140208:0:87098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:2.0:1784047302.140441:0:87098:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784047302.140504:0:87098:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cbc7b8db40: xid 1870705689403904, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:2.0:1784047302.140515:0:87098:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cbc7b8d480: xid 1870705689403648, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:2.0:1784047302.141485:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ccc4ac4d40) 00000020:00000080:2.0:1784047302.141512:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784047302.141598:0:87098:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784047302.141640:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c77401a 00000020:00000080:1.0:1784047302.143924:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784047302.150841:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4426598c0c774021 00000020:00000080:2.0:1784047302.161403:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784047302.161420:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047302.161429:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.161431:0:87098:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784047302.161435:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784047302.161438:0:87098:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1784047302.161439:0:87098:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047302.161441:0:87098:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047302.161442:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784047302.161444:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.161445:0:87098:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784047302.161447:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047302.161452:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.161453:0:87098:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784047302.161469:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784047302.161527:0:87098:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784047302.161548:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047302.161551:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.161552:0:87098:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784047302.161555:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047302.161558:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.161560:0:87098:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784047302.161562:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784047302.161568:0:87098:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:2.0:1784047302.161594:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047302.161636:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99ccc4ac19c0) 00000020:00000080:2.0:1784047302.161659:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1784047302.161666:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784047302.161725:0:87098:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784047302.161731:0:87098:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784047302.161737:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c77402f 00010000:00080000:2.0:1784047302.161771:0:87098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbcaee2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047302.168277:0:87098:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1784047302.171413:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047302.171429:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784047302.171473:0:87098:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784047302.171499:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774036 00000100:00080000:1.0:1784047302.171510:0:87098:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784047302.171516:0:87098:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cbcaee2000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047302.171553:0:87098:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00415500 x1870705709204864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047302.171584:0:87098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1784047302.171668:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047302.171671:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.171673:0:87098:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784047302.171676:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784047302.171679:0:87098:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1784047302.171681:0:87098:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047302.171682:0:87098:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047302.171684:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784047302.171686:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.171687:0:87098:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784047302.171689:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784047302.171694:0:87098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784047302.171697:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.171709:0:87098:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784047302.171713:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784047302.171717:0:87098:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:1.0:1784047302.171741:0:87098:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784047302.171744:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047302.171758:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cd00100000) 00000020:00000080:1.0:1784047302.171773:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1784047302.171778:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784047302.171841:0:87098:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784047302.171848:0:87098:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784047302.171853:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774044 00010000:00080000:1.0:1784047302.171884:0:87098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccd001a800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00000100:00100000:2.0:1784047302.172388:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709204864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784047302.172463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047302.172546:0:87098:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1784047302.174694:0:87098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784047302.174726:0:87098:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784047302.174812:0:87098:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1784047302.176559:0:87098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047302.176590:0:87098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:1.0:1784047302.180691:0:87098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000100:00100000:3.0:1784047302.182484:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204864 00000100:00100000:3.0:1784047302.182499:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204864 00000100:00100000:3.0:1784047302.182548:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1784047302.182559:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709204864:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784047302.182592:0:8442:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3400 last 0 00000020:00000080:3.0:1784047302.182653:0:8442:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77404b 00000004:00100000:3.0:1784047302.182672:0:8442:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047302.182769:0:8442:0:(import.c:65:import_set_state_nolock()) ffff99ccebebb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047302.182857:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709204864:12345-0@lo:38:llog_process_th.0 Request processed in 298us (10393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047302.182864:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1784047302.182952:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047302.182962:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1784047302.182970:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784047302.182976:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784047302.182978:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784047302.182992:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709204864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047302.185236:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709204992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047302.185318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.185480:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709204992 00000100:00100000:3.0:1784047302.185488:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709204992 00000100:00100000:3.0:1784047302.185543:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1784047302.185553:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709204992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047302.185588:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047302.185659:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709204992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047302.185667:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1784047302.185730:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709204992:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784047302.189685:0:87104:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1784047302.189695:0:87104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784047302.189894:0:87104:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1784047302.189928:0:87104:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784047302.190076:0:87104:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1784047302.190079:0:87104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784047302.205568:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047302.205584:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784047302.206017:0:87098:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784047302.206045:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774052 00000100:00080000:2.0:1784047302.206413:0:87098:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047302.206420:0:87098:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccd001a800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047302.206459:0:87098:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482d180 x1870705709205120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047302.206530:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709205120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047302.206603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.206715:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205120 00000100:00100000:0.0:1784047302.206723:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205120 00000100:00100000:0.0:1784047302.206761:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946 00000100:00100000:0.0:1784047302.206770:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3644:x1870705709205120:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784047302.206796:0:26185:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3400 last 0 00000020:00000080:0.0:1784047302.206824:0:26185:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774059 00002000:00100000:0.0:1784047302.206838:0:26185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cbcad88800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784047302.206842:0:26185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784047302.206845:0:26185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784047302.206937:0:26185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784047302.206963:0:26185:0:(import.c:65:import_set_state_nolock()) ffff99ccfe692800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1784047302.207288:0:87098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784047302.207433:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047302.207439:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.207441:0:87098:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784047302.207445:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784047302.207449:0:87098:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784047302.207450:0:87098:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047302.207452:0:87098:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047302.207453:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784047302.207456:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.207458:0:87098:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784047302.207460:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784047302.207465:0:87098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784047302.207468:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047302.207469:0:87098:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784047302.207473:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784047302.207477:0:87098:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:2.0:1784047302.207499:0:87098:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784047302.207501:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047302.207517:0:87098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ccc4ac0000) 00000020:00000080:2.0:1784047302.207535:0:87098:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1784047302.207541:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784047302.207638:0:87098:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784047302.207646:0:87098:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784047302.207652:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774067 00010000:00080000:2.0:1784047302.207683:0:87098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc1d83800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047302.207919:0:87098:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1784047302.207992:0:87098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784047302.208008:0:87098:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784047302.208130:0:87098:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1784047302.211603:0:87098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047302.211661:0:87098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:2.0:1784047302.211811:0:87098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000100:00100000:0.0:1784047302.211982:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709205120:12345-0@lo:8:llog_process_th.0 Request processed in 5206us (5372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.211995:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946 00000100:00100000:3.0:1784047302.214489:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047302.214507:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784047302.214517:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784047302.214523:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784047302.214527:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccd001a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784047302.214548:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784047302.214556:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709205120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047302.214804:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709205248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047302.214868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.214938:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205248 00000100:00100000:3.0:1784047302.214945:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205248 00000100:00100000:3.0:1784047302.215011:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1784047302.215021:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709205248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047302.215052:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047302.215239:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709205248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 218us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047302.215245:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1784047302.215290:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709205248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784047302.215362:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784047302.216051:0:87104:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784047302.216157:0:87104:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3400468549685ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784047302.216165:0:87104:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784047302.219522:0:87086:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1784047302.220706:0:87106:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:2.0:1784047302.220713:0:87106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784047302.221008:0:87106:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1784047302.221036:0:87106:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784047302.221261:0:87106:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:2.0:1784047302.221265:0:87106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784047302.223786:0:87098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047302.223802:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784047302.223846:0:87098:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784047302.223870:0:87098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77406e 00000100:00080000:0.0:1784047302.223881:0:87098:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047302.223887:0:87098:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbc1d83800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047302.224036:0:87098:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce3d22d80 x1870705709205376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047302.224251:0:87098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784047302.224309:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047302.224313:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047302.224315:0:87098:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784047302.224318:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047302.224322:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047302.224323:0:87098:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784047302.224326:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784047302.224328:0:87098:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784047302.224330:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047302.224332:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047302.224334:0:87098:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784047302.224336:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047302.224338:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047302.224339:0:87098:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784047302.224355:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784047302.224387:0:87098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87098:1870705709205504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047302.224470:0:87098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.224514:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205504 00000100:00100000:0.0:1784047302.224520:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205504 00000100:00100000:0.0:1784047302.224560:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784047302.224568:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:87098:x1870705709205504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047302.224717:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:87098:x1870705709205504:12345-0@lo:502:llog_process_th.0 Request processed in 148us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.224724:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784047302.224778:0:87098:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483180 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.224800:0:87098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87098:1870705709205504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784047302.224825:0:87098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047302.224834:0:87098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047302.224835:0:87098:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784047302.224840:0:87098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1784047302.225025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709205376:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047302.225077:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.226460:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205376 00000100:00100000:0.0:1784047302.226471:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205376 00000100:00100000:0.0:1784047302.226501:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947 00000100:00100000:0.0:1784047302.226508:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870705709205376:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784047302.226541:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3400 last 0 00000020:00000080:0.0:1784047302.226570:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774075 00002000:00100000:0.0:1784047302.226584:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cbcadfd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784047302.226588:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784047302.226591:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1784047302.227048:0:87085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784047302.227175:0:87085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00002000:00080000:0.0:1784047302.228778:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047302.228821:0:8433:0:(import.c:65:import_set_state_nolock()) ffff99ccc355b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047302.228921:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709205376:12345-0@lo:8:llog_process_th.0 Request processed in 2410us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.228948:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947 00000100:00100000:3.0:1784047302.229253:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047302.229263:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784047302.229288:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784047302.229293:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784047302.229297:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d83800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784047302.229314:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784047302.229319:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709205376:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047302.229403:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709205632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047302.229447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.229499:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205632 00000100:00100000:3.0:1784047302.229506:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205632 00000100:00100000:3.0:1784047302.229553:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1784047302.229563:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709205632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047302.229585:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047302.229644:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709205632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047302.229651:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00080000:3.0:1784047302.229669:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047302.229693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709205632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784047302.230331:0:87085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.230352:0:87085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047302.230359:0:87085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cbcae51000 from 1 10000000:01000000:1.0:1784047302.230362:0:87085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047302.230392:0:87085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.230400:0:87085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.230409:0:87085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047302.230427:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709205760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784047302.230466:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.230491:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047302.230717:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205760 00000100:00100000:3.0:1784047302.230723:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205760 00000100:00100000:3.0:1784047302.230756:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784047302.230763:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:87085:x1870705709205760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047302.230774:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047302.230789:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77407c expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.230810:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77407c expref: 9 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.230832:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77407c expref: 9 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.230841:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418000, rc 0) 00000100:00100000:3.0:1784047302.230875:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:87085:x1870705709205760:12345-0@lo:101:mount.lustre.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047302.230881:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047302.231066:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709205760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047302.231080:0:87085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.231088:0:87085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047302.231636:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709205888:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784047302.231687:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.231712:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e900 going to sleep for 11 seconds 00000004:00080000:3.0:1784047302.232101:0:87106:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784047302.232194:0:87106:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3400484586834ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784047302.232201:0:87106:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784047302.232332:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709205888 00000100:00100000:0.0:1784047302.232349:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709205888 00000100:00100000:0.0:1784047302.232397:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784047302.232406:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:87085:x1870705709205888:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784047302.232423:0:87091:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784047302.232440:0:87091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784047302.232444:0:87091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784047302.232447:0:87091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784047302.232449:0:87091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 112 00000100:00100000:0.0:1784047302.232548:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:87085:x1870705709205888:12345-0@lo:256:mount.lustre.0 Request processed in 143us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.232564:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784047302.232804:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709205888:0@lo:256:mount.lustre.0 00000004:00080000:2.0:1784047302.236250:0:87086:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:1.0:1784047302.237017:0:87085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047302.237045:0:87085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.237129:0:87085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047302.237147:0:87085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cbcae51000 from 1 10000000:01000000:1.0:1784047302.237150:0:87085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047302.237201:0:87085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.237209:0:87085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.237220:0:87085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047302.237248:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784047302.237320:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047302.237470:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206016 00000100:00100000:2.0:1784047302.237479:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206016 00000100:00100000:2.0:1784047302.237541:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784047302.237550:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:87085:x1870705709206016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047302.237564:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047302.237581:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77408a expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047302.237604:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77408a expref: 10 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047302.237634:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77408a expref: 10 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047302.237642:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1200, rc 0) 00000100:00100000:2.0:1784047302.237683:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709206016:12345-0@lo:101:mount.lustre.0 Request processed in 133us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.237690:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784047302.237715:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047302.237737:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047302.237752:0:87085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.237779:0:87085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047302.237841:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047302.237865:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.237921:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.241551:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206144 00000100:00100000:0.0:1784047302.241566:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206144 00000100:00100000:1.0:1784047302.245514:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784047302.245527:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709206144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047302.245789:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709206144:12345-0@lo:501:mount.lustre.0 Request processed in 263us (7921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.245815:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784047302.246006:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047302.246073:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047302.246123:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.246171:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047302.246223:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206272 00000100:00100000:2.0:1784047302.246231:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206272 00000100:00100000:2.0:1784047302.246259:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784047302.246266:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709206272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047302.246354:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709206272:12345-0@lo:503:mount.lustre.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.246361:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784047302.246427:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047302.247500:0:87108:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87108:1870705709206400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047302.247553:0:87108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.247655:0:87108:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e000 going to sleep for 11 seconds 00000100:00100000:2.0:1784047302.253267:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206400 00000100:00100000:2.0:1784047302.253285:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206400 00000100:00100000:2.0:1784047302.253470:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047302.253482:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:87108:x1870705709206400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047302.257830:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:87108:x1870705709206400:12345-0@lo:502:llog_process_th.0 Request processed in 4341us (10266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.257846:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784047302.258012:0:87108:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87108:1870705709206400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047302.258049:0:87108:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047302.258070:0:87108:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.258073:0:87108:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784047302.258081:0:87108:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbcae51000 00000020:00000080:1.0:1784047302.258084:0:87108:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784047302.258092:0:87108:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047302.258095:0:87108:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.258108:0:87108:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784047302.258112:0:87108:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047302.258115:0:87108:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.258117:0:87108:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784047302.258120:0:87108:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbcae51000 00000020:00000080:1.0:1784047302.258122:0:87108:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784047302.259838:0:87108:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87108:1870705709206528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047302.259916:0:87108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.268888:0:87108:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.270226:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206528 00000100:00100000:0.0:1784047302.270238:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206528 00000100:00100000:0.0:1784047302.270314:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784047302.270323:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:87108:x1870705709206528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047302.271274:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:87108:x1870705709206528:12345-0@lo:502:llog_process_th.0 Request processed in 949us (11354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.271286:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784047302.271441:0:87108:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87108:1870705709206528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047302.271479:0:87108:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047302.271487:0:87108:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047302.271490:0:87108:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784047302.271494:0:87108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784047302.276165:0:87085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784047302.276217:0:87085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047302.276238:0:87085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.276251:0:87085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047302.276305:0:87085:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784047302.276308:0:87085:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cbcae51000 10000000:01000000:0.0:1784047302.276311:0:87085:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cbcae51000 10000000:01000000:0.0:1784047302.276315:0:87085:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784047302.276320:0:87085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cbcae51000 from 1 10000000:01000000:0.0:1784047302.276322:0:87085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047302.276357:0:87085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.276365:0:87085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.276402:0:87085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047302.276428:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047302.276495:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.276793:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d480 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.276820:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206656 00000100:00100000:0.0:1784047302.276828:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206656 00000100:00100000:0.0:1784047302.276874:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784047302.276883:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:87085:x1870705709206656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047302.276912:0:87093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047302.276926:0:87093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4200/0x4426598c0c77409f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774098 expref: -99 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.276951:0:87093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4200/0x4426598c0c77409f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774098 expref: 11 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.276963:0:87093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4200/0x4426598c0c77409f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774098 expref: 11 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.276971:0:87093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4200, rc 0) 00000100:00100000:0.0:1784047302.277009:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709206656:12345-0@lo:101:mount.lustre.0 Request processed in 126us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.277015:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784047302.277244:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047302.277263:0:87085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.277278:0:87085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047302.277340:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047302.277368:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.277383:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d480 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.277592:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206784 00000100:00100000:0.0:1784047302.277597:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206784 00000100:00100000:0.0:1784047302.277644:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784047302.277651:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709206784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047302.277778:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709206784:12345-0@lo:501:mount.lustre.0 Request processed in 127us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.277785:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784047302.277822:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047302.277852:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047302.277887:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.277924:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.277937:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709206912 00000100:00100000:0.0:1784047302.277941:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709206912 00000100:00100000:0.0:1784047302.277962:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784047302.277968:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709206912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047302.278042:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709206912:12345-0@lo:503:mount.lustre.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.278049:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784047302.278376:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709206912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047302.282708:0:87111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87111:1870705709207040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047302.282787:0:87111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.282789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047302.282814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047302.282821:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207040 00000100:00100000:0.0:1784047302.282827:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207040 00000100:00100000:3.0:1784047302.282836:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047302.282856:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410816 00000100:00100000:0.0:1784047302.282857:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410560 00000100:00100000:3.0:1784047302.282859:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410816 00000100:00100000:0.0:1784047302.282859:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410560 00000100:00100000:0.0:1784047302.282875:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047302.282883:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87111:x1870705709207040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047302.282892:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410688 00000100:00100000:3.0:1784047302.282894:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410688 00000100:00100000:3.0:1784047302.282909:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1116 00000100:00100000:3.0:1784047302.282917:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689410816:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047302.282976:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689410816:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047302.282985:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1116 00000100:00100000:3.0:1784047302.283003:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1131 00000100:00100000:3.0:1784047302.283007:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689410688:12345-192.168.204.40@tcp:38:kworker.0 00000100:00100000:2.0:1784047302.283246:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:2.0:1784047302.283252:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1870705689410560:12345-192.168.204.40@tcp:250:kworker.0 00010000:00080000:2.0:1784047302.283270:0:87091:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d42aef96-772a-4ce2-a768-bea713505b5b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3400 last 0 00000020:00000080:2.0:1784047302.283297:0:87091:0:(genops.c:1406:class_connect()) connect: client d42aef96-772a-4ce2-a768-bea713505b5b, cookie 0x4426598c0c7740a6 00000100:00100000:0.0:1784047302.283298:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87111:x1870705709207040:12345-0@lo:502:llog_process_th.0 Request processed in 415us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.283304:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047302.283353:0:87111:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.283376:0:87111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87111:1870705709207040:0@lo:502:llog_process_th.0 00000100:00080000:2.0:1784047302.283456:0:87091:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d80800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047302.283495:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+5:2398:x1870705689410560:12345-192.168.204.40@tcp:250:kworker.0 Request processed in 241us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.283501:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000020:01000004:0.0:1784047302.284295:0:87111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784047302.284311:0:87111:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ccfebb19c0) 00000020:00000080:0.0:1784047302.284332:0:87111:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784047302.285292:0:87111:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbcae51000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784047302.285298:0:87111:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbcae51000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784047302.285313:0:87111:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbcae51000 4 00010000:00080000:2.0:1784047302.285345:0:87111:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc1d87800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00000100:00100000:3.0:1784047302.286826:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689410688:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 3805us (3977us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047302.286850:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1131 00000100:00080000:3.0:1784047302.286891:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784047302.296502:0:87111:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1784047302.297847:0:87111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784047302.298577:0:87111:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784047302.298591:0:87111:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4426598c0c7740b4 00000100:00080000:2.0:1784047302.298601:0:87111:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047302.298622:0:87111:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbc1d87800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047302.298657:0:87111:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482c380 x1870705709207168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047302.298686:0:87111:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784047302.299013:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709207168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047302.299640:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.300168:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207168 00000100:00100000:0.0:1784047302.300178:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207168 00000100:00100000:0.0:1784047302.300213:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1784047302.300221:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709207168:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047302.300285:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709207168:12345-0@lo:38:llog_process_th.0 Request processed in 62us (644us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784047302.300292:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1784047302.300339:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784047302.300348:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047302.300352:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047302.300356:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709207168:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784047302.308882:0:87111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87111:1870705709207296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047302.308969:0:87111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.309013:0:87111:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047302.310687:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207296 00000100:00100000:2.0:1784047302.310700:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207296 00000100:00100000:2.0:1784047302.310754:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784047302.310763:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87111:x1870705709207296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047302.310941:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87111:x1870705709207296:12345-0@lo:502:llog_process_th.0 Request processed in 177us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.310949:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784047302.313737:0:87111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87111:1870705709207296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047302.313836:0:87111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87111:1870705709207424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047302.313914:0:87111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.313946:0:87111:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047302.314439:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207424 00000100:00100000:2.0:1784047302.314448:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207424 00000100:00100000:2.0:1784047302.314505:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784047302.314523:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:87111:x1870705709207424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047302.314672:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:87111:x1870705709207424:12345-0@lo:502:llog_process_th.0 Request processed in 150us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.314681:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784047302.315100:0:87111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:87111:1870705709207424:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784047302.315131:0:87111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784047302.315452:0:87085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784047302.315478:0:87085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047302.315576:0:87085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047302.315588:0:87085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784047302.315668:0:87085:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784047302.315671:0:87085:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047302.315672:0:87085:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047302.315673:0:87085:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047302.315674:0:87085:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047302.315675:0:87085:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047302.315677:0:87085:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047302.315678:0:87085:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047302.315681:0:87085:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047302.315682:0:87085:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047302.315686:0:87085:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784047302.315688:0:87085:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784047302.315690:0:87085:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047302.315691:0:87085:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047302.315692:0:87085:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047302.315693:0:87085:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047302.315694:0:87085:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047302.315695:0:87085:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047302.315696:0:87085:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047302.315697:0:87085:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047302.315698:0:87085:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047302.315719:0:87085:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784047302.315734:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709207552:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784047302.315776:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047302.315799:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.315854:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207552 00000100:00100000:0.0:1784047302.315860:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207552 00000100:00100000:0.0:1784047302.315898:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784047302.315906:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709207552:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784047302.315930:0:87093:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784047302.315943:0:87093:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784047302.322802:0:87093:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047302.322827:0:87093:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784047302.322924:0:87095:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784047302.322929:0:87095:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784047302.322954:0:87095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.322973:0:87095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77407c expref: 11 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.322982:0:87095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.323027:0:87095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c77407c expref: 11 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047302.323048:0:87095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c77407c expref: 11 pid: 87092 timeout: 3500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047302.323084:0:87095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87095:1870705709207680:0@lo:104: 00000100:00100000:3.0:1784047302.323160:0:87095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047302.323218:0:87095:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047302.323277:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207680 00000100:00100000:0.0:1784047302.323287:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207680 00000100:00100000:0.0:1784047302.323341:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1784047302.323353:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:87095:x1870705709207680:12345-0@lo:104: 00010000:00010000:0.0:1784047302.323401:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323469:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047302.323475:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:87095:x1870705709207680:12345-0@lo:104: Request processed in 124us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047302.323482:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1784047302.323492:0:87095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87095:1870705709207680:0@lo:104: 00010000:00010000:0.0:1784047302.323503:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047302.323514:0:87095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323519:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323526:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047302.323537:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323545:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047302.323552:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047302.323558:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047302.323596:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323602:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047302.323653:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323661:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0030600/0x4426598c0c77407c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774083 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.323678:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047302.323680:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047302.323682:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047302.323694:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709207808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047302.323722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.323821:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207808 00000100:00100000:1.0:1784047302.323826:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207808 00010000:00010000:1.0:1784047302.323845:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c77407c expref: 12 pid: 87092 timeout: 3500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047302.323872:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:1.0:1784047302.323879:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+12:3648:x1870705709207808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047302.323890:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047302.323895:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c77407c expref: 12 pid: 87092 timeout: 3500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323916:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c77407c expref: 12 pid: 87092 timeout: 3500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323928:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418000/0x4426598c0c774083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c77407c expref: 12 pid: 87092 timeout: 3500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323942:0:10393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047302.323949:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:87085:x1870705709207552:12345-0@lo:253:mount.lustre.0 Request processed in 8043us (8171us total) trans 0 rc 0/0 00010000:00010000:1.0:1784047302.323950:0:10393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047302.323957:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 20000000:01000000:1.0:1784047302.323962:0:10393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001033635s 00010000:00010000:1.0:1784047302.323966:0:10393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323973:0:10393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323980:0:10393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323986:0:10393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.323991:0:10393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047302.323995:0:10393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047302.324002:0:10393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047302.324010:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:87085:1870705709207552:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1784047302.324022:0:10393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047302.324026:0:87085:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784047302.324029:0:87085:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784047302.324030:0:87085:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00010000:00010000:1.0:1784047302.324031:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:2.0:1784047302.324032:0:87085:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047302.324033:0:87085:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047302.324034:0:87085:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047302.324036:0:87085:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047302.324037:0:87085:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047302.324038:0:87085:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047302.324040:0:87085:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047302.324041:0:87085:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047302.324061:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+10:3648:x1870705709207808:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (337us total) trans 0 rc 0/0 00000020:02000000:2.0:1784047302.324062:0:87085:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784047302.324068:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00010000:00010000:0.0:1784047302.326811:0:87095:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.326830:0:87095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047302.326860:0:87095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419800/0x4426598c0c7740bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047302.329481:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709207808:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784047302.351193:0:87085:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411365 00000040:01000000:2.0:1784047302.351653:0:87085:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784047302.351934:0:87117:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784047302.352088:0:87085:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1784047302.352238:0:87116:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411365 00000020:00080000:0.0:1784047302.352242:0:87116:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411365 00000100:00100000:0.0:1784047302.352867:0:87118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87118:1870705709207936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047302.352943:0:87118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.352984:0:87118:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784047302.353337:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709207936 00000100:00100000:2.0:1784047302.353354:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709207936 00000100:00100000:2.0:1784047302.353413:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1784047302.353423:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87118:x1870705709207936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047302.353509:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87118:x1870705709207936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.353517:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:0.0:1784047302.353544:0:87118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87118:1870705709207936:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784047302.353574:0:87118:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784047302.353601:0:87118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87118:1870705709208064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047302.353653:0:87118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.353671:0:87118:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784047302.353879:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208064 00000100:00100000:2.0:1784047302.353885:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208064 00000100:00100000:2.0:1784047302.353911:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1784047302.353916:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87118:x1870705709208064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047302.354016:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87118:x1870705709208064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047302.354023:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000040:00080000:3.0:1784047302.354213:0:87117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784047302.354600:0:87118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87118:1870705709208064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047302.354739:0:87118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87118:1870705709208192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047302.354767:0:87118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047302.354825:0:87118:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b540 going to sleep for 11 seconds 00000040:01000000:0.0:1784047302.357732:0:87085:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784047302.357779:0:87085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784047302.359459:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208192 00000100:00100000:1.0:1784047302.359476:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208192 00000100:00100000:1.0:1784047302.359550:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:1.0:1784047302.359561:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87118:x1870705709208192:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784047302.359707:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87118:x1870705709208192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 148us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047302.359716:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:1.0:1784047302.359766:0:87118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87118:1870705709208192:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784047302.359832:0:87118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784047302.361737:0:87085:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784047302.361755:0:87085:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784047302.361841:0:87085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047302.362483:0:87118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784047302.362556:0:87118:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784047302.363094:0:87085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784047302.363652:0:87085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784047302.363687:0:87085:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784047302.363793:0:87085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784047302.365122:0:87117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784047302.365203:0:87117:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784047302.365209:0:87117:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:0.0:1784047302.375111:0:87085:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:1.0:1784047302.382901:0:87085:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:1.0:1784047302.383886:0:87119:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87119 00010000:02000000:1.0:1784047302.383897:0:87119:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1784047302.383900:0:87119:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784047302.383904:0:87119:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784047302.384089:0:87085:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784047302.384106:0:87085:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784047302.384156:0:87085:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784047302.384185:0:87085:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784047302.385073:0:87085:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047302.385342:0:87085:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047302.931420:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047302.932702:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047302.932725:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709208320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047302.932813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.932990:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208320 00000100:00100000:1.0:1784047302.933012:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208320 00000100:00100000:1.0:1784047302.933060:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1784047302.933071:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709208320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047302.933100:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047302.933159:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709208320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047302.933166:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:0.0:1784047302.934319:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709208320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047302.939471:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709208448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047302.939553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047302.939705:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208448 00000100:00100000:1.0:1784047302.939713:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208448 00000100:00100000:1.0:1784047302.939785:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1784047302.939796:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709208448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047302.939828:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047302.939882:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709208448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047302.939890:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1784047302.943216:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709208448:0@lo:13:osp-pre-1-1.0 10000000:01000000:3.0:1784047303.060664:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784047303.060672:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cbcae51000 from 113 10000000:01000000:3.0:1784047303.060676:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784047303.060733:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.060745:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.060766:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.060792:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.060860:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.060896:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047303.061204:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208576 00000100:00100000:2.0:1784047303.061219:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208576 00000100:00100000:2.0:1784047303.061278:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784047303.061287:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:6515:x1870705709208576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047303.061300:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047303.061314:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1400/0x4426598c0c7740c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7740c2 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.061337:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1400/0x4426598c0c7740c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7740c2 expref: 11 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.061348:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1400/0x4426598c0c7740c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7740c2 expref: 11 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.061356:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1400, rc 0) 00000100:00100000:2.0:1784047303.061410:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709208576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047303.061417:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784047303.063245:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.063277:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.063289:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047303.063368:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.063428:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047303.063473:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd22b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.063593:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208704 00000100:00100000:3.0:1784047303.063600:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208704 00000100:00100000:3.0:1784047303.063669:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784047303.063678:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709208704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047303.063697:0:87091:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784047303.063716:0:87091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047303.063731:0:87091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 113 00000100:00100000:3.0:1784047303.063834:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709208704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.063842:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784047303.064710:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784047303.064780:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047303.064790:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.064801:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047303.064810:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047303.064814:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 52 10000000:01000000:1.0:1784047303.064816:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047303.064844:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.064852:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.064861:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047303.064878:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.064920:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047303.064954:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd59c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.065197:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208832 00000100:00100000:3.0:1784047303.065204:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208832 00000100:00100000:3.0:1784047303.065253:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784047303.065261:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709208832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.065272:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047303.065284:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419200/0x4426598c0c7740d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7740d0 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.065305:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419200/0x4426598c0c7740d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7740d0 expref: 12 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.065316:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419200/0x4426598c0c7740d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7740d0 expref: 12 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.065398:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419200, rc 0) 00000100:00100000:3.0:1784047303.065444:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709208832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.065451:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784047303.070220:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047303.070253:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.070267:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047303.070374:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047303.070441:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047303.070491:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd9a8ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.071695:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709208960 00000100:00100000:0.0:1784047303.071707:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709208960 00000100:00100000:0.0:1784047303.071786:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784047303.071798:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709208960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.071993:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709208960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.072002:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784047303.072495:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709208960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.072553:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.072596:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.072652:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.072666:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209088 00000100:00100000:3.0:1784047303.072671:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209088 00000100:00100000:3.0:1784047303.072699:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784047303.072704:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709209088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.073895:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709209088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1186us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.073906:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047303.075106:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047303.079446:0:87143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784047303.082949:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784047303.082995:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047303.083006:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.083019:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047303.083029:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784047303.083031:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 110 10000000:01000000:3.0:1784047303.083034:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784047303.083072:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.083079:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.083090:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.083140:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.083209:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.083253:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.083506:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209216 00000100:00100000:0.0:1784047303.083513:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209216 00000100:00100000:0.0:1784047303.083568:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784047303.083577:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709209216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.083589:0:87091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047303.083622:0:87091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4000/0x4426598c0c7740e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7740de expref: -99 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.083645:0:87091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4000/0x4426598c0c7740e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7740de expref: 13 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.083662:0:87091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4000/0x4426598c0c7740e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7740de expref: 13 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.083670:0:87091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4000, rc 0) 00000100:00100000:0.0:1784047303.083708:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709209216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.083725:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784047303.083920:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.083934:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.083942:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.083991:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.084020:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.084049:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.084090:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209344 00000100:00100000:0.0:1784047303.084094:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209344 00000100:00100000:0.0:1784047303.084135:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784047303.084141:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709209344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784047303.084154:0:87092:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784047303.084171:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784047303.084175:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784047303.084178:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784047303.084180:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784047303.084183:0:87092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 113 00000100:00100000:0.0:1784047303.084257:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709209344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.084264:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784047303.084400:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784047303.084471:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784047303.084477:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.084485:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047303.084493:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784047303.084495:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784047303.084497:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784047303.084514:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.084530:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.084538:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.084551:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.084576:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.084600:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.084675:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209472 00000100:00100000:0.0:1784047303.084679:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209472 00000100:00100000:0.0:1784047303.084712:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784047303.084855:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709209472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.084864:0:87091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047303.084876:0:87091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5200/0x4426598c0c7740f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7740ec expref: -99 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.084904:0:87091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5200/0x4426598c0c7740f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7740ec expref: 14 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.084913:0:87091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5200/0x4426598c0c7740f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7740ec expref: 14 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.084921:0:87091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5200, rc 0) 00000100:00100000:0.0:1784047303.084951:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709209472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.084957:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784047303.085028:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.085039:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.085047:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.085096:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.085133:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.085160:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.085199:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209600 00000100:00100000:0.0:1784047303.085203:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209600 00000100:00100000:0.0:1784047303.085233:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784047303.085240:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709209600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.085445:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709209600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.085452:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784047303.085527:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.085557:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.085593:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.085643:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.085691:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209728 00000100:00100000:0.0:1784047303.085695:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209728 00000100:00100000:0.0:1784047303.085856:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784047303.085865:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709209728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.088540:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709209728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2670us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.088555:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784047303.088738:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047303.090181:0:87144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1784047303.095179:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1784047303.095231:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784047303.095322:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.095336:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.095347:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1784047303.095350:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc355c000 from 1 10000000:01000000:0.0:1784047303.095352:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784047303.095506:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.095515:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.095526:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.095554:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.095642:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.095685:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.097362:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209856 00000100:00100000:1.0:1784047303.097374:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209856 00000100:00100000:1.0:1784047303.097435:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784047303.097445:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709209856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.097462:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047303.097481:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0031a00/0x4426598c0c774101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7740fa expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.097518:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0031a00/0x4426598c0c774101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7740fa expref: 15 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.097530:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0031a00/0x4426598c0c774101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7740fa expref: 15 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.097538:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031a00, rc 0) 00000100:00100000:1.0:1784047303.097602:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709209856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047303.097628:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784047303.098560:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.098583:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.098593:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.098631:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784047303.098636:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.098653:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.098661:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784047303.098664:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc355c000 from 7 10000000:01000000:0.0:1784047303.098666:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047303.098693:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.098700:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.098707:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.098740:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.098790:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.098823:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.099047:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709209984 00000100:00100000:3.0:1784047303.099053:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709209984 00000100:00100000:3.0:1784047303.099246:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784047303.099256:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709209984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.099266:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047303.099278:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418000/0x4426598c0c77410f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774108 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.099296:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418000/0x4426598c0c77410f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774108 expref: 16 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.099304:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418000/0x4426598c0c77410f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774108 expref: 16 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.099312:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418000, rc 0) 00000100:00100000:3.0:1784047303.100196:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709209984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 939us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.100204:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784047303.106342:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709209984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.106376:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.106390:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047303.106494:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.106571:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047303.106632:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd22b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.109133:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210112 00000100:00100000:3.0:1784047303.109148:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210112 00000100:00100000:3.0:1784047303.109210:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784047303.109221:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709210112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.109424:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709210112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.109433:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784047303.109716:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.109767:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.109813:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047303.109840:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd22b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.111421:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210240 00000100:00100000:3.0:1784047303.111433:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210240 00000100:00100000:3.0:1784047303.111493:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784047303.111502:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709210240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.111666:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709210240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.111674:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784047303.112717:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047303.113521:0:87146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784047303.113808:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784047303.113834:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047303.113845:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.113857:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.113866:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047303.113868:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 52 10000000:01000000:0.0:1784047303.113871:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047303.113919:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.113927:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.113937:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.113962:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.114042:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.114085:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.117587:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210368 00000100:00100000:3.0:1784047303.117602:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210368 00000100:00100000:3.0:1784047303.117682:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784047303.117691:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709210368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.117708:0:87091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047303.117735:0:87091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419800/0x4426598c0c77411d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774116 expref: -99 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.117776:0:87091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419800/0x4426598c0c77411d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774116 expref: 17 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.117787:0:87091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419800/0x4426598c0c77411d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774116 expref: 17 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.117796:0:87091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419800, rc 0) 00000100:00100000:3.0:1784047303.117891:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709210368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.117897:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784047303.122407:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.122448:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.122461:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.122578:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.122675:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.122716:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047303.123276:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210496 00000100:00100000:2.0:1784047303.123289:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210496 00000100:00100000:2.0:1784047303.123348:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784047303.123360:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709210496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047303.123543:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709210496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047303.123550:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784047303.123673:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.123724:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.123776:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.123807:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047303.123874:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210624 00000100:00100000:2.0:1784047303.123879:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210624 00000100:00100000:2.0:1784047303.123956:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784047303.123963:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709210624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047303.124082:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709210624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047303.124090:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784047303.127532:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047303.129091:0:87148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784047303.129459:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784047303.129501:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047303.129513:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.129523:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.129534:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784047303.129537:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1784047303.129540:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047303.129582:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.129590:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.129627:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.129660:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.129734:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.129782:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc2ad4480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.130152:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210752 00000100:00100000:1.0:1784047303.130172:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210752 00000100:00100000:1.0:1784047303.130228:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784047303.130238:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709210752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.130255:0:87093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047303.130271:0:87093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030a00/0x4426598c0c77412b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774124 expref: -99 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.130298:0:87093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030a00/0x4426598c0c77412b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774124 expref: 18 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.130309:0:87093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030a00/0x4426598c0c77412b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774124 expref: 18 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.130317:0:87093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030a00, rc 0) 00000100:00100000:1.0:1784047303.130378:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709210752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047303.130385:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784047303.130668:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.130683:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.130694:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.130760:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.130804:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.130822:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc2ad4480 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.130837:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709210880 00000100:00100000:0.0:1784047303.130841:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709210880 00000100:00100000:0.0:1784047303.130868:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784047303.130876:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709210880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.131013:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709210880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.131021:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784047303.131050:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709210880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.131076:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.131115:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.131141:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc2ad4480 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.131152:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211008 00000100:00100000:0.0:1784047303.131155:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211008 00000100:00100000:0.0:1784047303.131298:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047303.131305:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709211008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.131981:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709211008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 674us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.131989:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047303.132059:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047303.145951:0:87149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784047303.147304:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784047303.147348:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784047303.147362:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.147376:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047303.147387:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784047303.147390:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccf756a000 from 7 10000000:01000000:2.0:1784047303.147393:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047303.147437:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.147446:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.147476:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047303.147505:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047303.147574:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047303.147630:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.148348:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211136 00000100:00100000:1.0:1784047303.148361:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211136 00000100:00100000:1.0:1784047303.148421:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784047303.148433:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709211136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.148450:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047303.148477:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030c00/0x4426598c0c774139 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774132 expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.148506:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030c00/0x4426598c0c774139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774132 expref: 19 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.148516:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030c00/0x4426598c0c774139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774132 expref: 19 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.148525:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030c00, rc 0) 00000100:00100000:1.0:1784047303.148589:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709211136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047303.148597:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784047303.148779:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.148796:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.148805:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.148893:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.148927:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.148957:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:2.0:1784047303.149285:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211264 00000100:00100000:2.0:1784047303.149291:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211264 00000100:00100000:2.0:1784047303.149335:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784047303.149343:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709211264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047303.149457:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709211264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047303.149464:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784047303.150301:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.150363:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.150418:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.150455:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.150477:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211392 00000100:00100000:3.0:1784047303.150482:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211392 00000100:00100000:3.0:1784047303.150517:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784047303.150523:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709211392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.150630:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709211392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.150638:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784047303.150678:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047303.151573:0:87151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784047303.151984:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784047303.152021:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784047303.152033:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152046:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047303.152056:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047303.152070:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 52 10000000:01000000:3.0:1784047303.152073:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047303.152106:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152113:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152133:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.152166:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.152218:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.152252:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.152269:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211520 00000100:00100000:3.0:1784047303.152275:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211520 00000100:00100000:3.0:1784047303.152315:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784047303.152527:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709211520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.152539:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047303.152553:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418800/0x4426598c0c774147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774140 expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152574:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418800/0x4426598c0c774147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774140 expref: 20 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152584:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418800/0x4426598c0c774147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774140 expref: 20 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152592:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418800, rc 0) 00000100:00100000:3.0:1784047303.152656:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709211520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 333us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.152669:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784047303.152716:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047303.152729:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.152738:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.152791:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.152816:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.152838:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.152850:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211648 00000100:00100000:3.0:1784047303.152854:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211648 00000100:00100000:3.0:1784047303.152876:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784047303.152883:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709211648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.152998:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709211648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.153004:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784047303.153050:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.153075:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.153112:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.153139:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.153150:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211776 00000100:00100000:3.0:1784047303.153154:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211776 00000100:00100000:3.0:1784047303.155435:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784047303.155467:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709211776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.155622:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709211776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.155630:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784047303.155691:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047303.162676:0:87152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784047303.163004:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784047303.163033:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047303.163046:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.163060:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047303.163070:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784047303.163073:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784047303.163077:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784047303.163146:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.163157:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047303.163179:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047303.163211:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.163312:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047303.163376:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23780 going to sleep for 11 seconds 00000100:00100000:2.0:1784047303.164195:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709211904 00000100:00100000:2.0:1784047303.164205:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709211904 00000100:00100000:2.0:1784047303.164267:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784047303.164279:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709211904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047303.164296:0:87091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047303.164316:0:87091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77414e expref: -99 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.164361:0:87091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77414e expref: 21 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.164373:0:87091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77414e expref: 21 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.164391:0:87091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1800, rc 0) 00000100:00100000:2.0:1784047303.164478:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709211904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047303.164485:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784047303.164743:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709211904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.164762:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.164784:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.164859:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.164896:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.164941:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047303.164982:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212032 00000100:00100000:3.0:1784047303.164988:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212032 00000100:00100000:3.0:1784047303.165031:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784047303.165039:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709212032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.165218:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709212032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.165227:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784047303.165445:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.165477:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.165519:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.165547:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047303.166270:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212160 00000100:00100000:2.0:1784047303.166278:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212160 00000100:00100000:2.0:1784047303.166321:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784047303.166339:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709212160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047303.167900:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709212160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1557us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047303.167915:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784047303.167929:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047303.169690:0:87155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1784047303.170150:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1784047303.170177:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784047303.170190:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.170204:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.170215:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784047303.170218:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfe6b8800 from 7 10000000:01000000:0.0:1784047303.170221:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047303.170270:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.170279:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.170300:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.170327:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.170406:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.170458:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.170514:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212288 00000100:00100000:1.0:1784047303.170522:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212288 00000100:00100000:1.0:1784047303.170626:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784047303.170638:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709212288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.170653:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047303.170670:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0031200/0x4426598c0c774163 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77415c expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.170697:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0031200/0x4426598c0c774163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77415c expref: 22 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.170709:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0031200/0x4426598c0c774163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77415c expref: 22 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.170717:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031200, rc 0) 00000100:00100000:1.0:1784047303.170770:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709212288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047303.170783:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784047303.170866:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047303.170884:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047303.170895:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047303.170954:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047303.170983:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047303.171014:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047303.171031:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212416 00000100:00100000:0.0:1784047303.171037:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212416 00000100:00100000:0.0:1784047303.171071:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784047303.171078:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc780d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709212416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.171567:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc780d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709212416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 487us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.171575:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784047303.171703:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.171831:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.171871:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.171941:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.172043:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212544 00000100:00100000:1.0:1784047303.172048:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212544 00000100:00100000:1.0:1784047303.172116:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784047303.172133:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709212544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.172225:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709212544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047303.172232:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784047303.172301:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047303.173186:0:87156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784047303.173348:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784047303.173376:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047303.173385:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173396:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.173405:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784047303.173413:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047303.173415:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784047303.173444:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173452:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173461:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.173479:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.173523:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.173590:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.173666:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212672 00000100:00100000:1.0:1784047303.173672:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212672 00000100:00100000:0.0:1784047303.173778:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784047303.173786:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709212672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.173796:0:87092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047303.173818:0:87092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c774171 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77416a expref: -99 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173839:0:87092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c774171 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77416a expref: 23 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173849:0:87092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c774171 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77416a expref: 23 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173858:0:87092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5a00, rc 0) 00000100:00100000:0.0:1784047303.173891:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709212672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047303.173899:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784047303.173943:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.173958:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173967:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.173986:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784047303.173991:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.173998:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047303.174006:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784047303.174008:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047303.174010:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784047303.174025:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.174032:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.174045:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.174058:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.174082:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047303.174103:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212800 00000100:00100000:0.0:1784047303.174103:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.174107:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212800 00000100:00100000:1.0:1784047303.174149:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784047303.174157:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709212800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047303.174164:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047303.174173:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030600/0x4426598c0c77417f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774178 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.174187:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030600/0x4426598c0c77417f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774178 expref: 24 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.174195:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030600/0x4426598c0c77417f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774178 expref: 24 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047303.174202:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030600, rc 0) 00000100:00100000:1.0:1784047303.174242:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709212800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047303.174249:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784047303.174249:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047303.174265:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.174273:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047303.174317:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047303.174342:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047303.174367:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047303.174410:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709212928 00000100:00100000:1.0:1784047303.174413:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709212928 00000100:00100000:1.0:1784047303.174471:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784047303.174478:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709212928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047303.174548:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709212928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047303.174555:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784047303.174632:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709212928:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784047303.174659:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784047303.174664:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.174672:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047303.955769:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047304.272175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047304.272290:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689410944 00000100:00100000:1.0:1784047304.272311:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689410944 00000100:00100000:1.0:1784047304.272395:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:1.0:1784047304.272408:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+5:42435:x1870705689410944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047304.272431:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047304.272459:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd6de00/0x4426598c0c774186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae180 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047304.272496:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd6de00/0x4426598c0c774186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae180 expref: 6 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047304.272510:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd6de00/0x4426598c0c774186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae180 expref: 6 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047304.272521:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6de00, rc 0) 00000100:00100000:1.0:1784047304.272598:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689410944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 192us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047304.272631:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:0.0:1784047304.283878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047304.284188:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411072 00000100:00100000:1.0:1784047304.284202:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411072 00000100:00100000:1.0:1784047304.284300:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:1.0:1784047304.284311:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689411072:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784047304.284356:0:87092:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1784047304.284382:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784047304.284385:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784047304.284396:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784047304.284399:0:87092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784047304.284401:0:87092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 113 00000100:00100000:0.0:1784047304.287539:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689411072:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 3212us (3656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047304.287560:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:3.0:1784047304.289563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047304.289712:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411200 00000100:00100000:0.0:1784047304.289725:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411200 00000100:00100000:0.0:1784047304.289785:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1133 00000100:00100000:0.0:1784047304.289796:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689411200:12345-192.168.204.40@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1784047304.289839:0:66221:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a2569b5-a558-4441-a96a-1d77608df16b' at ffff99ccc3566800, cookie 0x4426598c0c774005 00010000:00080000:0.0:1784047304.289858:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp recovering/t103079215109 exp ffff99ccc3566800 cur 3402 last 1784047302 00010000:02000400:0.0:1784047304.289868:0:66221:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784047304.289875:0:66221:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784047304.289912:0:66221:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784047304.290369:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047304.290753:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689411200:12345-192.168.204.40@tcp:38:ll_cfg_requeue.0 Request processed in 957us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047304.290764:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1133 00000100:00100000:2.0:1784047304.291130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047304.291515:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411328 00000100:00100000:0.0:1784047304.291524:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411328 00000100:00100000:0.0:1784047304.291602:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:0.0:1784047304.291642:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689411328:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047304.291658:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047304.291888:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4e00/0x4426598c0c77418d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae187 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047304.291926:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4e00/0x4426598c0c77418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae187 expref: 7 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047304.291940:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4e00/0x4426598c0c77418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae187 expref: 7 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047304.291953:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4e00, rc 0) 00000100:00100000:0.0:1784047304.292022:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689411328:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 383us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047304.292029:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:0.0:1784047304.301449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047304.302064:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411456 00000100:00100000:2.0:1784047304.302077:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411456 00000100:00100000:2.0:1784047304.302160:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:2.0:1784047304.302174:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689411456:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047304.302384:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689411456:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 212us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047304.302403:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:3.0:1784047304.306415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047304.306793:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411584 00000100:00100000:1.0:1784047304.306807:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411584 00000100:00100000:1.0:1784047304.306889:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:1.0:1784047304.306903:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689411584:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047304.307109:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689411584:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 198us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047304.307119:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:3.0:1784047304.308149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047304.311779:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689404672 00000100:00100000:0.0:1784047304.311803:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689404672 00000100:00100000:0.0:1784047304.312399:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1134 00000100:00100000:0.0:1784047304.312415:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689404672:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00080000:0.0:1784047304.312446:0:66220:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:0.0:1784047304.312479:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689404672:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 68us (4341us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047304.312489:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1134 00010000:00080000:3.0:1784047304.312549:0:87119:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1784047304.314685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047304.315008:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411712 00000100:00100000:0.0:1784047304.315020:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411712 00000100:00100000:0.0:1784047304.315141:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:0.0:1784047304.315153:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689411712:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047304.315176:0:87091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047304.315203:0:87091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24bc00/0x4426598c0c774194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae18e expref: -99 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047304.315244:0:87091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24bc00/0x4426598c0c774194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae18e expref: 9 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047304.315260:0:87091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24bc00/0x4426598c0c774194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae18e expref: 9 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047304.315271:0:87091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24bc00, rc 0) 00000100:00100000:0.0:1784047304.315355:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689411712:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 205us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047304.315363:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:3.0:1784047304.318695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047304.318913:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411840 00000100:00100000:1.0:1784047304.318927:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411840 00000100:00100000:1.0:1784047304.319027:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:1.0:1784047304.319039:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689411840:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047304.320142:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689411840:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 1090us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047304.321058:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:0.0:1784047304.329273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047304.329409:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689411968 00000100:00100000:1.0:1784047304.329423:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689411968 00000100:00100000:1.0:1784047304.329494:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:1.0:1784047304.329512:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689411968:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047304.329731:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689411968:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 221us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047304.329741:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:2.0:1784047304.342657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047304.342739:0:87097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412096 00000100:00100000:3.0:1784047304.342755:0:87097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412096 00000100:00100000:3.0:1784047304.342830:0:87097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:3.0:1784047304.342841:0:87097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcafa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689412096:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047304.342857:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047304.342877:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419c00/0x4426598c0c77419b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae195 expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047304.343178:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419c00/0x4426598c0c77419b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae195 expref: 10 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047304.343192:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419c00/0x4426598c0c77419b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae195 expref: 10 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047304.343216:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419c00, rc 0) 00000100:00100000:3.0:1784047304.343291:0:87097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcafa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689412096:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 451us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047304.343298:0:87097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:0.0:1784047304.349700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047304.349913:0:87091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412224 00000100:00100000:1.0:1784047304.349930:0:87091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412224 00000100:00100000:1.0:1784047304.350024:0:87091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:1.0:1784047304.350038:0:87091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcafa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689412224:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047304.350994:0:87091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcafa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689412224:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 952us (1304us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047304.351008:0:87091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 70 00010000:00010000:0.0:1784047304.979979:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047306.009311:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.026731:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784047307.240016:0:87370:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784047307.399742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047307.399797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047307.399860:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412352 00000100:00100000:3.0:1784047307.399870:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412352 00000100:00100000:3.0:1784047307.399939:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:3.0:1784047307.399950:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689412352:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047307.400030:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689412352:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047307.400051:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:0.0:1784047307.400221:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412480 00000100:00100000:0.0:1784047307.400227:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412480 00000100:00100000:0.0:1784047307.400285:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1117 00000100:00100000:0.0:1784047307.400293:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689412480:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047307.400335:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689412480:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 43us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047307.400341:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1117 00000100:00080000:3.0:1784047307.400559:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047307.540817:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047307.540824:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047307.540827:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047307.540834:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1784047307.540838:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047307.540845:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047307.540928:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edd880 x1870705709213184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047307.540961:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047307.540971:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047307.540973:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047307.540977:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1784047307.540979:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047307.540983:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047307.540995:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9eddf80 x1870705709213440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047307.541017:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047307.541020:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047307.541022:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047307.541025:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1784047307.541027:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047307.541030:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047307.541052:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9eded80 x1870705709213696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047307.541072:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047307.541075:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047307.541077:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047307.541080:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1784047307.541082:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047307.541085:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047307.541095:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edca80 x1870705709214080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047307.541117:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784047307.541124:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047307.541126:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047307.541131:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbc1d87800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047307.541141:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c14700 x1870705709214592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047307.541372:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709213056:0@lo:400:kworker.0 00000100:00100000:0.0:1784047307.541437:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709213184:0@lo:38:kworker.0 00000100:00100000:3.0:1784047307.541444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047307.541470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.541483:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709213952:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.541508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.541527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709214720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047307.541702:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709213440:0@lo:38:kworker.0 00000100:00100000:0.0:1784047307.541732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047307.541754:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709213696:0@lo:38:kworker.0 00000100:00100000:0.0:1784047307.541778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047307.541798:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709214080:0@lo:38:kworker.0 00000100:00100000:0.0:1784047307.541820:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047307.541836:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709214592:0@lo:38:kworker.0 00000100:00100000:2.0:1784047307.541845:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213696 00000100:00100000:2.0:1784047307.541855:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213696 00000100:00100000:0.0:1784047307.541859:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047307.541968:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1784047307.541977:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709213696:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047307.542007:0:8441:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99ccf7571000, cookie 0x4426598c0c77400c 00010000:00080000:2.0:1784047307.542012:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff99ccf7571000 cur 3405 last 1784047302 00000004:00100000:2.0:1784047307.542031:0:8441:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784047307.542137:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213184 00000100:00100000:0.0:1784047307.542142:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213184 00000100:00100000:0.0:1784047307.542167:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213440 00000100:00100000:0.0:1784047307.542170:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213440 00000100:00100000:0.0:1784047307.542183:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214080 00000100:00100000:0.0:1784047307.542185:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214080 00000100:00100000:0.0:1784047307.542198:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214592 00000100:00100000:0.0:1784047307.542208:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214592 00000100:00100000:0.0:1784047307.542231:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784047307.542236:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709213184:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1784047307.542246:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccc5024800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1784047307.542254:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3405 last 0 00000020:00000080:0.0:1784047307.542294:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c7741a2 00000100:00100000:2.0:1784047307.542298:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709213696:12345-0@lo:38:kworker.0 Request processed in 321us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047307.542305:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000004:00100000:0.0:1784047307.542307:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047307.542349:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047307.542390:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709213184:12345-0@lo:38:kworker.0 Request processed in 153us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047307.542398:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784047307.542415:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1784047307.542419:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709213440:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047307.542432:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3405 last 0 00000020:00000080:0.0:1784047307.542454:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4426598c0c7741a9 00000004:00100000:0.0:1784047307.542460:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047307.542474:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047307.542688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.542713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784047307.542719:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709213312:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.542743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.542756:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709214208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.542775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.542804:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709213568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.542830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.542841:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709214336:0@lo:400:kworker.0 00000100:00100000:1.0:1784047307.542886:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213312 00000100:00100000:1.0:1784047307.542891:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213312 00000100:00100000:1.0:1784047307.542924:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213568 00000100:00100000:1.0:1784047307.542927:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213568 00000100:00100000:1.0:1784047307.542942:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1784047307.542947:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709213312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047307.542993:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709213312:12345-0@lo:400:kworker.0 Request processed in 44us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.543000:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1784047307.543015:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1784047307.543021:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709213568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047307.543064:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709213568:12345-0@lo:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.543079:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1784047307.543092:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1784047307.543096:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709214080:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784047307.543111:0:67153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3405 last 0 00000020:00000080:1.0:1784047307.543137:0:67153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4426598c0c7741b0 00000004:00100000:1.0:1784047307.543145:0:67153:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047307.543166:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccebeb8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047307.543201:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870705709214080:12345-0@lo:38:kworker.0 Request processed in 103us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.543207:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1784047307.543224:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1784047307.543229:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709214592:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784047307.543242:0:67153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3405 last 0 00000020:00000080:1.0:1784047307.543265:0:67153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4426598c0c7741b7 00000004:00100000:1.0:1784047307.543272:0:67153:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047307.543286:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccebeb9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047307.543313:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709214592:12345-0@lo:38:kworker.0 Request processed in 83us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.543318:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1784047307.543371:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214720 00000100:00100000:1.0:1784047307.543375:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214720 00000100:00100000:1.0:1784047307.543397:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214208 00000100:00100000:1.0:1784047307.543400:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214208 00000100:00100000:1.0:1784047307.543413:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1784047307.543418:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3647:x1870705709214720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047307.543453:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047307.544082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.544139:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709213568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.544155:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784047307.544164:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709213824:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.544198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.544229:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709214464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.544268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.544313:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213056 00000100:00100000:3.0:1784047307.544318:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213056 00000100:00100000:3.0:1784047307.544354:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784047307.544362:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcafa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709213056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047307.544383:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213952 00000100:00100000:2.0:1784047307.544388:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213952 00000100:00100000:3.0:1784047307.544406:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcafa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709213056:12345-0@lo:400:kworker.0 Request processed in 44us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047307.544415:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784047307.544416:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214336 00000100:00100000:2.0:1784047307.544419:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214336 00000100:00100000:2.0:1784047307.544434:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709213824 00000100:00100000:2.0:1784047307.544436:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709213824 00000100:00100000:3.0:1784047307.544458:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214464 00000100:00100000:3.0:1784047307.544463:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214464 00000100:00100000:2.0:1784047307.544651:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:2.0:1784047307.544660:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709213952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047307.544691:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709213952:12345-0@lo:400:kworker.0 Request processed in 33us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047307.545228:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:3.0:1784047307.545251:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:2.0:1784047307.545259:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1784047307.545264:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709214336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047307.545271:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709213824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.545319:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709214336:12345-0@lo:400:kworker.0 Request processed in 60us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047307.545326:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1784047307.545340:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:3.0:1784047307.545346:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709214464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.545376:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709214464:12345-0@lo:400:kworker.0 Request processed in 30us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047307.545382:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:2.0:1784047307.545393:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709213824:12345-0@lo:400:kworker.0 Request processed in 126us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047307.545399:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00010000:00080000:3.0:1784047307.545406:0:87119:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784047307.545413:0:87119:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 103079215109 00000020:00080000:3.0:1784047307.545418:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.545422:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:3.0:1784047307.545427:0:87119:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:3.0:1784047307.545429:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.545447:0:87119:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689404672 t103079215109 from 192.168.204.40@tcp req@ffff99cbc9edf480 x1870705689404672/t0(103079215109) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:435/0 lens 528/0 e 0 to 0 dl 1784047315 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047307.545468:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870705709213440:12345-0@lo:38:kworker.0 Request processed in 2725us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047307.545476:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1784047307.545533:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00010000:00080000:0.0:1784047307.545835:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9edd880 x1870705709213184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.545850:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00100000:1.0:1784047307.546161:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3647:x1870705709214720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.546169:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00080000:1.0:1784047307.546194:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047307.546199:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047307.546202:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047307.546469:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709213312:0@lo:400:kworker.0 00000100:00100000:1.0:1784047307.546481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709213056:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.547593:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709214208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.547691:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709214208:12345-0@lo:400:kworker.0 Request processed in 2149us (4914us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047307.547701:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:1.0:1784047307.547718:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709213952:0@lo:400:kworker.0 00000100:00100000:1.0:1784047307.547739:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709214720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047307.547757:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709213824:0@lo:400:kworker.0 00000100:00100000:1.0:1784047307.547766:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709214208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.547770:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709214464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047307.547781:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709214336:0@lo:400:kworker.0 00000004:00080000:3.0:1784047307.547801:0:87119:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2303us 00000100:00080000:0.0:1784047307.549692:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99cbc9edd880 x1870705709213184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047332 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.549705:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047307.549711:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047307.549722:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047307.549727:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709213184:0@lo:38:kworker.0 00010000:00080000:0.0:1784047307.549758:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9eddf80 x1870705709213440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.549773:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000001:00100000:1.0:1784047307.553290:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1784047307.554625:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99cbc9eddf80 x1870705709213440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047332 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.554638:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047307.554645:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047307.554651:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047307.554658:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709213440:0@lo:38:kworker.0 00000100:00080000:0.0:1784047307.554697:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:0.0:1784047307.554707:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784047307.554711:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1784047307.554714:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:0.0:1784047307.554718:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc6531800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:0.0:1784047307.554721:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000001:00100000:1.0:1784047307.555582:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784047307.558340:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709213696:0@lo:38:kworker.0 00010000:00080000:0.0:1784047307.558383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9edca80 x1870705709214080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.558403:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00010000:00080000:3.0:1784047307.558659:0:87391:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784047307.558664:0:87391:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784047307.558669:0:87391:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1784047307.559658:0:87391:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1784047307.562888:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99cbc9edca80 x1870705709214080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047332 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.562902:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047307.562918:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047307.562923:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047307.562929:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709214080:0@lo:38:kworker.0 00010000:00080000:0.0:1784047307.562963:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ccf2c14700 x1870705709214592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.562981:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:0.0:1784047307.562990:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784047307.562995:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784047307.562997:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784047307.563001:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709214592:0@lo:38:kworker.0 00000100:00100000:0.0:1784047307.563060:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709214848:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784047307.563124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047307.564299:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.564321:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.564337:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.564350:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.564368:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.564375:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565829:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565842:0:87119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565848:0:87119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565853:0:87119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047307.565856:0:87119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565863:0:87119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565878:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccef54bc00) 00010000:00010000:3.0:1784047307.565880:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047307.565885:0:87119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565891:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c7741be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047307.565919:0:87119:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a142331d reply state 00000000c5c20733 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565941:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.565948:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccef54ba00) 00010000:00010000:3.0:1784047307.565951:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047307.565954:0:87119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784047307.566107:0:87119:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1784047307.566130:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.566133:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:3.0:1784047307.566137:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.566139:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000100:00100000:3.0:1784047307.566904:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214848 00000100:00100000:3.0:1784047307.566915:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214848 00000100:00100000:3.0:1784047307.566968:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:3.0:1784047307.566976:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709214848:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784047307.567092:0:83733:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cce3d22d80 x1870705709214848/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:438/0 lens 224/0 e 0 to 0 dl 1784047318 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047307.567110:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709214848:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 135us (3986us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047307.567117:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000020:00080000:3.0:1784047307.567202:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.567206:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000100:00100000:3.0:1784047307.570578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047307.570635:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689405184 00000100:00100000:3.0:1784047307.570644:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689405184 00000100:00100000:3.0:1784047307.570703:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1139 00000100:00100000:3.0:1784047307.570722:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689405184:12345-192.168.204.40@tcp:36:rm.0 00010000:00080000:3.0:1784047307.570743:0:67153:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:3.0:1784047307.570756:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689405184:12345-192.168.204.40@tcp:36:rm.0 Request processed in 39us (187us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047307.570763:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1139 00000020:00080000:3.0:1784047307.570784:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.570787:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:3.0:1784047307.570791:0:87119:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:3.0:1784047307.570795:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.570804:0:87119:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689405184 t103079215110 from 192.168.204.40@tcp req@ffff99ccf2c17b80 x1870705689405184/t0(103079215110) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:438/0 lens 512/0 e 0 to 0 dl 1784047318 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784047307.570888:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.570904:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.570916:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.570928:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.570935:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.570941:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571049:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571058:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571065:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571283:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571292:0:87119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571299:0:87119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571305:0:87119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047307.571309:0:87119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571550:0:87119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571562:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff99ccef54b300) 00010000:00010000:3.0:1784047307.571566:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784047307.571570:0:87119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571576:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7741da lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571602:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571641:0:87119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571648:0:87119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571653:0:87119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047307.571657:0:87119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571663:0:87119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571671:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccef54b200) 00010000:00010000:3.0:1784047307.571673:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047307.571676:0:87119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571681:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047307.571693:0:87119:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b357ff25 reply state 0000000095025a87 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571705:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.571711:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccef54ba00) 00010000:00010000:3.0:1784047307.571719:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047307.571722:0:87119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784047307.571791:0:87119:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784047307.571808:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.571810:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:3.0:1784047307.571814:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.571816:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000001:00100000:0.0:1784047307.577159:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784047307.578310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047307.579150:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406336 00000100:00100000:0.0:1784047307.579161:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406336 00000100:00100000:0.0:1784047307.579224:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1140 00000100:00100000:0.0:1784047307.579235:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689406336:12345-192.168.204.40@tcp:101:touch.0 00010000:00080000:0.0:1784047307.579267:0:66221:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:0.0:1784047307.579284:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689406336:12345-192.168.204.40@tcp:101:touch.0 Request processed in 51us (982us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047307.579292:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1140 00000020:00080000:2.0:1784047307.579308:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047307.579377:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:2.0:1784047307.579383:0:87119:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:2.0:1784047307.579387:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047307.579397:0:87119:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689406336 t103079215111 from 192.168.204.40@tcp req@ffff99ccc482c700 x1870705689406336/t0(103079215111) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:438/0 lens 752/0 e 0 to 0 dl 1784047318 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784047307.579419:0:87119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047307.579574:0:87119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7741e1 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae179 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.579825:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.579838:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.579849:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.579862:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.579869:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.579875:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047307.580424:0:87119:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x4426598c0c773f72 00000004:00080000:2.0:1784047307.580427:0:87119:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x4426598c0c773f72 in new mfd 00010000:00010000:2.0:1784047307.580437:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580549:0:87119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580557:0:87119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580563:0:87119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047307.580568:0:87119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580573:0:87119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580583:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccec0f1400) 00010000:00010000:2.0:1784047307.580585:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047307.580588:0:87119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580592:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7741e8 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047307.580601:0:87119:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061ed464a reply state 00000000fe07327f transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580636:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580654:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99ccec0f1700) 00010000:00010000:2.0:1784047307.580656:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047307.580658:0:87119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047307.580681:0:87119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7741e1 lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580696:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccec0f1400) 00010000:00010000:2.0:1784047307.580698:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047307.580702:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7741e1 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae179 expref: 12 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.580713:0:87119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0200, rc 0) 00010000:00080000:2.0:1784047307.581312:0:87119:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784047307.581332:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047307.581335:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:2.0:1784047307.581339:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047307.581341:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:3.0:1784047307.619555:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047307.619848:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406592 00000100:00100000:0.0:1784047307.619864:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406592 00000100:00100000:0.0:1784047307.619938:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1141 00000100:00100000:0.0:1784047307.619953:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:2398:x1870705689406592:12345-192.168.204.40@tcp:36:touch.0 00010000:00080000:0.0:1784047307.620007:0:68026:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:0.0:1784047307.620093:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:2398:x1870705689406592:12345-192.168.204.40@tcp:36:touch.0 Request processed in 145us (551us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047307.620102:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1141 00000020:00080000:2.0:1784047307.621899:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047307.621907:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:2.0:1784047307.621913:0:87119:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:2.0:1784047307.621916:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047307.621929:0:87119:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689406592 t103079215112 from 192.168.204.40@tcp req@ffff99ccf2c14000 x1870705689406592/t0(103079215112) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:438/0 lens 488/0 e 0 to 0 dl 1784047318 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784047307.622852:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.622871:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.622883:0:87119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047307.623276:0:87119:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be00a7e4 reply state 00000000be2bb3c0 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.623293:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.623302:0:87119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99ccef54b200) 00010000:00010000:3.0:1784047307.623305:0:87119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047307.623309:0:87119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784047307.623423:0:87119:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784047307.623443:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.623446:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:3.0:1784047307.623450:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.623452:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1784047307.634743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047307.637166:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689406976 00000100:00100000:2.0:1784047307.637180:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689406976 00000100:00100000:2.0:1784047307.637247:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 219 00000100:00100000:2.0:1784047307.637272:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+14:2398:x1870705689406976:12345-192.168.204.40@tcp:35:touch.0 00010000:00080000:2.0:1784047307.637293:0:66223:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:2.0:1784047307.637793:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+14:2398:x1870705689406976:12345-192.168.204.40@tcp:35:touch.0 Request processed in 520us (4470us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047307.637803:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 219 00000020:00080000:3.0:1784047307.644824:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.644834:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:3.0:1784047307.644840:0:87119:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:3.0:1784047307.644843:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.644858:0:87119:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689406976 t103079215113 from 192.168.204.40@tcp req@ffff99ccf2c14a80 x1870705689406976/t0(103079215113) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:438/0 lens 392/0 e 0 to 0 dl 1784047318 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047307.645141:0:87119:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784047307.645159:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.645161:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:3.0:1784047307.645164:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047307.645166:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:2.0:1784047307.651273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047307.651592:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412608 00000100:00100000:3.0:1784047307.651602:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412608 00000100:00100000:3.0:1784047307.651683:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1120 00000100:00100000:3.0:1784047307.651706:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+15:2398:x1870705689412608:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784047307.651732:0:66219:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99ccc482ca80 x1870705689412608/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:438/0 lens 224/0 e 0 to 0 dl 1784047318 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047307.651762:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+15:2398:x1870705689412608:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 Request processed in 58us (498us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047307.651769:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1120 00000020:00080000:1.0:1784047307.652019:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047307.652024:0:87119:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:1.0:1784047307.652027:0:87119:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1784047307.652030:0:87119:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047307.652046:0:87119:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047307.652049:0:87119:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1784047307.652161:0:87119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:3.0:1784047307.655027:0:87086:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00100000:3.0:1784047307.655048:0:87086:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784047307.655081:0:87086:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00000001:00080000:2.0:1784047307.655197:0:87119:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1784047307.655240:0:87119:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1784047307.655258:0:87119:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99cce3d22d80 x1870705709214848/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:438/0 lens 224/0 e 0 to 0 dl 1784047318 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784047307.655388:0:87119:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.40@tcp: req@ffff99ccc482ca80 x1870705689412608/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:438/0 lens 224/0 e 0 to 0 dl 1784047318 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1784047307.655451:0:87119:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1784047307.655813:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784047307.655823:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99ccf2c17480 x1870705709214848/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047323 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.655831:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99ccf2c17480 x1870705709214848/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047323 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047307.655838:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047307.655848:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047307.655853:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709214848:0@lo:400:ldlm_lock_repla.0 00010000:00010000:1.0:1784047307.656538:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656551:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656586:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656592:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047307.656597:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656636:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656656:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccef54ba00) 00010000:00010000:1.0:1784047307.656659:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047307.656664:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656671:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418200/0x4426598c0c7741c5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656705:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656712:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656717:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656722:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047307.656725:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656741:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656750:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccef54ba00) 00010000:00010000:1.0:1784047307.656752:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047307.656755:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656760:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c7741d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656778:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656784:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656788:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656793:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047307.656795:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656801:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656807:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99ccec0f1700) 00010000:00010000:1.0:1784047307.656809:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047307.656812:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656824:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7741ef lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656841:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656847:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656851:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656855:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047307.656858:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656876:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656883:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99ccef54b200) 00010000:00010000:1.0:1784047307.656885:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047307.656888:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.656894:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c7741fd lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047307.657518:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047307.657535:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709214976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047307.657601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.657880:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709214976 00000100:00100000:3.0:1784047307.657897:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709214976 00000100:00100000:3.0:1784047307.657951:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1784047307.657960:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709214976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047307.657991:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:3.0:1784047307.658050:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709214976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047307.658057:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1784047307.658098:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709214976:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1784047307.715554:0:87119:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc914846be10 00100000:10000000:0.0:1784047307.715575:0:87119:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1784047307.717974:0:87105:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:2.0:1784047307.718047:0:87105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87105:1870705709215104:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784047307.718147:0:87105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047307.718183:0:87105:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047307.718335:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215104 00000100:00100000:1.0:1784047307.718345:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215104 00000100:00100000:1.0:1784047307.718492:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1784047307.718505:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:87105:x1870705709215104:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784047307.718557:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -593 00002000:02000040:1.0:1784047307.718563:0:8431:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1793) 00000004:00080000:2.0:1784047307.719465:0:87107:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1784047307.719512:0:87107:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87107:1870705709215232:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784047307.719577:0:87107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047307.719634:0:87107:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047307.719737:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215232 00000100:00100000:0.0:1784047307.719745:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215232 00000100:00100000:0.0:1784047307.719781:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4949 00000100:00100000:0.0:1784047307.719790:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:87107:x1870705709215232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784047307.719814:0:26186:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -95 00002000:02000040:0.0:1784047307.719819:0:26186:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1793) 00002000:00010000:1.0:1784047307.740945:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.740963:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.740987:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.740993:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.741001:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741022:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741043:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741052:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741076:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.741092:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.741099:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741107:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.741129:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741140:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741190:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741199:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a19d3b/0x4426598c0c774204 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741231:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.741234:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.741245:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.741463:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.741469:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741498:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.741502:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.741506:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741515:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741522:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741536:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741551:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.741560:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.741586:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741602:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.741639:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741648:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741676:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741685:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d7a16ff/0x4426598c0c77420b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741699:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.741701:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.741702:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.741777:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.741806:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741816:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.741819:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.741823:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741832:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741841:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741847:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741863:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.741871:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.741876:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741883:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.741887:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741894:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741911:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741919:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb65a5e/0x4426598c0c774212 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.741935:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.741937:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.741938:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.741986:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.741992:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742000:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.742003:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.742008:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742018:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742026:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742045:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742071:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.742080:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.742085:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742093:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.742096:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742104:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742115:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742123:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f8d1c25/0x4426598c0c774219 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742135:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742137:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742139:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.742183:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.742188:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742196:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.742205:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.742210:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742219:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742249:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742286:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742314:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.742323:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.742328:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742351:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.742354:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742362:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742373:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742391:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009547d888/0x4426598c0c774220 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742406:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742408:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742409:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.742491:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.742510:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742529:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.742532:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.742537:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742546:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742553:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742574:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742589:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.742596:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.742627:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742635:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.742638:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742647:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742658:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742665:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b938b16e/0x4426598c0c774227 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742678:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742680:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742681:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.742725:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.742730:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742738:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.742741:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.742745:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742766:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742774:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742782:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742796:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.742819:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.742823:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742830:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.742834:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742842:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742853:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742860:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea1f41e/0x4426598c0c77422e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742881:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742883:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.742885:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.742960:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.742965:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742974:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.742977:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.742981:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742990:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.742997:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743005:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743024:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.743055:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.743060:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743091:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6dc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.743094:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743114:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743127:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743133:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d62344fa/0x4426598c0c774235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743158:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.743160:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.743162:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.743233:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.743238:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743257:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.743260:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.743265:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743274:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743303:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743311:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743340:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.743348:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.743351:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743358:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6cc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.743361:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743368:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743380:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743387:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f31d6b03/0x4426598c0c77423c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743401:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.743408:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.743410:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.743487:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.743493:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743501:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.743504:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.743507:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743515:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743522:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743529:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743541:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.743547:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.743551:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743557:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.743561:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743579:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743590:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743597:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fec9583/0x4426598c0c774243 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.743634:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.743636:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.743638:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.745096:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.745110:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745129:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.745134:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.745140:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745155:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745166:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745188:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745216:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.745234:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.745239:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745246:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.745251:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745260:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745277:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745284:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000851e6a43/0x4426598c0c77424a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745308:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.745310:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.745311:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.745746:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.745762:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745771:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.745774:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.745777:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745787:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745793:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745801:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745816:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.745825:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.745829:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745836:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.745839:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745847:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745934:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745943:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087f23f59/0x4426598c0c774251 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.745963:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.745965:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.745967:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.746020:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.746026:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746046:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.746049:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.746054:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746063:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746082:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746089:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746122:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047307.746159:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1784047307.746171:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047307.746173:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746182:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.746205:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6da00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.746211:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:3.0:1784047307.746214:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746219:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.746234:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.746239:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746257:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746268:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.746273:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746277:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.746306:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007884354b/0x4426598c0c774258 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746320:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.746334:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.746341:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.746343:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.746351:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.746361:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.746367:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.746368:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746379:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746393:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746400:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f22a9316/0x4426598c0c77425f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746417:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.746419:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.746420:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.746470:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.746475:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746483:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=3405s v=(0 0) 00010000:00010000:1.0:1784047307.746486:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.746490:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746499:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746507:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.746521:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.749503:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047307.749879:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047307.749893:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.749927:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ce00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047307.749933:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.749945:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.749976:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.749985:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcee650c/0x4426598c0c774266 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.750018:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.750020:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.750022:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.751833:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.751845:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751864:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.751868:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.751875:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751889:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751899:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751906:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751925:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.751936:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.751942:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751955:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.751959:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751967:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751981:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.751987:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c77426d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.752007:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.752009:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.752011:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.752773:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.752784:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.752806:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.752810:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.752815:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.752829:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.752837:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.752845:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.752865:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047307.753176:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.753183:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.753193:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.753198:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.753203:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.753214:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753215:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.753225:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753237:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.753242:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753257:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.753261:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.753282:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753292:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753301:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c774274 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.753305:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.753320:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.753324:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753331:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.753333:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753340:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753349:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753355:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.753357:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.753358:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.753573:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.753581:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753599:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.753603:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.753626:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753638:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753645:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753653:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753671:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.753682:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.753688:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753696:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.753701:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753712:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753741:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753748:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774282 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753771:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.753777:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.753779:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.753833:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.753839:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753847:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.753850:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.753855:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753876:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753885:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753892:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753926:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.753934:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.753939:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753947:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.753950:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753959:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753972:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.753979:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774289 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754003:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754006:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754008:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.754069:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.754075:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754083:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.754093:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.754097:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754106:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754114:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754121:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754132:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.754140:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.754144:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754152:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.754155:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754162:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754171:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754189:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774290 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754208:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754210:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754211:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.754262:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.754269:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754277:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.754280:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.754284:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754296:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754304:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754312:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754330:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.754338:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.754348:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754355:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.754358:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754366:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754377:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754385:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774297 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754406:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754410:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754412:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.754459:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.754465:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754473:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.754476:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.754480:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754502:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754511:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754518:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754532:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.754541:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.754544:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754551:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.754554:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754562:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754573:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754580:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c77429e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754603:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754635:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.754638:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.754691:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.754698:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754706:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.754709:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.754713:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754722:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754730:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754737:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754760:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047307.754802:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.754807:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754826:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.754829:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.754833:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754843:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754850:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754856:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754870:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047307.754879:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047307.754882:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754888:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.754892:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754899:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754936:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754943:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c7742a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754958:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.754962:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754968:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.754971:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754978:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754989:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.754996:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c7742ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755010:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c77427b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755012:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755015:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755028:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.755045:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.755058:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.755092:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.755099:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755107:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.755110:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.755115:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755124:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755131:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755138:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755163:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047307.755212:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.755219:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755226:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.755229:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.755233:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.755235:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.755245:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755267:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.755273:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755273:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.755281:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755286:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755302:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755302:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755317:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047307.755324:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047307.755335:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755338:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.755338:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755349:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755389:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.755391:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047307.755400:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755401:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755446:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755460:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755473:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755474:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c7742ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755498:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755503:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755507:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755510:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.755515:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c7742b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755557:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047307.755559:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.755573:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755573:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755580:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047307.755590:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755592:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047307.755637:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047307.755646:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755650:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.755675:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.755676:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.755681:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.755687:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755690:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755725:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.755737:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.755738:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755745:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755750:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755760:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755769:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.755772:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755782:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755783:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047307.755793:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755794:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.755802:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.755812:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047307.755823:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.755824:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.755829:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755831:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755843:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755855:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755863:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7742c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755880:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755882:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755884:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.755901:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755913:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c7742c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047307.755930:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.755940:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.755944:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.755948:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.755954:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.755955:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.755960:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.755965:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755974:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.755993:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.756000:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.756015:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.756025:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.756094:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.756098:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756107:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756119:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756127:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c7742cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.756147:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.756149:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.756203:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.756208:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756216:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.756219:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.756224:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756846:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756869:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756877:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.756968:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047307.757047:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.757054:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757064:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.757067:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.757072:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757082:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757089:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757097:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757123:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047307.757168:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.757175:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757184:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.757187:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.757191:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757201:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757209:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757216:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.757234:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784047307.758656:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784047307.758664:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758678:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.758693:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758704:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758721:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758729:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c7742dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758763:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047307.758767:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758773:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.758776:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758784:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758792:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758799:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c7742e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758817:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.758820:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758827:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.758830:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758837:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758845:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758851:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c7742eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758861:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.758863:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.758865:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.758967:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.758974:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.758985:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.758994:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.759001:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759013:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759021:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759028:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759059:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047307.759068:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.759072:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759079:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.759083:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759090:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759101:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759118:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c7742f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759132:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759133:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759135:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.759173:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.759178:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759186:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.759189:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.759193:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759202:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759209:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759217:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759228:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047307.759250:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.759254:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759261:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24aa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.759264:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759272:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759282:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759289:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c7742f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759301:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759303:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759304:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.759350:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.759355:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759364:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.759367:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.759372:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759392:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759401:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759408:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759422:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.759425:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759432:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.759438:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759444:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.759447:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.759452:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759453:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759478:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759479:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759505:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759510:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759516:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774300 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759523:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c7742d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759540:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759543:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759546:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.759592:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.759598:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759664:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.759667:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.759672:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759676:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759684:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759687:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.759691:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759697:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759700:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.759708:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759708:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759724:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047307.759734:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.759737:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759756:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.759760:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759768:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759779:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759786:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774307 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047307.759788:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.759800:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759808:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.759811:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.759812:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.759815:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.759818:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.759823:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759833:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759841:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759848:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.759862:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.759868:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759877:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.759880:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.759885:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759894:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759916:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759924:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.759945:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047307.759954:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047307.759959:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047307.759965:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.759966:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759971:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759986:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ae00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.759988:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.759990:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.759999:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760002:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760018:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760019:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760053:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760060:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c77430e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760248:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.760250:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.760252:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.760300:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.760306:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760314:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.760318:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.760322:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760331:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760338:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760355:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760370:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.760378:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.760382:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760390:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.760393:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760401:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760413:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760420:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77431c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760439:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.760441:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.760442:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.760487:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.760500:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760512:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774315 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760513:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.760536:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.760544:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.760546:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.760598:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.760604:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760660:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.760664:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.760668:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760676:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760684:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760690:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.760708:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047307.760745:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.760750:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760958:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.760966:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760977:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760986:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.760993:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761005:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.761009:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761016:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ba00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.761020:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761027:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761063:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761069:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c77432a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761492:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.761496:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.761501:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761522:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761531:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761538:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761558:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047307.761569:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.761574:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761581:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.761585:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761592:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761603:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761645:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c774331 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761675:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.761677:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.761679:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.761734:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.761737:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.761740:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.761752:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.761760:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.761764:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.761769:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.761773:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.761777:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761778:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761799:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.761801:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761805:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.761813:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761821:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761824:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.761845:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774323 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761846:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761863:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.761877:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047307.762543:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.762550:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762573:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.762577:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.762582:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762594:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762603:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762637:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762672:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047307.762676:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047307.762681:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762685:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.762693:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762694:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.762701:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762707:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbdc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.762713:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762716:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762731:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762739:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762755:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c774338 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762770:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.762772:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.762774:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.762781:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.762840:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.762846:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762854:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.762869:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762878:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebedc5ab/0x4426598c0c77433f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762947:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.762952:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762963:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.762966:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.762970:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.762974:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.762976:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.762985:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763003:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.763014:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.763018:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763027:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.763041:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763050:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763061:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.763075:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.763087:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774346 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.763088:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.763110:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.763114:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.763118:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763119:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.763122:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.763125:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.763134:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.763143:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.763151:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.763189:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.763195:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.763202:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763209:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.763215:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763223:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763238:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763245:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035452efd/0x4426598c0c77434d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763269:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.763271:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.763282:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047307.763296:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047307.763302:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763310:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:1.0:1784047307.763313:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.763316:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763325:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763333:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763339:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763353:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.763360:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.763363:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763370:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cea00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.763373:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763393:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763405:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763413:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c774354 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.763434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.763438:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.763440:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.763580:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.763587:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.763596:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.763599:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.764180:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.764198:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.764208:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.764216:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.765022:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047307.765065:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1784047307.765113:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.765120:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.765132:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:3.0:1784047307.765145:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.765167:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.765169:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047307.765177:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.765180:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.765210:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.765214:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.765258:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.765270:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9543aeb/0x4426598c0c77435b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.765298:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.765301:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.765304:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.766006:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.766016:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.766057:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047307.766130:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.766138:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.766149:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:3.0:1784047307.766152:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.766153:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047307.766165:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.766167:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.766202:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.766207:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.766210:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.766245:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.766260:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.766267:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c774362 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.766284:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.766286:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.766288:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.767009:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767042:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767073:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047307.767145:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.767152:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767163:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.767166:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.767171:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767181:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767188:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767195:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767219:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047307.767255:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047307.767265:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767275:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047307.767280:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767288:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767303:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767311:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1b23b2c/0x4426598c0c774369 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767331:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047307.767336:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767343:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047307.767357:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767364:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767375:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767382:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774370 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.767404:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.767407:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.767412:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.767643:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.767651:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767669:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.767674:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.767678:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767688:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767698:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767707:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767738:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047307.767751:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047307.767761:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.767770:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047307.767775:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.767784:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047307.767803:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.767804:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047307.767815:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767827:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.767835:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047307.767837:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afa8985/0x4426598c0c774377 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767840:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767861:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767882:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.767889:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.767899:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.768202:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.768205:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047307.768207:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.768865:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047307.768905:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047307.768915:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.768926:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.768930:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.768940:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.768959:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.768979:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef24f429/0x4426598c0c77437e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769009:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047307.769020:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047307.769026:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.769043:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.769043:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769059:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.769063:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047307.769069:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769081:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769089:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769096:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769126:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047307.769158:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047307.769166:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047307.769175:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047307.769176:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.769184:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769189:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769203:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769209:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:0.0:1784047307.769222:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047307.769229:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769230:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769243:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873ba3fb/0x4426598c0c774385 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769265:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.769268:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.769281:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.769385:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769396:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.769404:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.769507:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047307.769534:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047307.769541:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769550:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.769554:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769562:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769574:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769582:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004981cfd7/0x4426598c0c77438c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.769600:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.769601:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.769630:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047307.769678:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.769685:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.769695:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.769698:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.769702:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.769713:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.769733:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.769742:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.769994:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047307.770051:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.770057:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770065:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.770068:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.770071:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770080:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770088:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770095:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770159:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784047307.770219:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.770230:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770254:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.770258:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.770262:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770274:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770284:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.770292:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770596:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047307.770597:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047307.770665:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.770678:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.770678:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770695:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.770696:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770705:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770748:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.770764:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770810:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770819:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78e311e/0x4426598c0c774393 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770839:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047307.770842:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770849:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047307.770853:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770861:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770871:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047307.770878:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.770881:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047307.770890:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.771048:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047307.771054:0:26186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c11d7cc6/0x4426598c0c7743a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047307.771123:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.771128:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771142:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.771145:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.771151:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771161:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771168:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771175:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771191:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047307.771232:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.771248:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771256:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.771267:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.771272:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771280:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771283:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771313:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5dc1ddd/0x4426598c0c77439a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771390:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047307.771395:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771403:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.771407:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771416:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771428:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771445:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6f2561/0x4426598c0c7743a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771491:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.771525:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.771531:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.771535:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.771538:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047307.774434:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047307.775939:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047307.775953:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.775969:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.775974:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.775986:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.776009:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.776017:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031545298/0x4426598c0c7743af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.776056:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.776058:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.776060:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.776070:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047307.780147:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.780161:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780178:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.780184:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.780190:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780205:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780216:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780224:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780393:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047307.780440:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047307.780445:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780454:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=3406s v=(0 0) 00010000:00010000:2.0:1784047307.780457:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047307.780461:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780471:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780479:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780486:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047307.780498:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047307.780595:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047307.780603:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780637:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.780642:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780651:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780670:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780678:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4fcb6b5/0x4426598c0c7743b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780700:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047307.780704:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780712:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047307.780715:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780723:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780734:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780748:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000987142be/0x4426598c0c7743bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047307.780778:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.780781:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.780783:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047307.780791:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784047307.781649:0:26186:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00000100:00100000:2.0:1784047307.781748:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:87107:x1870705709215232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 61956us (62167us total) trans 0 rc 0/0 00010000:00010000:0.0:1784047307.782603:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047307.782726:0:87107:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87107:1870705709215232:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784047307.782744:0:87107:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:2.0:1784047307.782855:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4949 00000100:00100000:3.0:1784047307.783053:0:87107:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87107:1870705709215488:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784047307.783098:0:87107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.783123:0:87107:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e56480 going to sleep for 11 seconds 00000100:00100000:3.0:1784047307.783157:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215488 00000100:00100000:3.0:1784047307.783164:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215488 00000100:00100000:3.0:1784047307.783198:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950 00000100:00100000:3.0:1784047307.783207:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:87107:x1870705709215488:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784047307.783382:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709215360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047307.783421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047307.783460:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215360 00000100:00100000:2.0:1784047307.783464:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215360 00000100:00100000:2.0:1784047307.783488:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1784047307.783495:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709215360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047307.783514:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00002000:00080000:3.0:1784047307.783745:0:26187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:2.0:1784047307.783983:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709215360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 486us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047307.783990:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:0.0:1784047307.787443:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709215360:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1784047307.787777:0:8431:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:1.0:1784047307.787866:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:87105:x1870705709215104:12345-0@lo:5:osp-pre-0-0.0 Request processed in 69361us (69717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.787877:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4948 00000100:00100000:3.0:1784047307.787885:0:87105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87105:1870705709215104:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784047307.788934:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:87107:x1870705709215488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5724us (5832us total) trans 4294968750 rc 0/0 00000100:00100000:2.0:1784047307.788944:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950 00000004:00080000:3.0:1784047307.790419:0:87105:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:3.0:1784047307.790512:0:87105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87105:1870705709215744:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784047307.790569:0:87105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.790597:0:87105:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e56000 going to sleep for 11 seconds 00000100:00100000:3.0:1784047307.790642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047307.790661:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709215616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047307.790688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047307.790726:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215744 00000100:00100000:3.0:1784047307.790734:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215744 00000100:00100000:3.0:1784047307.790795:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4951 00000100:00100000:3.0:1784047307.790806:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:87105:x1870705709215744:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784047307.790848:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:1.0:1784047307.797120:0:87107:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87107:1870705709215488:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784047307.797144:0:87107:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00000100:00100000:3.0:1784047307.799222:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:87105:x1870705709215744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8336us (8570us total) trans 4294968750 rc 0/0 00000100:00100000:3.0:1784047307.799235:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4951 00000100:00100000:2.0:1784047307.799427:0:87105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87105:1870705709215744:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784047307.799447:0:87105:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00000100:00100000:1.0:1784047307.803647:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215616 00000100:00100000:1.0:1784047307.803662:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215616 00000100:00100000:1.0:1784047307.803725:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1784047307.803735:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709215616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047307.804878:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047307.805064:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709215616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1326us (14370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047307.805073:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1784047307.805664:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709215616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784047308.050782:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047308.053899:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709215872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047308.053974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047308.054044:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709215872 00000100:00100000:0.0:1784047308.054053:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709215872 00000100:00100000:0.0:1784047308.054098:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1784047308.054107:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709215872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047308.054131:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047308.054175:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709215872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047308.054182:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1784047308.054229:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709215872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047308.054576:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047308.054586:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709216000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047308.054636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047308.054851:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216000 00000100:00100000:1.0:1784047308.054856:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216000 00000100:00100000:1.0:1784047308.054892:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1784047308.054899:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709216000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047308.054912:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047308.054947:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709216000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047308.054954:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1784047308.056548:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709216000:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1784047308.252288:0:87425:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784047308.252557:0:87425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784047309.074770:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784047309.148222:0:87475:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047309.148519:0:87475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784047309.448317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047309.448422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047309.448467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047309.448520:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412736 00000100:00100000:3.0:1784047309.448531:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412736 00000100:00100000:3.0:1784047309.448595:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:3.0:1784047309.448632:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689412736:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047309.448716:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689412736:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047309.448724:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:1.0:1784047309.449873:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412864 00000100:00100000:1.0:1784047309.449883:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412864 00000100:00080000:0.0:1784047309.449934:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047309.449939:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689412992 00000100:00100000:1.0:1784047309.449943:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689412992 00000100:00080000:0.0:1784047309.449964:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047309.449973:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1121 00000100:00100000:1.0:1784047309.449982:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689412864:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047309.450052:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689412864:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 71us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047309.450059:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1121 00000100:00100000:1.0:1784047309.450075:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1122 00000100:00100000:1.0:1784047309.450082:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689412992:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047309.450185:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689412992:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047309.450193:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1122 00010000:00010000:1.0:1784047310.102484:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047310.839695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047310.840741:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413120 00000100:00100000:0.0:1784047310.840824:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413120 00000100:00100000:0.0:1784047310.840920:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1142 00000100:00100000:0.0:1784047310.840934:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413120:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047310.840963:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047310.841013:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7743c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae19c expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047310.841338:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7743cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047310.841356:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7743cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047310.841506:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7743cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047310.841579:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047310.841584:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047310.841715:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7743cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047310.841748:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7743c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae19c expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047310.841840:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7743cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae19c expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047310.841851:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6d00) 00010000:00010000:0.0:1784047310.841855:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047310.841859:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbce00, rc 0) 00000100:00100000:0.0:1784047310.842038:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:66732:x1870705689413120:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1106us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047310.842048:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1142 00000100:00100000:0.0:1784047310.848055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047310.848219:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413248 00000100:00100000:1.0:1784047310.848233:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413248 00000100:00100000:1.0:1784047310.848359:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1143 00000100:00100000:1.0:1784047310.848384:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:66732:x1870705689413248:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047310.848449:0:68026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:1.0:1784047310.848568:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:66732:x1870705689413248:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 197us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047310.848577:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1143 00000100:00100000:1.0:1784047310.852941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047310.853068:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413376 00000100:00100000:2.0:1784047310.853082:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413376 00000100:00100000:2.0:1784047310.853163:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1144 00000100:00100000:2.0:1784047310.853503:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413376:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047310.853559:0:67153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047310.853714:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413376:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 538us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047310.853723:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1144 00000100:00100000:0.0:1784047310.858906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047310.859096:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413504 00000100:00100000:2.0:1784047310.859110:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413504 00000100:00100000:2.0:1784047310.859320:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4952 00000100:00100000:2.0:1784047310.859341:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2398:x1870705689413504:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:2.0:1784047310.859396:0:26185:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3409 last 0 00000020:00000080:2.0:1784047310.859451:0:26185:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c7743d2 00002000:00100000:2.0:1784047310.859469:0:26185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99cbc753c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784047310.859494:0:26185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784047310.859591:0:26185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784047310.859658:0:26185:0:(import.c:65:import_set_state_nolock()) ffff99cbc753c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047310.859755:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689413504:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 415us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047310.859764:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4952 00000100:00100000:0.0:1784047310.862538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047310.862755:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413632 00000100:00100000:2.0:1784047310.862768:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413632 00000100:00100000:2.0:1784047310.862888:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1984 00000100:00100000:2.0:1784047310.862900:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413632:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047310.862935:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047310.863164:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413632:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 265us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047310.863173:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1984 00000100:00080000:0.0:1784047310.863230:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047310.865751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047310.865818:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413760 00000100:00100000:0.0:1784047310.865831:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413760 00000100:00100000:0.0:1784047310.865889:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4953 00000100:00100000:0.0:1784047310.865898:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1870705689413760:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:0.0:1784047310.866095:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3409 last 0 00000020:00000080:0.0:1784047310.866138:0:8433:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c7743d9 00002000:00100000:0.0:1784047310.866154:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99ccc6dae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047310.866295:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784047310.866397:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047310.866438:0:8433:0:(import.c:65:import_set_state_nolock()) ffff99ccc6daa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047310.866564:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689413760:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 664us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047310.866573:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4953 00000100:00100000:1.0:1784047310.869477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047310.869601:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689413888 00000100:00100000:2.0:1784047310.869691:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689413888 00000100:00100000:2.0:1784047310.869821:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1985 00000100:00100000:2.0:1784047310.869834:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413888:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047310.869868:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047310.869954:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:66732:x1870705689413888:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 123us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047310.869994:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1985 00000100:00080000:0.0:1784047310.872292:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047310.985489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047310.985548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047310.985583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047310.985715:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414016 00000100:00100000:0.0:1784047310.985728:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414016 00000100:00100000:0.0:1784047310.985806:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1145 00000100:00100000:0.0:1784047310.985817:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689414016:12345-192.168.204.40@tcp:17:kworker.0 00000100:00100000:0.0:1784047310.985941:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689414016:12345-192.168.204.40@tcp:17:kworker.0 Request processed in 126us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047310.985949:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1145 00000100:00100000:2.0:1784047310.987095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047310.987266:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414400 00000100:00100000:0.0:1784047310.987276:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414400 00000100:00100000:0.0:1784047310.987337:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1146 00000100:00100000:0.0:1784047310.987347:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689414400:12345-192.168.204.40@tcp:17:kworker.0 00000100:00100000:0.0:1784047310.987446:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689414400:12345-192.168.204.40@tcp:17:kworker.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047310.987454:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1146 00000100:00100000:1.0:1784047310.988704:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414272 00000100:00100000:1.0:1784047310.988719:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414272 00000100:00100000:1.0:1784047310.988837:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414144 00000100:00100000:1.0:1784047310.988841:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414144 00000100:00100000:1.0:1784047310.988887:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4954 00000100:00100000:1.0:1784047310.988897:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689414272:12345-192.168.204.40@tcp:17:kworker.0 00000100:00100000:1.0:1784047310.989036:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689414272:12345-192.168.204.40@tcp:17:kworker.0 Request processed in 140us (3486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047310.989044:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4954 00000100:00100000:1.0:1784047310.989289:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4955 00000100:00100000:1.0:1784047310.989297:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689414144:12345-192.168.204.40@tcp:17:kworker.0 00000100:00100000:1.0:1784047310.989340:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689414144:12345-192.168.204.40@tcp:17:kworker.0 Request processed in 43us (3755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047310.989346:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4955 00010000:00010000:3.0:1784047311.124085:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047312.148078:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047312.659192:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709216128:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.659295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.659344:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709216640:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.659390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.659410:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709217152:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.659431:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.659447:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709217664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.659474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661067:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784047312.661085:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709216256:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709216768:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661219:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709217280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661261:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709217792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047312.661279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661327:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709216384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661377:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709216896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661424:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709217408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661465:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784047312.661471:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709216512:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661505:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709217024:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661560:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709217536:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047312.661637:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216128 00000100:00100000:3.0:1784047312.661647:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216128 00000100:00100000:3.0:1784047312.661712:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784047312.661723:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709216128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.661786:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709216128:12345-0@lo:400:kworker.0 Request processed in 64us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.661794:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784047312.661834:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216640 00000100:00100000:3.0:1784047312.661838:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216640 00000100:00100000:3.0:1784047312.661874:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217152 00000100:00100000:3.0:1784047312.661879:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217152 00000100:00100000:3.0:1784047312.661893:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217664 00000100:00100000:3.0:1784047312.661895:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217664 00000100:00100000:3.0:1784047312.661905:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216256 00000100:00100000:3.0:1784047312.661907:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216256 00000100:00100000:3.0:1784047312.661920:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216384 00000100:00100000:3.0:1784047312.661922:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216384 00000100:00100000:3.0:1784047312.661935:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216512 00000100:00100000:3.0:1784047312.661949:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216512 00000100:00100000:3.0:1784047312.661967:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1784047312.661973:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709216640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662010:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709216640:12345-0@lo:400:kworker.0 Request processed in 36us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662017:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1784047312.662029:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1784047312.662036:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709217152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662072:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709217152:12345-0@lo:400:kworker.0 Request processed in 37us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662079:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1784047312.662091:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1784047312.662097:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709217664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662123:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709217664:12345-0@lo:400:kworker.0 Request processed in 26us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662129:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1784047312.662139:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1784047312.662144:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709216256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662171:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709216256:12345-0@lo:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662178:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1784047312.662192:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1784047312.662197:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709216384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662229:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709216384:12345-0@lo:400:kworker.0 Request processed in 32us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662236:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1784047312.662251:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784047312.662258:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709216512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662284:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709216512:12345-0@lo:400:kworker.0 Request processed in 27us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662290:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784047312.662318:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216768 00000100:00100000:3.0:1784047312.662322:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216768 00000100:00100000:3.0:1784047312.662356:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217280 00000100:00100000:3.0:1784047312.662359:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217280 00000100:00100000:3.0:1784047312.662369:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217792 00000100:00100000:3.0:1784047312.662371:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217792 00000100:00100000:3.0:1784047312.662381:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1784047312.662386:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709216768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662419:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709216768:12345-0@lo:400:kworker.0 Request processed in 33us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662426:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1784047312.662437:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1784047312.662442:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709217280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662470:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709217280:12345-0@lo:400:kworker.0 Request processed in 28us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662477:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1784047312.662487:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1784047312.662492:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709217792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047312.662520:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:3.0:1784047312.662548:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709217792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662555:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1784047312.662591:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709216896 00000100:00100000:3.0:1784047312.662595:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709216896 00000100:00100000:3.0:1784047312.662642:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217408 00000100:00100000:3.0:1784047312.662646:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217408 00000100:00100000:3.0:1784047312.662672:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217024 00000100:00100000:3.0:1784047312.662676:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217024 00000100:00100000:3.0:1784047312.662692:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430 00000100:00100000:3.0:1784047312.662698:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709216896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662735:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709216896:12345-0@lo:400:kworker.0 Request processed in 37us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662742:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430 00000100:00100000:3.0:1784047312.662753:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217536 00000100:00100000:3.0:1784047312.662756:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217536 00000100:00100000:3.0:1784047312.662790:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1784047312.662796:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709217408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662826:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709217408:12345-0@lo:400:kworker.0 Request processed in 30us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662831:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1784047312.662842:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1784047312.662848:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709217024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662873:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709217024:12345-0@lo:400:kworker.0 Request processed in 26us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662880:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1784047312.662890:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:3.0:1784047312.662896:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709217536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.662920:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709217536:12345-0@lo:400:kworker.0 Request processed in 24us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047312.662926:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00080000:3.0:1784047312.662976:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047312.662981:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047312.662984:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047312.662986:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047312.663032:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709216512:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709217024:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663067:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709217536:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663082:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709216384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663094:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709216896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663106:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709217408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663159:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709216256:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663170:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709216768:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663179:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709217280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663193:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709217792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047312.663204:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709216128:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709216640:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663228:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709217152:0@lo:400:kworker.0 00000100:00100000:3.0:1784047312.663241:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709217664:0@lo:400:kworker.0 00000100:00100000:1.0:1784047312.668761:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047312.668797:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709217920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047312.668895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047312.668992:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709217920 00000100:00100000:1.0:1784047312.669003:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709217920 00000100:00100000:1.0:1784047312.669071:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1784047312.669082:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709217920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047312.669130:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047312.670350:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709217920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1260us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047312.670365:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:0.0:1784047312.670388:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709217920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047313.171155:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047313.171187:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709218048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047313.171283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047313.171338:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047313.171355:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218048 00000100:00100000:0.0:1784047313.171364:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218048 00000100:00100000:0.0:1784047313.171426:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1784047313.171436:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709218048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047313.171476:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047313.171527:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709218048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047313.171535:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1784047313.171594:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709218048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047313.172434:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047313.172449:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709218176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047313.172502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047313.172641:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218176 00000100:00100000:2.0:1784047313.172649:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218176 00000100:00100000:2.0:1784047313.172695:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1784047313.172704:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709218176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047313.172725:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047313.172767:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709218176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047313.172775:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1784047313.173075:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709218304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047313.173110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047313.173167:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709218176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047313.173273:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218304 00000100:00100000:2.0:1784047313.173280:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218304 00000100:00100000:2.0:1784047313.173316:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1784047313.173323:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709218304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047313.173345:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047313.173386:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709218304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047313.173392:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1784047313.173422:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709218304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047313.178882:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047313.178921:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709218432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047313.179037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047313.179249:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218432 00000100:00100000:0.0:1784047313.179260:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218432 00000100:00100000:0.0:1784047313.179332:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:0.0:1784047313.179344:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709218432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047313.179375:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047313.179436:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709218432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047313.179443:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:0.0:1784047313.179508:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709218432:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1784047313.688598:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:0.0:1784047313.688675:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968750 is committed 00000001:00100000:0.0:1784047313.700095:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:0.0:1784047313.700133:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968750 is committed 00010000:00010000:0.0:1784047314.195762:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047314.572388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047314.572442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047314.572475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047314.572515:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047314.572549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047314.572592:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414528 00000100:00100000:2.0:1784047314.572627:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414528 00000100:00100000:2.0:1784047314.572694:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:2.0:1784047314.572706:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689414528:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047314.572803:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689414528:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 98us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047314.572813:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:2.0:1784047314.572861:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414784 00000100:00100000:2.0:1784047314.572866:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414784 00000100:00100000:2.0:1784047314.572996:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414656 00000100:00100000:2.0:1784047314.573000:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414656 00000100:00100000:2.0:1784047314.573027:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1129 00000100:00100000:2.0:1784047314.573035:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689414784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047314.573076:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689414784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 42us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047314.573085:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1129 00000100:00100000:2.0:1784047314.573102:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1130 00000100:00100000:2.0:1784047314.573109:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689414656:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047314.573145:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689414656:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 36us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047314.573153:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1130 00000100:00100000:2.0:1784047314.573177:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415040 00000100:00100000:2.0:1784047314.573182:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415040 00000100:00100000:2.0:1784047314.573217:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689414912 00000100:00100000:2.0:1784047314.573229:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689414912 00000100:00100000:2.0:1784047314.573264:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2434 00000100:00100000:2.0:1784047314.573272:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689415040:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047314.573305:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689415040:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047314.573316:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2434 00000100:00100000:2.0:1784047314.573335:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2435 00000100:00100000:2.0:1784047314.573343:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689414912:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047314.573373:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689414912:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047314.573379:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2435 00000100:00080000:2.0:1784047314.573574:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047314.573580:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047314.573583:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047314.573585:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784047315.219037:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047316.249315:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784047316.770835:0:87669:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1784047317.271281:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047317.779006:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709218688:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.779161:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709219200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.779211:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709219712:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.779265:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784047317.779271:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709218816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.779319:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709219328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779344:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.779360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709219840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.779446:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218688 00000100:00100000:3.0:1784047317.779454:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218688 00000100:00100000:3.0:1784047317.779530:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218816 00000100:00100000:3.0:1784047317.779534:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218816 00000100:00100000:3.0:1784047317.779563:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1784047317.779581:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709218688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779668:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709218688:12345-0@lo:400:kworker.0 Request processed in 89us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047317.779676:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1784047317.779696:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1784047317.779716:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709218816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779748:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709218816:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047317.779754:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1784047317.779776:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219200 00000100:00100000:3.0:1784047317.779779:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219200 00000100:00100000:3.0:1784047317.779801:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219712 00000100:00100000:3.0:1784047317.779803:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219712 00000100:00100000:3.0:1784047317.779818:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:3.0:1784047317.779824:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709219200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779868:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709219200:12345-0@lo:400:kworker.0 Request processed in 44us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047317.779874:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:3.0:1784047317.779887:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:3.0:1784047317.779893:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709219712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.779921:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709219712:12345-0@lo:400:kworker.0 Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047317.779927:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:3.0:1784047317.779953:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219328 00000100:00100000:3.0:1784047317.779957:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219328 00000100:00100000:3.0:1784047317.779982:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219840 00000100:00100000:3.0:1784047317.779985:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219840 00000100:00100000:3.0:1784047317.780004:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436 00000100:00100000:3.0:1784047317.780010:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709219328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780042:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709219328:12345-0@lo:400:kworker.0 Request processed in 33us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047317.780049:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436 00000100:00100000:3.0:1784047317.780068:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1784047317.780074:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709219840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780103:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709219840:12345-0@lo:400:kworker.0 Request processed in 29us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047317.780109:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00080000:3.0:1784047317.780129:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047317.780134:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047317.780136:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047317.780177:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709218816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780188:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709219328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780196:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 2 00000100:00100000:3.0:1784047317.780212:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709219840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780221:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709218688:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780229:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709219200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.780237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709219712:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.780994:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709218560:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781109:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709219072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781153:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709219584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781194:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709220096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781237:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784047317.781242:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709218944:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781261:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781276:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709219456:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781312:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709219968:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047317.781384:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219456 00000100:00100000:1.0:1784047317.781399:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219456 00000100:00100000:1.0:1784047317.781437:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219968 00000100:00100000:1.0:1784047317.781440:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219968 00000100:00100000:1.0:1784047317.781460:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1784047317.781466:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709219456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781511:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709219456:12345-0@lo:400:kworker.0 Request processed in 45us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047317.781516:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1784047317.781528:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1784047317.781534:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709219968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.781559:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709219968:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047317.781565:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1784047317.781581:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219072 00000100:00100000:1.0:1784047317.781584:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219072 00000100:00100000:1.0:1784047317.781633:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709219584 00000100:00100000:1.0:1784047317.781636:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709219584 00000100:00100000:1.0:1784047317.781649:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220096 00000100:00100000:1.0:1784047317.781651:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220096 00000100:00100000:1.0:1784047317.781660:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218944 00000100:00100000:1.0:1784047317.781662:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218944 00000100:00100000:1.0:1784047317.781676:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1784047317.781681:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709219072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047317.782111:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709218560 00000100:00100000:0.0:1784047317.782116:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709218560 00000100:00100000:0.0:1784047317.782148:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784047317.782156:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709218560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047317.782194:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709218560:12345-0@lo:400:kworker.0 Request processed in 40us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047317.782200:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784047317.782410:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1784047317.782422:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709219584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782460:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709219584:12345-0@lo:400:kworker.0 Request processed in 42us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047317.782466:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1784047317.782481:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1784047317.782488:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709220096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782516:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709220096:12345-0@lo:400:kworker.0 Request processed in 29us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047317.782522:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1784047317.782545:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1784047317.782551:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709218944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782582:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709218944:12345-0@lo:400:kworker.0 Request processed in 31us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047317.782588:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:2.0:1784047317.782638:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047317.782642:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047317.782645:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047317.782684:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709218944:0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782694:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709219456:0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782718:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968750 gen 2 00000100:00100000:2.0:1784047317.782732:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709219968:0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782742:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709218560:0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782752:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709219584:0@lo:400:kworker.0 00000100:00100000:2.0:1784047317.782765:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709220096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047317.783691:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709219072:12345-0@lo:400:kworker.0 Request processed in 2004us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047317.783813:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1784047317.783989:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709219072:0@lo:400:kworker.0 00000100:00100000:3.0:1784047317.784242:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709220352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047317.784791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047317.784879:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047317.784899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709220224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047317.784928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047317.785297:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220352 00000100:00100000:0.0:1784047317.785305:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220352 00000100:00100000:0.0:1784047317.785363:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220224 00000100:00100000:0.0:1784047317.785366:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220224 00000100:00100000:0.0:1784047317.785395:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1784047317.785404:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709220352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047317.785439:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047317.785487:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709220352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047317.785494:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1784047317.785509:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1784047317.785515:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709220224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047317.785548:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:0.0:1784047317.785589:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709220224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047317.785595:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1784047317.785998:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709220224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047317.786092:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709220352:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784047318.298891:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047318.299057:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709220736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047318.299157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047318.299237:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220736 00000100:00100000:1.0:1784047318.299244:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220736 00000100:00100000:1.0:1784047318.299311:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:1.0:1784047318.299320:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709220736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047318.299348:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047318.299395:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709220736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047318.299402:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:1.0:1784047318.299449:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709220736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047318.299492:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709220608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047318.299525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047318.299550:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047318.299557:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709220480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047318.299585:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047318.299639:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220608 00000100:00100000:1.0:1784047318.299642:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220608 00000100:00100000:1.0:1784047318.299665:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220480 00000100:00100000:1.0:1784047318.299668:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220480 00000100:00100000:1.0:1784047318.299684:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1784047318.299912:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709220608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047318.299935:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047318.299977:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709220608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 287us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047318.299985:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1784047318.300000:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1784047318.300007:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709220480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047318.300029:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047318.300057:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709220480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047318.300063:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1784047318.300167:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709220480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047318.300184:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709220608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047318.301455:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709220864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047318.301515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047318.301566:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220864 00000100:00100000:1.0:1784047318.301572:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220864 00000100:00100000:1.0:1784047318.301632:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1784047318.301648:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709220864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047318.301669:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047318.301722:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709220864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047318.301729:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1784047318.301770:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709220864:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1784047318.446858:0:87717:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1784047319.315001:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047319.685908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047319.685971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047319.686008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047319.686156:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415552 00000100:00100000:1.0:1784047319.686177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047319.686195:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415552 00000100:00100000:1.0:1784047319.686215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047319.686303:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415680 00000100:00100000:3.0:1784047319.686310:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415680 00000100:00100000:2.0:1784047319.686323:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415296 00000100:00100000:2.0:1784047319.686335:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415296 00000100:00100000:3.0:1784047319.686355:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2440 00000100:00100000:2.0:1784047319.686421:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415424 00000100:00100000:2.0:1784047319.686425:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415424 00000100:00100000:2.0:1784047319.686451:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1137 00000100:00100000:2.0:1784047319.686462:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689415296:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047319.686535:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689415296:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 75us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047319.686556:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1137 00000100:00100000:2.0:1784047319.686573:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1138 00000100:00100000:2.0:1784047319.686580:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689415424:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047319.686648:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689415424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047319.686655:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1138 00000100:00080000:2.0:1784047319.686680:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047319.686685:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047319.686688:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047319.686691:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047319.686710:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2441 00000100:00100000:2.0:1784047319.686722:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689415680:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047319.686752:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689415680:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047319.686763:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2441 00000100:00100000:3.0:1784047319.687304:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689415552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047319.687571:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689415552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1088us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047319.687583:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2440 00000100:00100000:0.0:1784047319.690949:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415168 00000100:00100000:0.0:1784047319.690967:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415168 00000100:00100000:0.0:1784047319.691049:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:0.0:1784047319.691059:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689415168:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047319.691151:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689415168:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 93us (5142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047319.691160:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00010000:00010000:1.0:1784047320.340701:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047320.392311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047320.393772:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415808 00000100:00100000:1.0:1784047320.393809:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415808 00000100:00100000:1.0:1784047320.393956:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1147 00000100:00100000:1.0:1784047320.393969:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:67200:x1870705689415808:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047320.394027:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:1.0:1784047320.394148:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:67200:x1870705689415808:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 181us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047320.394156:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1147 00000100:00100000:2.0:1784047320.400262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047320.400527:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689415936 00000100:00100000:0.0:1784047320.400632:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689415936 00000100:00100000:0.0:1784047320.400903:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1148 00000100:00100000:0.0:1784047320.400921:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:67200:x1870705689415936:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047320.400985:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047320.401228:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:67200:x1870705689415936:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 311us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047320.401237:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1148 00000100:00100000:0.0:1784047320.413186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047320.413740:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689416064 00000100:00100000:1.0:1784047320.413755:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689416064 00000100:00100000:1.0:1784047320.415015:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1994 00000100:00100000:1.0:1784047320.415041:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67200:x1870705689416064:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:1.0:1784047320.415095:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047320.415213:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67200:x1870705689416064:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 184us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047320.415222:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1994 00000100:00100000:1.0:1784047320.421946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047320.422164:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689416192 00000100:00100000:2.0:1784047320.422177:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689416192 00000100:00100000:2.0:1784047320.422253:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1995 00000100:00100000:2.0:1784047320.422265:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67200:x1870705689416192:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047320.422325:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047320.422421:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67200:x1870705689416192:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 158us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047320.422430:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1995 00000100:00100000:3.0:1784047320.478736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047320.481377:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689416320 00000100:00100000:2.0:1784047320.481400:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689416320 00000100:00100000:2.0:1784047320.481566:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1149 00000100:00100000:2.0:1784047320.481580:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:67216:x1870705689416320:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047320.481688:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047320.481722:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0c00/0x4426598c0c7743e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1a3 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.481830:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.481849:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.481864:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.481884:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.481891:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.481899:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482036:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0600/0x4426598c0c7743f5 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482057:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0600/0x4426598c0c7743f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482088:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0600/0x4426598c0c7743f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047320.482142:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784047320.482146:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047320.482177:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0600/0x4426598c0c7743f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482192:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482198:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482205:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482212:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482219:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047320.482223:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482232:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482245:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6d00) 00010000:00010000:2.0:1784047320.482248:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047320.482253:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482269:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7743e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482301:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482308:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482314:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482319:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047320.482322:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482329:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482338:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff99ccec0f1600) 00010000:00010000:2.0:1784047320.482341:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047320.482344:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482350:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1000/0x4426598c0c7743ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482391:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0c00/0x4426598c0c7743e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1a3 expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482420:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0600/0x4426598c0c7743f5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1a3 expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047320.482428:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccec0f1200) 00010000:00010000:2.0:1784047320.482431:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047320.482433:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0600, rc 0) 00000100:00100000:2.0:1784047320.482544:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:67216:x1870705689416320:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 967us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047320.482553:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1149 00000100:00100000:0.0:1784047320.489229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047320.489449:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689416576 00000100:00100000:3.0:1784047320.489463:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689416576 00000100:00100000:3.0:1784047320.489550:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1150 00000100:00100000:3.0:1784047320.489564:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:67216:x1870705689416576:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047320.489593:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047320.489659:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7743fc lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1aa expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489764:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489782:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489807:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489826:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489834:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489862:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489973:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489982:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.489989:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490141:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490149:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047320.490155:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490164:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490180:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccec0f1200) 00010000:00010000:3.0:1784047320.490184:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047320.490189:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490197:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419a00/0x4426598c0c774403 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490214:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490230:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490236:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490242:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047320.490246:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490253:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.490261:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99cceca13600) 00010000:00010000:3.0:1784047320.490264:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047320.490266:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.491227:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c77440a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.491325:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7743fc lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1aa expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.491341:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccec0f1200) 00010000:00010000:3.0:1784047320.491343:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784047320.491348:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418a00/0x4426598c0c7743fc lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1aa expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047320.491379:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418a00, rc 0) 00000100:00100000:3.0:1784047320.491489:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:67216:x1870705689416576:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1927us (2274us total) trans 0 rc 301/301 00000100:00100000:3.0:1784047320.491501:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1150 00000100:00100000:3.0:1784047320.504510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047320.504653:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689416832 00000100:00100000:0.0:1784047320.504668:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689416832 00000100:00100000:0.0:1784047320.504810:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1151 00000100:00100000:0.0:1784047320.504841:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:67216:x1870705689416832:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047320.504873:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047320.504913:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1b1 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047320.505091:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784047320.505250:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774411 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1b1 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.505269:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6d00) 00010000:00010000:0.0:1784047320.505285:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047320.505291:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1b1 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.505310:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd600, rc 0) 00000100:00100000:0.0:1784047320.505400:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:67216:x1870705689416832:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 562us (904us total) trans 107374182401 rc 301/301 00000100:00100000:0.0:1784047320.505408:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1151 00000100:00100000:1.0:1784047320.513476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047320.515522:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689416960 00000100:00100000:0.0:1784047320.515544:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689416960 00000100:00100000:0.0:1784047320.515727:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1152 00000100:00100000:0.0:1784047320.515743:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:67216:x1870705689416960:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:0.0:1784047320.515877:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.515911:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.515951:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.515973:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.515982:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.515990:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516116:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516126:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516133:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047320.516191:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047320.516208:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516225:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516233:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516240:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516256:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516263:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047320.516268:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516290:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516305:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff99ccec0f1200) 00010000:00010000:0.0:1784047320.516308:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047320.516314:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516322:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c77441f lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516343:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516350:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516357:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516362:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047320.516365:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516383:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516392:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff99ccec9b6100) 00010000:00010000:0.0:1784047320.516395:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047320.516398:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516403:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c774426 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516420:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516426:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516431:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516436:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047320.516439:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516445:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516452:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff99ccec9b6a00) 00010000:00010000:0.0:1784047320.516455:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047320.516458:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047320.516475:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c77442d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047320.516594:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:67216:x1870705689416960:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 854us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047320.516645:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1152 00000100:00100000:2.0:1784047320.524734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047320.525727:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417216 00000100:00100000:3.0:1784047320.525745:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417216 00000100:00100000:3.0:1784047320.525845:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 220 00000100:00100000:3.0:1784047320.525859:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:67216:x1870705689417216:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1784047320.526487:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:67216:x1870705689417216:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 627us (1765us total) trans 107374182402 rc 0/0 00000100:00100000:3.0:1784047320.526497:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 220 00010000:00010000:3.0:1784047321.363792:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047322.386932:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047322.899156:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709220992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047322.899260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899305:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709221504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899352:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709222016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709222528:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899440:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1784047322.899464:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709221120:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899524:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709221632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899564:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709222144:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899601:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709222656:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899686:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709221376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899754:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709221888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899796:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709222400:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899837:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784047322.899843:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709221248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899875:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709221760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899915:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709222272:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.899934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047322.899967:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221504 00000100:00100000:1.0:1784047322.899976:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221504 00000100:00100000:1.0:1784047322.900039:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221632 00000100:00100000:1.0:1784047322.900043:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221632 00000100:00100000:1.0:1784047322.900066:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222144 00000100:00100000:1.0:1784047322.900069:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222144 00000100:00100000:1.0:1784047322.900081:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222656 00000100:00100000:1.0:1784047322.900083:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222656 00000100:00100000:1.0:1784047322.900093:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221376 00000100:00100000:1.0:1784047322.900096:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221376 00000100:00100000:1.0:1784047322.900110:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221248 00000100:00100000:1.0:1784047322.900113:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221248 00000100:00100000:1.0:1784047322.900130:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1784047322.900140:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709221504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900209:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709221504:12345-0@lo:400:kworker.0 Request processed in 69us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900217:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1784047322.900237:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784047322.900244:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709221632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900271:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709221632:12345-0@lo:400:kworker.0 Request processed in 28us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900277:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784047322.900287:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1784047322.900292:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709222144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900317:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709222144:12345-0@lo:400:kworker.0 Request processed in 25us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900322:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1784047322.900332:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1784047322.900337:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709222656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900361:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709222656:12345-0@lo:400:kworker.0 Request processed in 24us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900377:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1784047322.900391:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1784047322.900397:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709221376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900432:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709221376:12345-0@lo:400:kworker.0 Request processed in 35us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900438:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1784047322.900451:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1784047322.900458:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709221248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900484:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709221248:12345-0@lo:400:kworker.0 Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900489:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1784047322.900511:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222016 00000100:00100000:1.0:1784047322.900515:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222016 00000100:00100000:1.0:1784047322.900543:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222528 00000100:00100000:1.0:1784047322.900547:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222528 00000100:00100000:1.0:1784047322.900567:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221888 00000100:00100000:1.0:1784047322.900569:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221888 00000100:00100000:1.0:1784047322.900586:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222400 00000100:00100000:1.0:1784047322.900588:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222400 00000100:00100000:1.0:1784047322.900636:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:1.0:1784047322.900643:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709222016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900675:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709222016:12345-0@lo:400:kworker.0 Request processed in 33us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900681:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:1.0:1784047322.900692:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1784047322.900698:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709222528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900739:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709222528:12345-0@lo:400:kworker.0 Request processed in 41us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900759:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1784047322.900771:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1784047322.900777:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709221888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900805:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709221888:12345-0@lo:400:kworker.0 Request processed in 29us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900811:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1784047322.900821:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:1.0:1784047322.900828:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709222400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.900855:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709222400:12345-0@lo:400:kworker.0 Request processed in 28us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.900860:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:1.0:1784047322.900893:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709220992 00000100:00100000:1.0:1784047322.900897:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709220992 00000100:00100000:1.0:1784047322.900922:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221760 00000100:00100000:1.0:1784047322.900925:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221760 00000100:00100000:1.0:1784047322.900934:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222272 00000100:00100000:1.0:1784047322.900937:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222272 00000100:00100000:1.0:1784047322.900946:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1784047322.900951:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709220992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047322.900983:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047322.901018:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709220992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.901025:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1784047322.901036:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1784047322.901041:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709221760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901078:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709221760:12345-0@lo:400:kworker.0 Request processed in 36us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.901085:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1784047322.901096:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:1.0:1784047322.901101:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709222272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901125:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709222272:12345-0@lo:400:kworker.0 Request processed in 24us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047322.901131:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00080000:1.0:1784047322.901148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047322.901153:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047322.901156:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047322.901158:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047322.901217:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709221248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901230:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709221760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901241:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709222272:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901251:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709221376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901260:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709221888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901270:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709222400:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901322:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709221632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901334:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709222144:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709222656:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709220992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047322.901385:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709221504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901397:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709222016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047322.901410:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709222528:0@lo:400:kworker.0 00000100:00100000:0.0:1784047322.904121:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709221120 00000100:00100000:0.0:1784047322.904134:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709221120 00000100:00100000:0.0:1784047322.904234:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784047322.904247:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709221120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047322.904364:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709221120:12345-0@lo:400:kworker.0 Request processed in 119us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047322.904372:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784047322.904480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709221120:0@lo:400:kworker.0 00000100:00100000:3.0:1784047322.904868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047322.904923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047322.906006:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222784 00000100:00100000:0.0:1784047322.906018:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222784 00000100:00100000:0.0:1784047322.906891:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:0.0:1784047322.906909:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709222784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047322.906958:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:0.0:1784047322.907259:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709222784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 356us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047322.907269:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:0.0:1784047322.907351:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709222784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784047323.411089:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047323.411341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709222912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047323.411782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047323.411842:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047323.411851:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709222912 00000100:00100000:1.0:1784047323.411852:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709223296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047323.411863:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709222912 00000100:00100000:1.0:1784047323.411888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047323.411924:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223296 00000100:00100000:3.0:1784047323.411928:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223296 00000100:00100000:3.0:1784047323.411951:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:3.0:1784047323.411960:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709222912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047323.411996:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047323.412045:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709223040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047323.412083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047323.412097:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047323.412103:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709223168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047323.412124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047323.412151:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223040 00000100:00100000:1.0:1784047323.412156:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223040 00000100:00100000:3.0:1784047323.412163:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709222912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047323.412173:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:3.0:1784047323.412209:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223168 00000100:00100000:3.0:1784047323.412212:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223168 00000100:00100000:0.0:1784047323.412974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709222912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047323.423698:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1784047323.423730:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709223296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047323.423783:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047323.424896:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709223296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1175us (13001us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047323.424912:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1784047323.427871:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:1.0:1784047323.427903:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709223040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047323.427965:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047323.428107:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709223040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 218us (16022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047323.428116:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:1.0:1784047323.428202:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709223040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047323.432376:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709223296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047323.437599:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:3.0:1784047323.437646:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709223168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047323.437692:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047323.437843:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709223168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 211us (25715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047323.437852:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1784047323.438118:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709223168:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784047324.435390:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047324.805460:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047324.805509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047324.805537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047324.805557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047324.805583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047324.805646:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417600 00000100:00100000:3.0:1784047324.805656:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417600 00000100:00100000:3.0:1784047324.805730:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417472 00000100:00100000:3.0:1784047324.805734:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417472 00000100:00100000:3.0:1784047324.805761:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1145 00000100:00100000:3.0:1784047324.805771:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689417600:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047324.805851:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689417600:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 81us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047324.805858:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1145 00000100:00100000:3.0:1784047324.805877:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1146 00000100:00100000:3.0:1784047324.805884:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:2400:x1870705689417472:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047324.805914:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:2400:x1870705689417472:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047324.805933:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1146 00000100:00100000:3.0:1784047324.805970:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417856 00000100:00100000:3.0:1784047324.805973:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417856 00000100:00100000:3.0:1784047324.806000:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417728 00000100:00100000:3.0:1784047324.806003:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417728 00000100:00100000:3.0:1784047324.806022:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2446 00000100:00100000:3.0:1784047324.806028:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689417856:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047324.806055:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689417856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047324.806061:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2446 00000100:00100000:3.0:1784047324.806072:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2447 00000100:00100000:3.0:1784047324.806078:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689417728:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047324.806100:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689417728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047324.806105:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2447 00000100:00080000:3.0:1784047324.806127:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047324.806130:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047324.806133:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047324.806134:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047324.806336:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417344 00000100:00100000:0.0:1784047324.806341:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417344 00000100:00100000:0.0:1784047324.806383:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:0.0:1784047324.806390:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689417344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047324.806427:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689417344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 39us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047324.806434:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00010000:00010000:1.0:1784047325.459290:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047326.491306:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784047326.493747:0:87086:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00000001:02000400:0.0:1784047327.353532:0:87913:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 12:42:04 (1784047324) 00000100:00100000:3.0:1784047327.407469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047327.407565:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689417984 00000100:00100000:1.0:1784047327.407578:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689417984 00000100:00100000:1.0:1784047327.407695:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1153 00000100:00100000:1.0:1784047327.407709:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:67806:x1870705689417984:12345-192.168.204.40@tcp:101:lfs.0 00000100:00080000:3.0:1784047327.407732:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784047327.407738:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047327.407768:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1b8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.407868:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.407887:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.407904:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.407925:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.407932:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.407939:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408010:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408018:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408026:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408034:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408041:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cee00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047327.408046:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408055:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408069:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6d00) 00010000:00010000:1.0:1784047327.408072:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047327.408076:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408083:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77443b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408096:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408102:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408114:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408119:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047327.408122:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408129:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408137:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99ccc37d2000) 00010000:00010000:1.0:1784047327.408139:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047327.408142:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408147:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774442 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408181:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774434 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1b8 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408192:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6d00) 00010000:00010000:1.0:1784047327.408194:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047327.408198:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1b8 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.408208:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf200, rc 0) 00000100:00100000:1.0:1784047327.408305:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:67806:x1870705689417984:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 598us (861us total) trans 0 rc 301/301 00000100:00100000:1.0:1784047327.408323:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1153 00000100:00100000:3.0:1784047327.413014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047327.413221:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689418240 00000100:00100000:1.0:1784047327.413235:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689418240 00000100:00100000:1.0:1784047327.413324:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1154 00000100:00100000:1.0:1784047327.413339:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:67806:x1870705689418240:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047327.413379:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047327.413385:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784047327.413429:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c7743cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae19c expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.413959:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6d00) 00010000:00010000:1.0:1784047327.413977:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047327.414001:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c774449 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1bf expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.414142:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.414158:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.414170:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.414185:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.414192:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.414213:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415552:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415573:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415585:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047327.415598:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1784047327.415676:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415686:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415694:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415775:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415782:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047327.415787:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415795:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415828:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:1.0:1784047327.415831:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047327.415837:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415843:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774450 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047327.415857:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003527e064 reply state 00000000801cefee transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415869:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415876:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99ccc37d2900) 00010000:00010000:1.0:1784047327.415878:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047327.415882:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047327.415925:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c774449 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415950:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047327.415957:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccc37d2200) 00010000:00010000:1.0:1784047327.415960:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047327.415962:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfc00, rc 0) 00000100:00100000:1.0:1784047327.416056:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:67806:x1870705689418240:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2720us (3055us total) trans 107374182403 rc 0/0 00000100:00100000:1.0:1784047327.416067:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1154 00000100:00100000:3.0:1784047327.420324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047327.421913:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689418496 00000100:00100000:0.0:1784047327.421932:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689418496 00000100:00100000:0.0:1784047327.422019:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1155 00000100:00100000:0.0:1784047327.422033:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:67806:x1870705689418496:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047327.422067:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047327.422098:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbdc00/0x4426598c0c77446c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1c6 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047327.422253:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047327.422271:0:66221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047327.422281:0:66221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047327.422343:0:66221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047327.422358:0:66221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 11 pid: 66220 timeout: 3525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047327.422376:0:66221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66221:1870705709223424:192.168.204.40@tcp:104: 00000100:00100000:0.0:1784047327.422497:0:66221:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047327.424260:0:66221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66221:1870705709223424:192.168.204.40@tcp:104: 00010000:00010000:3.0:1784047327.424306:0:66221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047327.433049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047327.434853:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689418624 00000100:00100000:3.0:1784047327.434894:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689418624 00010000:00010000:3.0:1784047327.434953:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 12 pid: 66220 timeout: 3525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047327.435182:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2535 00000100:00100000:3.0:1784047327.435196:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf349d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:2402:x1870705689418624:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047327.435219:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047327.435228:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 12 pid: 66220 timeout: 3525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047327.435243:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 12 pid: 66220 timeout: 3525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047327.435271:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77445e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1bf expref: 12 pid: 66220 timeout: 3525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047327.435287:0:25839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccc37d2200) 00010000:00010000:3.0:1784047327.435294:0:25839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047327.435304:0:25839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047327.435313:0:25839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047327.435355:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047327.435431:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf349d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:2402:x1870705689418624:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 237us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047327.435450:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2535 00010000:00010000:2.0:1784047327.437581:0:66221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.437599:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047327.437723:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1784047327.440224:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440245:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440254:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440283:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047327.440288:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440298:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440330:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccc37d2200) 00010000:00010000:2.0:1784047327.440334:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047327.440340:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440347:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd600/0x4426598c0c774473 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440526:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbdc00/0x4426598c0c77446c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1c6 expref: 11 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440539:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6600) 00010000:00010000:2.0:1784047327.440542:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047327.440547:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbdc00/0x4426598c0c77446c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1c6 expref: 11 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047327.440568:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbdc00, rc 0) 00000100:00100000:2.0:1784047327.440754:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:67806:x1870705689418496:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 18723us (20442us total) trans 107374182404 rc 301/301 00000100:00100000:2.0:1784047327.440765:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1155 00000100:00100000:3.0:1784047327.448116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047327.448683:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689418880 00000100:00100000:0.0:1784047327.448700:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689418880 00000100:00100000:0.0:1784047327.448777:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 221 00000100:00100000:0.0:1784047327.448823:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:67806:x1870705689418880:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1784047327.449316:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:67806:x1870705689418880:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 525us (1211us total) trans 107374182405 rc 0/0 00000100:00100000:0.0:1784047327.449326:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 221 00000100:00100000:3.0:1784047327.453515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047327.453691:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689419136 00000100:00100000:1.0:1784047327.453705:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689419136 00000100:00100000:1.0:1784047327.453774:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 222 00000100:00100000:1.0:1784047327.453789:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf35d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:67806:x1870705689419136:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1784047327.454126:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf35d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:67806:x1870705689419136:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 340us (623us total) trans 107374182406 rc 0/0 00000100:00100000:1.0:1784047327.454135:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 222 00010000:00010000:2.0:1784047327.510054:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047328.021966:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709223552:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022087:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709224064:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022137:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709224576:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709225088:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022218:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784047328.022224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709223936:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022263:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709224448:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709224960:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022354:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709223680:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022408:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709224192:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022448:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709224704:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022482:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784047328.022487:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709223808:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022516:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709224320:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022551:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709224832:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.022599:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223552 00000100:00100000:1.0:1784047328.022633:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223552 00000100:00100000:1.0:1784047328.022691:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784047328.022700:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709223552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022753:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709223552:12345-0@lo:400:kworker.0 Request processed in 53us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.022760:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784047328.022794:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224064 00000100:00100000:1.0:1784047328.022798:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224064 00000100:00100000:1.0:1784047328.022829:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224576 00000100:00100000:1.0:1784047328.022832:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224576 00000100:00100000:1.0:1784047328.022842:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225088 00000100:00100000:1.0:1784047328.022845:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225088 00000100:00100000:1.0:1784047328.022853:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223936 00000100:00100000:1.0:1784047328.022855:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223936 00000100:00100000:1.0:1784047328.022866:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223680 00000100:00100000:1.0:1784047328.022868:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223680 00000100:00100000:1.0:1784047328.022890:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709223808 00000100:00100000:1.0:1784047328.022893:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709223808 00000100:00100000:1.0:1784047328.022906:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1784047328.022912:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709224064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022944:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709224064:12345-0@lo:400:kworker.0 Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.022950:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1784047328.022962:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1784047328.022967:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709224576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.022993:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709224576:12345-0@lo:400:kworker.0 Request processed in 26us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.022999:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1784047328.023010:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1784047328.023015:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709225088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023039:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709225088:12345-0@lo:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023044:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1784047328.023053:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1784047328.023058:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709223936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023084:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709223936:12345-0@lo:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023090:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1784047328.023101:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1784047328.023107:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709223680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023136:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709223680:12345-0@lo:400:kworker.0 Request processed in 30us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023147:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1784047328.023159:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1784047328.023164:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709223808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023190:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709223808:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023196:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1784047328.023227:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224448 00000100:00100000:1.0:1784047328.023230:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224448 00000100:00100000:1.0:1784047328.023252:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224960 00000100:00100000:1.0:1784047328.023255:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224960 00000100:00100000:1.0:1784047328.023269:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224320 00000100:00100000:1.0:1784047328.023271:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224320 00000100:00100000:1.0:1784047328.023285:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224832 00000100:00100000:1.0:1784047328.023288:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224832 00000100:00100000:1.0:1784047328.023305:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448 00000100:00100000:1.0:1784047328.023311:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709224448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023341:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709224448:12345-0@lo:400:kworker.0 Request processed in 30us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023347:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448 00000100:00100000:1.0:1784047328.023359:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1784047328.023365:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709224960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023389:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709224960:12345-0@lo:400:kworker.0 Request processed in 25us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023395:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1784047328.023405:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1784047328.023411:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709224320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023449:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709224320:12345-0@lo:400:kworker.0 Request processed in 38us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023455:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1784047328.023466:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1784047328.023472:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709224832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023498:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709224832:12345-0@lo:400:kworker.0 Request processed in 27us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023504:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1784047328.023531:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224192 00000100:00100000:1.0:1784047328.023534:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224192 00000100:00100000:1.0:1784047328.023559:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709224704 00000100:00100000:1.0:1784047328.023562:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709224704 00000100:00100000:1.0:1784047328.023578:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:1.0:1784047328.023584:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709224192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023638:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709224192:12345-0@lo:400:kworker.0 Request processed in 54us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023660:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:1.0:1784047328.023673:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:1.0:1784047328.023679:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709224704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023707:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709224704:12345-0@lo:400:kworker.0 Request processed in 29us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.023712:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00080000:1.0:1784047328.023743:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047328.023747:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047328.023749:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047328.023751:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047328.023790:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709223808:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023811:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709224320:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023820:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709224832:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023829:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709223680:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023838:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709224192:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023845:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709224704:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023888:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709223936:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023898:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709224448:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023906:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709224960:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709223552:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023921:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709224064:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023930:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709224576:0@lo:400:kworker.0 00000100:00100000:1.0:1784047328.023939:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709225088:0@lo:400:kworker.0 00000100:00100000:3.0:1784047328.024342:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047328.024354:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709225216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047328.024393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047328.024425:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225216 00000100:00100000:3.0:1784047328.024429:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225216 00000100:00100000:3.0:1784047328.024458:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1784047328.024464:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709225216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047328.024491:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047328.024535:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709225216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047328.024541:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1784047328.024574:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709225216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047328.035855:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709225344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047328.035930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.036008:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225344 00000100:00100000:1.0:1784047328.036016:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225344 00000100:00100000:1.0:1784047328.036066:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1784047328.036076:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709225344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047328.036114:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:1.0:1784047328.042595:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709225344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6509us (6653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.042628:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:3.0:1784047328.043577:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709225344:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1784047328.341214:0:87086:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:3.0:1784047328.341289:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047328.341308:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047328.341316:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047328.341347:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047328.341352:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047328.341360:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047328.341377:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99ccc37d2900) 00010000:00010000:3.0:1784047328.341380:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047328.341384:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047328.341390:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c774457 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047328.442218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047328.442312:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689419264 00000100:00100000:1.0:1784047328.442323:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689419264 00000100:00100000:1.0:1784047328.442434:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1156 00000100:00100000:1.0:1784047328.442445:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:67815:x1870705689419264:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047328.442469:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047328.442494:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1cd expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.442559:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774488 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.442573:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.442585:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047328.442666:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047328.442671:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047328.442695:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.442731:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1cd expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.442748:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1cd expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.442756:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:1.0:1784047328.442759:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047328.442771:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf200, rc 0) 00000100:00100000:1.0:1784047328.442835:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:67815:x1870705689419264:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 391us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.442842:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1156 00000100:00100000:0.0:1784047328.453911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047328.454342:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689419392 00000100:00100000:1.0:1784047328.454353:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689419392 00000100:00100000:1.0:1784047328.454418:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1157 00000100:00100000:1.0:1784047328.454430:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:67815:x1870705689419392:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047328.454461:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00000100:00100000:1.0:1784047328.454526:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:67815:x1870705689419392:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 98us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.454534:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1157 00000100:00100000:0.0:1784047328.460810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047328.461055:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689419520 00000100:00100000:2.0:1784047328.461064:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689419520 00000100:00100000:2.0:1784047328.461132:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1158 00000100:00100000:2.0:1784047328.461142:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:67815:x1870705689419520:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047328.461173:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047328.461256:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:67815:x1870705689419520:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 109us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047328.461264:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1158 00000100:00080000:0.0:1784047328.461556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047328.467564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047328.467800:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689419648 00000100:00100000:3.0:1784047328.467809:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689419648 00000100:00100000:3.0:1784047328.467878:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2000 00000100:00100000:3.0:1784047328.467888:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67815:x1870705689419648:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047328.467922:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047328.467987:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67815:x1870705689419648:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 100us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047328.467994:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2000 00000100:00080000:1.0:1784047328.468532:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047328.472174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047328.472295:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689419776 00000100:00100000:3.0:1784047328.472305:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689419776 00000100:00100000:3.0:1784047328.472379:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2001 00000100:00100000:3.0:1784047328.472390:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67815:x1870705689419776:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047328.472439:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047328.472506:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:67815:x1870705689419776:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 117us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047328.472514:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2001 00000100:00080000:1.0:1784047328.472700:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784047328.531389:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047328.531534:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709225472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047328.531649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047328.531713:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225472 00000100:00100000:2.0:1784047328.531723:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225472 00000100:00100000:2.0:1784047328.531778:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1784047328.531787:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709225472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047328.531812:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047328.531861:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709225472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047328.531868:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1784047328.531921:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709225472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047328.532075:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709225600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047328.532104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.532171:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225600 00000100:00100000:1.0:1784047328.532175:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225600 00000100:00100000:1.0:1784047328.532199:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1784047328.532358:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709225600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047328.532371:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047328.532402:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709225600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.532409:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1784047328.532493:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709225600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047328.533191:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709225728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047328.533239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047328.533276:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225728 00000100:00100000:2.0:1784047328.533281:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225728 00000100:00100000:2.0:1784047328.533318:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1784047328.533325:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709225728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047328.533338:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047328.533372:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709225728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047328.533379:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1784047328.533411:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709225728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047328.535245:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709225856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047328.535312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047328.535468:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225856 00000100:00100000:1.0:1784047328.535482:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225856 00000100:00100000:1.0:1784047328.535531:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1784047328.535541:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709225856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047328.535566:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047328.535631:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709225856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.535655:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1784047328.535699:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709225856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047328.619994:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047328.623767:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420032 00000100:00100000:1.0:1784047328.623788:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420032 00000100:00100000:1.0:1784047328.623954:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1159 00000100:00100000:1.0:1784047328.623964:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:67822:x1870705689420032:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00010000:1.0:1784047328.624028:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047328.625937:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c774488 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1cd expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.625962:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:1.0:1784047328.625973:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047328.626938:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.626959:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.626973:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.626987:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.627006:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.627014:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628300:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628315:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628322:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628329:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628336:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047328.628341:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628349:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628365:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:1.0:1784047328.628367:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047328.628372:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628379:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77448f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047328.628419:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004605d229 reply state 00000000110c591c transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628431:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.628438:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2b00) 00010000:00010000:1.0:1784047328.628440:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047328.628442:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047328.629901:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+9:67822:x1870705689420032:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 5926us (9908us total) trans 107374182407 rc 0/0 00000100:00100000:1.0:1784047328.629916:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1159 00000100:00100000:3.0:1784047328.663765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047328.664486:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420160 00000100:00100000:1.0:1784047328.664502:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420160 00000100:00100000:1.0:1784047328.664670:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1160 00000100:00100000:1.0:1784047328.664684:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:67825:x1870705689420160:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047328.664717:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047328.664755:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77449d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1d4 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.664857:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c7744a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.664876:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c7744a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.664892:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c7744a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047328.664984:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047328.664990:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047328.665025:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c7744a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.665059:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77449d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1d4 expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.665081:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c7744a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1d4 expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.665174:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:1.0:1784047328.665178:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047328.665181:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf200, rc 0) 00000100:00100000:1.0:1784047328.665357:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:67825:x1870705689420160:12345-192.168.204.40@tcp:101:rm.0 Request processed in 674us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047328.665365:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1160 00000100:00100000:3.0:1784047328.671010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047328.671139:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420288 00000100:00100000:2.0:1784047328.671151:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420288 00000100:00100000:2.0:1784047328.671217:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1161 00000100:00100000:2.0:1784047328.671229:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:67825:x1870705689420288:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:2.0:1784047328.671253:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047328.671281:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c7744ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1db expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671362:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671379:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671390:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671401:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671427:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671434:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671532:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671553:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671561:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047328.671671:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784047328.671675:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047328.671705:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671717:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671725:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671731:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671736:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671752:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671758:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047328.671762:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671770:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671784:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:2.0:1784047328.671787:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047328.671791:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671798:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671814:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671820:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671824:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671829:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047328.671832:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671847:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671856:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2b00) 00010000:00010000:2.0:1784047328.671858:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047328.671861:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671866:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671897:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c7744ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1db expref: 12 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671912:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1db expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.671919:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99ccec0f1700) 00010000:00010000:2.0:1784047328.671922:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047328.671924:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0200, rc 0) 00000100:00100000:2.0:1784047328.672013:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:67825:x1870705689420288:12345-192.168.204.40@tcp:101:rm.0 Request processed in 785us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047328.672021:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1161 00000100:00100000:2.0:1784047328.679373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047328.679890:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420544 00000100:00100000:1.0:1784047328.679905:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420544 00000100:00100000:1.0:1784047328.679984:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1162 00000100:00100000:1.0:1784047328.679996:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:67825:x1870705689420544:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:1.0:1784047328.680068:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784047328.680110:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c7744c0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1db expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680139:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99ccec0f1700) 00010000:00010000:1.0:1784047328.680174:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c7744a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1d4 expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680185:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:1.0:1784047328.680191:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047328.680365:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680381:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680393:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680405:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680413:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680420:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680509:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680517:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047328.680524:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684024:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684049:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684061:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684587:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684597:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684602:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684666:0:68026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047328.684695:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684701:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684707:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684714:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cea00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047328.684718:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684726:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684740:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99ccc37d2400) 00010000:00010000:0.0:1784047328.684743:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784047328.684747:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684763:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c7744d5 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684786:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684791:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684809:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684815:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684820:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047328.684823:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684829:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684837:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:0.0:1784047328.684840:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047328.684843:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684849:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7744c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047328.684865:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000038a9122 reply state 00000000acd10cbb transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684884:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047328.684892:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2b00) 00010000:00010000:0.0:1784047328.684895:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047328.684898:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047328.684980:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047328.684987:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.685007:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047328.685011:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047328.685289:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:67825:x1870705689420544:12345-192.168.204.40@tcp:36:rm.0 Request processed in 5288us (5919us total) trans 107374182408 rc 0/0 00000100:00100000:0.0:1784047328.685299:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1162 00010000:00010000:2.0:1784047328.692172:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.698745:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99ccc37d2400) 00010000:00010000:2.0:1784047328.698759:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784047328.698771:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.698781:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc600/0x4426598c0c7744dc lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047328.698805:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047328.698807:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047328.698810:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047329.571479:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047329.930558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047329.930667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047329.930709:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420800 00000100:00100000:1.0:1784047329.930721:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420800 00000100:00100000:3.0:1784047329.930924:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420672 00000100:00100000:3.0:1784047329.930928:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420672 00000100:00100000:3.0:1784047329.930965:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:3.0:1784047329.930976:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689420672:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047329.931063:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689420672:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 89us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047329.931072:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1784047329.931198:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1153 00000100:00100000:1.0:1784047329.931207:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+11:2399:x1870705689420800:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:1.0:1784047329.931233:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfeb81f80 x1870705689420800/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:460/0 lens 224/224 e 0 to 0 dl 1784047340 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047329.931515:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+11:2399:x1870705689420800:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 309us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047329.931523:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1153 00000100:00080000:1.0:1784047329.931551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047329.941710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047329.941773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047329.941805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047329.941904:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420928 00000100:00100000:2.0:1784047329.941922:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420928 00000100:00100000:2.0:1784047329.942011:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1154 00000100:00100000:2.0:1784047329.942025:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689420928:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047329.942150:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689420928:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 127us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047329.942159:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1154 00000100:00100000:1.0:1784047329.942403:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421184 00000100:00100000:1.0:1784047329.942409:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421184 00000100:00100000:1.0:1784047329.942450:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421056 00000100:00100000:1.0:1784047329.942453:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421056 00000100:00100000:1.0:1784047329.942479:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2452 00000100:00100000:1.0:1784047329.942486:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689421184:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047329.942524:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689421184:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 39us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047329.942531:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2452 00000100:00100000:1.0:1784047329.942545:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2453 00000100:00100000:1.0:1784047329.942551:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689421056:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047329.942577:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689421056:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047329.942586:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2453 00010000:00010000:1.0:1784047330.587769:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047331.603298:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047332.626794:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047333.139281:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047333.139306:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709225984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047333.139380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047333.139473:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709225984 00000100:00100000:0.0:1784047333.139482:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709225984 00000100:00100000:1.0:1784047333.139529:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709226112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047333.139538:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:0.0:1784047333.139546:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709225984:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047333.139565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1784047333.139590:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047333.139631:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226112 00000100:00100000:2.0:1784047333.139635:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226112 00000100:00100000:2.0:1784047333.139664:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:0.0:1784047333.139665:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709225984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047333.139750:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709226112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047333.139775:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00010000:00000080:2.0:1784047333.139786:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfeb82d80 x1870705709226112/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/368 e 0 to 0 dl 1784047344 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047333.139816:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709226112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047333.143443:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:0.0:1784047333.143572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709226112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047333.143581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709226240:0@lo:400:kworker.0 00000100:00100000:0.0:1784047333.143591:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709225984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047333.143669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047333.143767:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226240 00000100:00100000:0.0:1784047333.143775:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226240 00000100:00100000:0.0:1784047333.143818:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784047333.143826:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709226240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047333.143974:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:0.0:1784047333.144110:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709226240:12345-0@lo:400:kworker.0 Request processed in 284us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047333.144129:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784047333.144141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709226496:0@lo:400:kworker.0 00000100:00100000:2.0:1784047333.144171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047333.144247:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709226240:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.144262:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047333.144268:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709226368:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.144291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047333.144339:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047333.144346:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709226624:0@lo:400:kworker.0 00000100:00100000:2.0:1784047333.144372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047333.144444:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226496 00000100:00100000:3.0:1784047333.144448:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226496 00000100:00100000:3.0:1784047333.144501:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226368 00000100:00100000:3.0:1784047333.144504:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226368 00000100:00100000:3.0:1784047333.144521:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1784047333.144527:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709226496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.144577:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709226496:12345-0@lo:400:kworker.0 Request processed in 51us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.144583:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1784047333.144594:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226624 00000100:00100000:3.0:1784047333.144597:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226624 00000100:00100000:3.0:1784047333.144630:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1784047333.144636:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709226368:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047333.144649:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc482f800 x1870705709226368/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784047344 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047333.144894:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047333.144899:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047333.144914:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1784047333.144925:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709226624:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784047333.144937:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccff10ed80 x1870705709226624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784047344 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047333.144966:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709226624:12345-0@lo:400:kworker.0 Request processed in 45us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047333.144973:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1784047333.145010:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709226624:0@lo:400:kworker.0 00000100:00100000:2.0:1784047333.145020:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709226496:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.145111:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709226368:12345-0@lo:400:kworker.0 Request processed in 474us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.145118:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1784047333.145241:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709226880:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.145274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047333.145295:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709227392:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.145317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047333.145338:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784047333.145343:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709226752:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.145366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047333.145381:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709227264:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.145399:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047333.145420:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226752 00000100:00100000:1.0:1784047333.145424:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226752 00000100:00100000:1.0:1784047333.145454:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1784047333.145459:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709226752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.145491:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709226752:12345-0@lo:400:kworker.0 Request processed in 32us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047333.145498:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1784047333.145516:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709226880 00000100:00100000:1.0:1784047333.145519:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709226880 00000100:00100000:1.0:1784047333.145541:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227392 00000100:00100000:1.0:1784047333.145544:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227392 00000100:00100000:1.0:1784047333.145576:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227264 00000100:00100000:1.0:1784047333.145579:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227264 00000100:00100000:1.0:1784047333.145628:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:1.0:1784047333.145634:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709226880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.145666:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709226880:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.145849:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709227008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.145875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047333.145892:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709227520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.145911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047333.145925:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047333.145930:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709227136:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.145951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047333.145975:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227008 00000100:00100000:3.0:1784047333.145979:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227008 00000100:00100000:3.0:1784047333.146003:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1784047333.146009:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709227392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.146047:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709227392:12345-0@lo:400:kworker.0 Request processed in 39us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.146053:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1784047333.146065:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1784047333.146071:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709227264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.146098:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709227264:12345-0@lo:400:kworker.0 Request processed in 27us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.146104:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1784047333.146114:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1784047333.146119:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709227008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.146146:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709227008:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.146152:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1784047333.146168:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227520 00000100:00100000:3.0:1784047333.146171:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227520 00000100:00100000:3.0:1784047333.146190:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227136 00000100:00100000:3.0:1784047333.146192:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227136 00000100:00100000:3.0:1784047333.146203:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1784047333.146208:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709227520:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047333.146218:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfeb81500 x1870705709227520/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784047344 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047333.146245:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709227520:12345-0@lo:400:kworker.0 Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.146251:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1784047333.146261:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1784047333.146266:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709227136:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047333.146282:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfa3e8000 x1870705709227136/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784047344 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047333.146310:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709227136:12345-0@lo:400:kworker.0 Request processed in 43us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.146315:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1784047333.146345:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709227136:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.146355:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709227008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047333.146363:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709227520:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.148628:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:1.0:1784047333.148911:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709226752:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.148925:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709227264:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.148936:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709226880:0@lo:400:kworker.0 00000100:00100000:1.0:1784047333.148947:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709227392:0@lo:400:kworker.0 00000100:00100000:2.0:1784047333.149194:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709226368:0@lo:400:kworker.0 00000100:00080000:2.0:1784047333.149240:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047333.149245:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047333.149249:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784047333.650855:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047333.653212:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709227648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047333.653283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047333.653345:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227648 00000100:00100000:0.0:1784047333.653352:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227648 00000100:00100000:0.0:1784047333.653401:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1784047333.653410:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709227648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047333.653441:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047333.653482:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709227648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047333.653490:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1784047333.653533:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709227648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047333.655064:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709227776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047333.655125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047333.655189:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227776 00000100:00100000:1.0:1784047333.655197:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227776 00000100:00100000:1.0:1784047333.655327:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1784047333.655336:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709227776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047333.655358:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047333.655402:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709227776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047333.655409:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1784047333.655459:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709227776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047333.657963:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709227904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047333.658024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047333.658076:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709227904 00000100:00100000:0.0:1784047333.658084:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709227904 00000100:00100000:0.0:1784047333.658126:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1784047333.658135:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709227904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047333.658162:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047333.658203:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709227904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047333.658211:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1784047333.658256:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709227904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047333.659868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709228032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047333.659929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047333.659982:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228032 00000100:00100000:3.0:1784047333.659988:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228032 00000100:00100000:3.0:1784047333.660029:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:3.0:1784047333.660037:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709228032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047333.660055:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047333.660097:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709228032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047333.660104:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:3.0:1784047333.660149:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709228032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784047334.688395:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784047335.041750:0:87086:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:1.0:1784047335.041950:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.041963:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.041979:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.041985:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047335.041990:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.041999:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042018:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2b00) 00010000:00010000:1.0:1784047335.042021:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047335.042026:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042032:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c774496 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042051:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042058:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042064:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042069:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047335.042072:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042089:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042098:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37d2b00) 00010000:00010000:1.0:1784047335.042101:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047335.042104:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047335.042110:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c7744ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047335.047783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047335.047815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047335.047851:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047335.047878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047335.047903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047335.047930:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421440 00000100:00100000:2.0:1784047335.047940:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421440 00000100:00100000:2.0:1784047335.047996:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421568 00000100:00100000:2.0:1784047335.048000:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421568 00000100:00100000:2.0:1784047335.048025:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1161 00000100:00100000:2.0:1784047335.048040:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689421440:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:2.0:1784047335.048070:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccff10c380 x1870705689421440/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:466/0 lens 224/224 e 0 to 0 dl 1784047346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047335.048124:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689421440:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047335.048132:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1161 00000100:00100000:2.0:1784047335.048150:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1162 00000100:00100000:2.0:1784047335.048156:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689421568:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047335.048182:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689421568:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047335.048188:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1162 00000100:00100000:2.0:1784047335.048206:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421696 00000100:00100000:2.0:1784047335.048209:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421696 00000100:00100000:2.0:1784047335.048247:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421824 00000100:00100000:2.0:1784047335.048250:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421824 00000100:00100000:2.0:1784047335.048271:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2458 00000100:00100000:2.0:1784047335.048277:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689421696:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047335.048305:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689421696:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047335.048311:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2458 00000100:00100000:2.0:1784047335.048323:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2459 00000100:00100000:2.0:1784047335.048328:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689421824:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047335.048349:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689421824:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 21us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047335.048355:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2459 00000100:00080000:2.0:1784047335.048369:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047335.048373:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047335.048376:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047335.048378:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047335.048645:0:87093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421312 00000100:00100000:0.0:1784047335.048650:0:87093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421312 00000100:00100000:0.0:1784047335.048682:0:87093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:0.0:1784047335.048688:0:87093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689421312:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047335.048725:0:87093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689421312:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047335.048732:0:87093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00010000:00010000:1.0:1784047335.719036:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784047336.112208:0:88308:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784047336.226345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047336.226552:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689421952 00000100:00100000:0.0:1784047336.226562:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689421952 00000100:00100000:0.0:1784047336.226655:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1163 00000100:00100000:0.0:1784047336.226666:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:67893:x1870705689421952:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047336.226687:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047336.226712:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7744e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1e2 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.226779:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7744ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.226793:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7744ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.226805:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7744ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047336.226861:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047336.226865:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047336.226904:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7744ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.226947:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7744e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e2 expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.226965:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7744ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e2 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.226973:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6300) 00010000:00010000:0.0:1784047336.226976:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047336.226980:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd800, rc 0) 00010000:00000080:0.0:1784047336.226987:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfa3e9c00 x1870705689421952/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:467/0 lens 576/688 e 0 to 0 dl 1784047347 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047336.227052:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:67893:x1870705689421952:12345-192.168.204.40@tcp:101:dd.0 Request processed in 388us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047336.227060:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1163 00000100:00100000:1.0:1784047336.231480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047336.232931:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422208 00000100:00100000:2.0:1784047336.232943:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422208 00000100:00100000:2.0:1784047336.233006:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1164 00000100:00100000:2.0:1784047336.233016:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:67893:x1870705689422208:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047336.233035:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047336.233038:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784047336.233062:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7744ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e2 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233080:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec9b6300) 00010000:00010000:2.0:1784047336.233089:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047336.233109:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1600/0x4426598c0c7744f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1e9 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233220:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233232:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233241:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233714:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233723:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233731:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233795:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233803:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233811:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047336.233909:0:66221:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784047336.233913:0:66221:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1784047326 00000004:00010000:2.0:1784047336.233916:0:66221:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1784047326 00000004:00010000:2.0:1784047336.233923:0:66221:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1784047326 00000004:00010000:2.0:1784047336.233925:0:66221:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1784047336.233929:0:66221:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1784047336.233937:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233944:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233950:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233956:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233963:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047336.233967:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233974:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233983:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4b00) 00010000:00010000:2.0:1784047336.233986:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047336.233989:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.233995:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c7744f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234006:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234023:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234029:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234033:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047336.234036:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234043:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234051:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff99ccfebe4500) 00010000:00010000:2.0:1784047336.234053:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047336.234056:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234062:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c7744ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234105:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1600/0x4426598c0c7744f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234122:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.234130:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:2.0:1784047336.234133:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1784047336.234142:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1e00, rc 0) 00010000:00000080:2.0:1784047336.234151:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0f800 x1870705689422208/t107374182409(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:467/0 lens 752/824 e 0 to 0 dl 1784047347 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047336.234222:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:67893:x1870705689422208:12345-192.168.204.40@tcp:101:dd.0 Request processed in 1206us (2750us total) trans 107374182409 rc 0/0 00000100:00100000:2.0:1784047336.234230:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1164 00000100:00100000:2.0:1784047336.238148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047336.238223:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422336 00000100:00100000:0.0:1784047336.238233:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422336 00000100:00100000:0.0:1784047336.238301:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1165 00000100:00100000:0.0:1784047336.238312:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+9:67893:x1870705689422336:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047336.238336:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047336.238359:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd400/0x4426598c0c774514 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1f0 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.238395:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77451b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.238409:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77451b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.238430:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77451b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.238549:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd400/0x4426598c0c774514 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f0 expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.238566:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77451b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f0 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047336.238574:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:0.0:1784047336.238577:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047336.238580:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd200, rc 0) 00010000:00000080:0.0:1784047336.238587:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccff10f100 x1870705689422336/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:467/0 lens 568/1272 e 0 to 0 dl 1784047347 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047336.239047:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:67893:x1870705689422336:12345-192.168.204.40@tcp:101:dd.0 Request processed in 735us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047336.239055:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1165 00000100:00100000:1.0:1784047336.254967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047336.255246:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422592 00000100:00100000:3.0:1784047336.255269:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422592 00000100:00100000:3.0:1784047336.255347:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1166 00000100:00100000:3.0:1784047336.255357:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:67893:x1870705689422592:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047336.255499:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047336.255518:0:66220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047336.255529:0:66220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047336.255565:0:66220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047336.255579:0:66220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047336.255593:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66220:1870705709228160:192.168.204.40@tcp:104: 00000100:00100000:3.0:1784047336.255694:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc7b4ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047336.261064:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66220:1870705709228160:192.168.204.40@tcp:104: 00010000:00010000:0.0:1784047336.261095:0:66220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047336.265719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047336.267134:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422720 00000100:00100000:2.0:1784047336.267144:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422720 00010000:00010000:2.0:1784047336.267181:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047336.267228:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2536 00000100:00100000:2.0:1784047336.267237:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+11:2401:x1870705689422720:12345-192.168.204.40@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1784047336.267266:0:26194:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267278:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267291:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267300:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:2.0:1784047336.267303:0:26194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1784047336.267306:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267327:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267333:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267360:0:26194:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047336.267413:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+11:2401:x1870705689422720:12345-192.168.204.40@tcp:102:ldlm_bl.0 Request processed in 177us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047336.267420:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2536 00010000:00010000:2.0:1784047336.267533:0:66220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267542:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047336.267686:0:66220:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784047336.267689:0:66220:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1784047326 -> 1784047335 00000004:00010000:2.0:1784047336.267691:0:66220:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1784047326 -> 1784047326 00000004:00010000:2.0:1784047336.267699:0:66220:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1784047326 -> 1784047335 00000004:00010000:2.0:1784047336.267702:0:66220:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1784047336.267710:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006419c8ca reply state 0000000005f42ac2 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267723:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047336.267740:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:2.0:1784047336.267742:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047336.267745:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1784047336.267791:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0f480 x1870705689422592/t107374182410(0) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:467/0 lens 488/456 e 0 to 0 dl 1784047347 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047336.267826:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+12:67893:x1870705689422592:12345-192.168.204.40@tcp:36:dd.0 Request processed in 12471us (12870us total) trans 107374182410 rc 0/0 00000100:00100000:2.0:1784047336.267833:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1166 00000100:00100000:3.0:1784047336.272573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047336.272748:0:66234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422848 00000100:00100000:2.0:1784047336.272758:0:66234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422848 00002000:00010000:2.0:1784047336.272792:0:66234:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:2.0:1784047336.272797:0:66234:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99cce3d23800 with x1870705689422848 00000100:00100000:2.0:1784047336.272822:0:66234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:2.0:1784047336.272830:0:66234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:2402:x1870705689422848:12345-192.168.204.40@tcp:10:dd.0 00000004:00010000:2.0:1784047336.272989:0:66234:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784047336.272993:0:66234:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1784047335 -> 1784047335 00000004:00010000:2.0:1784047336.272996:0:66234:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1784047326 -> 1784047326 00000004:00010000:2.0:1784047336.272998:0:66234:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1784047335 -> 1784047335 00000004:00010000:2.0:1784047336.273001:0:66234:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784047336.273016:0:66234:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce3d23800 x1870705689422848/t107374182411(0) o10->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:467/0 lens 440/432 e 0 to 0 dl 1784047347 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047336.273075:0:66234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+13:2402:x1870705689422848:12345-192.168.204.40@tcp:10:dd.0 Request processed in 245us (511us total) trans 107374182411 rc 0/0 00000100:00100000:2.0:1784047336.273083:0:66234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00002000:00010000:2.0:1784047336.273086:0:66234:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:2.0:1784047336.273099:0:66234:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99cce3d23800 with x1870705689422848 00000100:00100000:2.0:1784047336.282565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047336.282620:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689423104 00000100:00100000:2.0:1784047336.282630:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689423104 00000100:00100000:2.0:1784047336.282690:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 223 00000100:00100000:2.0:1784047336.282701:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+13:67893:x1870705689423104:12345-192.168.204.40@tcp:35:dd.0 00010000:00000080:2.0:1784047336.282892:0:66223:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfeb82300 x1870705689423104/t107374182412(0) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:467/0 lens 392/456 e 0 to 0 dl 1784047347 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047336.282951:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+14:67893:x1870705689423104:12345-192.168.204.40@tcp:35:dd.0 Request processed in 252us (396us total) trans 107374182412 rc 0/0 00000100:00100000:2.0:1784047336.282959:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 223 00010000:00010000:3.0:1784047336.722864:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047337.755441:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047338.258849:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709228416:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.258920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.258951:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709228928:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.258975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.258993:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709229440:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.259014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.259038:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784047338.259044:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709228544:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.259066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.259083:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709229056:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.259106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.259121:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709229568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.259156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.259192:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228416 00000100:00100000:1.0:1784047338.259199:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228416 00000100:00100000:1.0:1784047338.259487:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228544 00000100:00100000:1.0:1784047338.259492:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228544 00000100:00100000:1.0:1784047338.259521:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1784047338.259531:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709228416:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047338.259555:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc79f0380 x1870705709228416/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:469/0 lens 224/224 e 0 to 0 dl 1784047349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047338.259600:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709228416:12345-0@lo:400:kworker.0 Request processed in 70us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.259630:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1784047338.259648:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1784047338.259654:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709228544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.259684:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709228544:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.259691:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1784047338.259710:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228928 00000100:00100000:1.0:1784047338.259714:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228928 00000100:00100000:1.0:1784047338.259738:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229440 00000100:00100000:1.0:1784047338.259741:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229440 00000100:00100000:1.0:1784047338.259760:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1784047338.259766:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709228928:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047338.259779:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc79f3100 x1870705709228928/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:469/0 lens 224/224 e 0 to 0 dl 1784047349 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047338.259808:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709228928:12345-0@lo:400:kworker.0 Request processed in 42us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.259923:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709228288:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.259959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.259991:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709228800:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.260032:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709229312:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.260079:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709229824:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.260113:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784047338.260118:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709228672:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.260150:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709229184:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.260186:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709229696:0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.260236:0:87092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228288 00000100:00100000:3.0:1784047338.260240:0:87092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228288 00000100:00100000:3.0:1784047338.260344:0:87092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784047338.260351:0:87092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709228288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260387:0:87092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709228288:12345-0@lo:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.260394:0:87092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784047338.260422:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228800 00000100:00100000:3.0:1784047338.260425:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228800 00000100:00100000:3.0:1784047338.260444:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229312 00000100:00100000:3.0:1784047338.260447:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229312 00000100:00100000:3.0:1784047338.260471:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229824 00000100:00100000:3.0:1784047338.260474:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229824 00000100:00100000:3.0:1784047338.260484:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709228672 00000100:00100000:3.0:1784047338.260487:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709228672 00000100:00100000:3.0:1784047338.260500:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1784047338.260506:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709228800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047338.260545:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709228800:12345-0@lo:400:kworker.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.260552:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1784047338.260564:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1784047338.260570:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709229312:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047338.260580:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce3d21c00 x1870705709229312/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:469/0 lens 224/224 e 0 to 0 dl 1784047349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047338.260626:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709229312:12345-0@lo:400:kworker.0 Request processed in 36us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.260633:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1784047338.260644:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1784047338.260650:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709229824:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047338.260660:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce3d22680 x1870705709229824/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:469/0 lens 224/224 e 0 to 0 dl 1784047349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047338.260687:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709229824:12345-0@lo:400:kworker.0 Request processed in 37us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.260693:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1784047338.260704:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1784047338.260710:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709228672:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047338.260720:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00416680 x1870705709228672/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:469/0 lens 224/224 e 0 to 0 dl 1784047349 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047338.260743:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709228672:12345-0@lo:400:kworker.0 Request processed in 34us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.260749:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1784047338.260774:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229056 00000100:00100000:3.0:1784047338.260778:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229056 00000100:00100000:3.0:1784047338.260803:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229568 00000100:00100000:3.0:1784047338.260806:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229568 00000100:00100000:1.0:1784047338.261622:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1784047338.261645:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1784047338.261653:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709229440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.261699:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709229440:12345-0@lo:400:kworker.0 Request processed in 47us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.261705:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1784047338.261736:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229184 00000100:00100000:1.0:1784047338.261740:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229184 00000100:00100000:1.0:1784047338.261768:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229696 00000100:00100000:1.0:1784047338.261771:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229696 00000100:00100000:1.0:1784047338.261790:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:1.0:1784047338.261796:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709229056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047338.261943:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1784047338.261955:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709229568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047338.261990:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709229568:12345-0@lo:400:kworker.0 Request processed in 39us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047338.261997:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1784047338.262011:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1784047338.262017:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709229184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047338.262044:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709229184:12345-0@lo:400:kworker.0 Request processed in 28us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047338.262049:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1784047338.262060:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:2.0:1784047338.262066:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709229696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047338.262090:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709229696:12345-0@lo:400:kworker.0 Request processed in 24us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047338.262103:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:2.0:1784047338.262159:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047338.262171:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709229952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047338.262201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047338.262245:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709229952 00000100:00100000:2.0:1784047338.262310:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709229952 00000100:00100000:2.0:1784047338.262338:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:2.0:1784047338.262344:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709229952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047338.262368:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444995072 avail 1298755584 00010000:00000080:2.0:1784047338.262380:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c21f80 x1870705709229952/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:469/0 lens 224/368 e 0 to 0 dl 1784047349 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047338.262412:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709229952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047338.262418:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:2.0:1784047338.262474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709229952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047338.263432:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709229056:12345-0@lo:400:kworker.0 Request processed in 1632us (4322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.263443:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00080000:1.0:1784047338.263482:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047338.263487:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047338.263490:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047338.263493:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047338.263566:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709228544:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.263579:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709229056:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.263589:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709229568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.263601:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709228416:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.263625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709228928:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.263647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709229440:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.263676:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047338.263684:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709230080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047338.263720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047338.263846:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230080 00000100:00100000:2.0:1784047338.263851:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230080 00000100:00100000:2.0:1784047338.263881:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1784047338.263887:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709230080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047338.263911:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047338.263946:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709230080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047338.263952:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1784047338.263981:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709230080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047338.264138:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709228672:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.264151:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709229184:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.264162:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709229696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.264171:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709228288:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.264182:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709228800:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.264191:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709229312:0@lo:400:kworker.0 00000100:00100000:1.0:1784047338.264201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709229824:0@lo:400:kworker.0 00000020:01000004:2.0:1784047338.449367:0:88405:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784047338.449439:0:88405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.449466:0:88405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.449474:0:88405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.449481:0:88405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.449507:0:88405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784047338.449513:0:88405:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784047338.449537:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047338.449542:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784047338.449547:0:88405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784047338.449576:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784047338.449598:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047338.449645:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.449663:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047338.449667:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.449677:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047338.449685:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047338.449690:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047338.449693:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784047338.449695:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1784047338.449811:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709230208:0@lo:39:umount.0 00000100:00100000:0.0:1784047338.449888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047338.450114:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.450121:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784047338.450167:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709230336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047338.450194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047338.450293:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230208 00000100:00100000:2.0:1784047338.450299:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230208 00000100:00100000:1.0:1784047338.450351:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230336 00000100:00100000:2.0:1784047338.450356:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1784047338.450358:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230336 00000100:00100000:2.0:1784047338.450368:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709230208:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784047338.450395:0:66220:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7741b7 00000100:00100000:1.0:1784047338.450396:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1784047338.450408:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709230336:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784047338.450412:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99ccebeb9800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784047338.450421:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047338.450438:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4200/0x4426598c0c77409f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774098 expref: 24 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1784047338.450442:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce7ed4700 x1870705709230208/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:469/0 lens 224/224 e 0 to 0 dl 1784047349 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784047338.450466:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047338.451356:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.451368:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5400/0x4426598c0c774098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77409f expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.451382:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047338.451393:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047338.451396:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047338.451800:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047338.454070:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870705709230208:12345-0@lo:39:umount.0 Request processed in 3684us (4162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047338.454085:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000020:00000080:2.0:1784047338.454115:0:66220:0:(genops.c:906:class_export_put()) final put ffff99ccebebc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784047338.455749:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebebc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784047338.455818:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccebeb9800 for lustre-MDT0000 00000100:00080000:0.0:1784047338.456013:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784047338.456036:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709230208:0@lo:39:umount.0 00000100:00080000:2.0:1784047338.456205:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047338.456209:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784047338.456214:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784047338.457314:0:88405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457328:0:88405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457334:0:88405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457340:0:88405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457362:0:88405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047338.457368:0:88405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457375:0:88405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457381:0:88405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457387:0:88405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457399:0:88405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047338.457419:0:88405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457424:0:88405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457430:0:88405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457435:0:88405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457463:0:88405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784047338.457476:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784047338.457482:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457489:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047338.457493:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457501:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047338.457508:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047338.457513:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784047338.457516:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784047338.457548:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457575:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047338.457786:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457795:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0030200/0x4426598c0c773fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773fbf expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457810:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047338.457814:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457820:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047338.457823:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457830:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047338.457837:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047338.457842:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784047338.457844:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784047338.457846:0:16469:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1784047338.457861:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457867:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047338.457880:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457897:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c7740c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7740c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457906:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047338.457909:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457915:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047338.457918:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457924:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047338.457930:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047338.457935:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784047338.457937:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784047338.457939:0:16469:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784047338.457952:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457958:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047338.457964:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457970:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0031c00/0x4426598c0c77408a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774091 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.457990:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047338.457992:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047338.457994:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047338.458012:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709230592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047338.458090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047338.458136:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047338.458141:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709230720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047338.458162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047338.458201:0:88405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.458210:0:88405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.458216:0:88405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.458222:0:88405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.458234:0:88405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784047338.458237:0:88405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784047338.458240:0:88405:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784047338.458275:0:88405:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784047338.458279:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784047338.458283:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784047338.458289:0:88405:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1784047338.459065:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047338.459072:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459081:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047338.459084:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459091:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047338.459098:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047338.459103:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047338.459105:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784047338.459107:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784047338.459133:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459139:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047338.459150:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459157:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0030000/0x4426598c0c773fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c773faa expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459168:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047338.459180:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047338.459182:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047338.459205:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230592 00000100:00100000:0.0:1784047338.459211:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230592 00010000:00010000:3.0:1784047338.459243:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047338.459255:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230720 00000100:00100000:0.0:1784047338.459259:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230720 00000100:00100000:3.0:1784047338.459279:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1784047338.459288:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1784047338.459294:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709230592:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047338.459300:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709230720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047338.459312:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047338.459313:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047338.459333:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1400/0x4426598c0c7740c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7740c2 expref: 25 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459334:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77408a expref: 25 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.459364:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047338.459364:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047338.459421:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709230720:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.459429:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709230592:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047338.459430:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1784047338.459442:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1784047338.459492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709230720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047338.459503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709230592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047338.459521:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709230464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047338.459533:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709230848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047338.459559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047338.459591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047338.459627:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230464 00000100:00100000:3.0:1784047338.459633:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230464 00000100:00100000:3.0:1784047338.459662:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230848 00000100:00100000:3.0:1784047338.459665:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230848 00000100:00100000:3.0:1784047338.459685:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1784047338.459691:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+23:3646:x1870705709230464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047338.459699:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047338.459831:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4a00/0x4426598c0c773fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773fb1 expref: 23 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047338.459836:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1784047338.459848:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+22:3645:x1870705709230848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047338.459849:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047338.459857:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047338.459868:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5600/0x4426598c0c773faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c773fa3 expref: 22 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047338.459880:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047338.459894:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+21:3646:x1870705709230464:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047338.459902:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1784047338.459920:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+20:3645:x1870705709230848:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047338.459928:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1784047338.459960:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709230464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047338.459962:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709230848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047338.459986:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047338.460378:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+19:3645:x1870705709230336:12345-0@lo:103:ldlm_bl.0 Request processed in 9970us (10180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.460386:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1784047338.462373:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709230336:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1784047338.471817:0:88405:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1784047338.472482:0:87086:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:1.0:1784047338.472625:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047338.472638:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047338.472644:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047338.472651:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047338.472655:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047338.472663:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047338.472680:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:1.0:1784047338.472683:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047338.472688:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047338.472693:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774522 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784047338.472901:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1784047338.472911:0:88405:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccebeba000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784047338.472916:0:88405:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccfddd7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784047338.472919:0:88405:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccfddd0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784047338.472923:0:88405:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccf7571000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784047338.472939:0:88405:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc3566800 2a2569b5-a558-4441-a96a-1d77608df16b 192.168.204.40@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 107374182412 stale:0 00000020:00080000:3.0:1784047338.472944:0:88405:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99cce4978000) has exports, disconnecting them 00000020:00080000:3.0:1784047338.472948:0:88405:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccebeba000), last request at 1784047307 00000020:00000080:3.0:1784047338.472955:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7741b0 00000100:00080000:3.0:1784047338.472962:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccebeb8000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784047338.472986:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccebeba000): rc 0 00000020:00000080:3.0:1784047338.472988:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccebeba000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1784047338.473003:0:88405:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccfddd7800), last request at 1784047338 00000020:00000080:3.0:1784047338.473006:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7741a9 00000100:00080000:3.0:1784047338.473010:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da8800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784047338.473021:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccfddd7800): rc 0 00000020:00000080:3.0:1784047338.473023:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccfddd7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784047338.473026:0:88405:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccfddd0000), last request at 1784047338 00000020:00000080:3.0:1784047338.473029:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7741a2 00000100:00080000:3.0:1784047338.473033:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784047338.473041:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccfddd0000): rc 0 00000020:00000080:3.0:1784047338.473051:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccfddd0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1784047338.473055:0:88405:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccf7571000), last request at 1784047302 00000020:00000080:3.0:1784047338.473064:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77400c 00000100:00080000:3.0:1784047338.473074:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccc5024800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784047338.473115:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784047338.473123:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccf7571000): rc 0 00000020:00000080:3.0:1784047338.473125:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccf7571000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1784047338.473130:0:88405:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.40@tcp (ffff99ccc3566800), last request at 1784047336 00000020:00000080:3.0:1784047338.473134:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774005 00000020:00010000:3.0:1784047338.473140:0:88405:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccc3566800: total 4 00000100:00080000:3.0:1784047338.473143:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd5800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1784047338.473155:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccc3566800: total 4 00010000:00010000:3.0:1784047338.473185:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccc3566800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1784047338.473211:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1e00/0x4426598c0c774506 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 7 pid: 66221 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.473232:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0600/0x4426598c0c7743f5 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1a3 expref: 6 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.473269:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77451b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f0 expref: 5 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047338.473287:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccc3566800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1784047338.473661:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047338.474332:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebeba000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047338.474392:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047338.474417:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047338.474436:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7571000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047338.474484:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccebeb8000 for lustre-MDT0000 00000020:00000080:1.0:1784047338.474498:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6da8800 for lustre-MDT0000 00000020:00000080:1.0:1784047338.474503:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccfddd6800 for lustre-MDT0000 00000020:00000080:1.0:1784047338.474517:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5024800 for lustre-MDT0000 00010000:00010000:0.0:1784047338.474627:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047338.474633:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784047338.475673:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccc3566800): rc 0 00000004:00000080:0.0:1784047338.475685:0:88405:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc9140d93ae0 00000100:00080000:0.0:1784047338.475717:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784047338.475721:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784047338.476484:0:88405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784047338.477304:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784047338.477667:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784047338.477671:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 3 00000100:00100000:1.0:1784047338.477764:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709230976:0@lo:39:umount.0 00000100:00100000:1.0:1784047338.477836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.477890:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709230976 00000100:00100000:1.0:1784047338.477898:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709230976 00000100:00100000:1.0:1784047338.477942:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1784047338.477951:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709230976:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784047338.477984:0:83733:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77404b 00000100:00080000:1.0:1784047338.477992:0:83733:0:(import.c:65:import_set_state_nolock()) ffff99ccebebb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047338.478013:0:83733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411436 00000100:00100000:1.0:1784047338.478157:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3644:x1870705709230976:12345-0@lo:39:umount.0 Request processed in 206us (320us total) trans 77309411437 rc 0/0 00000100:00100000:1.0:1784047338.478165:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00010000:00010000:1.0:1784047338.478189:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047338.478216:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784047338.478222:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709230976:0@lo:39:umount.0 00000004:00080000:0.0:1784047338.478557:0:88405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784047338.478641:0:88405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784047338.478658:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccd001a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784047338.478675:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784047338.478678:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968750 gen 3 00000004:00080000:0.0:1784047338.478686:0:88405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784047338.478805:0:88405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784047338.478816:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d83800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1784047338.478865:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cce4978000) has no exports 00000100:00100000:1.0:1784047338.479717:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709231104:0@lo:9:umount.0 00000100:00100000:1.0:1784047338.479773:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.479800:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709231232:0@lo:9:umount.0 00000100:00100000:1.0:1784047338.479822:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047338.479857:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709231104 00000100:00100000:1.0:1784047338.479864:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709231104 00000100:00100000:1.0:1784047338.479897:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709231232 00000100:00100000:1.0:1784047338.479900:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709231232 00000100:00100000:1.0:1784047338.479920:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956 00000100:00100000:1.0:1784047338.479928:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709231104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784047338.479949:0:8824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774059 00000100:00080000:1.0:1784047338.479969:0:8824:0:(import.c:65:import_set_state_nolock()) ffff99ccfe692800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047338.480013:0:8824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968750 00000100:00100000:1.0:1784047338.480130:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709231104:12345-0@lo:9:umount.0 Request processed in 202us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.480137:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956 00000100:00100000:1.0:1784047338.480151:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:1.0:1784047338.480157:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709231232:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784047338.480168:0:8824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774075 00000100:00080000:1.0:1784047338.480173:0:8824:0:(import.c:65:import_set_state_nolock()) ffff99ccc355b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047338.480196:0:8824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968750 00000100:00100000:1.0:1784047338.480284:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709231232:12345-0@lo:9:umount.0 Request processed in 127us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047338.480290:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00010000:00010000:1.0:1784047338.480316:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047338.480321:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047338.480346:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccd001a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00080000:0.0:1784047338.480668:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cce4978000) has no exports 00000004:00080000:1.0:1784047338.486342:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784047338.486353:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784047338.486364:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709231104:0@lo:9:umount.0 00000100:00080000:1.0:1784047338.486406:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d83800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784047338.486419:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784047338.486420:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784047338.486423:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709231232:0@lo:9:umount.0 00000020:00000080:3.0:1784047338.526064:0:6506:0:(genops.c:906:class_export_put()) final put ffff99ccc3566800/2a2569b5-a558-4441-a96a-1d77608df16b 00010000:00010000:3.0:1784047338.526120:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047338.526123:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047338.526125:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784047338.526498:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3566800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-MDT0000 00000020:00000080:2.0:1784047338.526582:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccfddd5800 for lustre-MDT0000 00000020:00000080:0.0:1784047338.556825:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774021 00000020:00000080:0.0:1784047338.556841:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cbc79c2000/lustre-QMT0000_UUID 00000020:01000000:0.0:1784047338.556917:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784047338.556987:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc79c2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1784047338.557009:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047338.557022:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784047338.557026:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99ccc4ac4d40) has no exports 00000020:00000080:1.0:1784047338.557412:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77401a 00000020:00000080:1.0:1784047338.557418:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccd001f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047338.557499:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd001f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047338.557577:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047338.557585:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784047338.557588:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccd0019800/lustre-QMT0000_UUID 00000020:00000080:1.0:1784047338.557591:0:88405:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd0019800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784047338.557595:0:88405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1784047338.557870:0:88405:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cd00117360 - data ffff99ccf31f2438/ffff99ccfe6d9000 00000020:01000000:1.0:1784047338.558004:0:88405:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc781a8a0 - data ffff99ccf79da438/ffff99ccec9b0400 00000100:00080000:0.0:1784047338.597461:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784047338.597471:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784047338.597486:0:88405:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99cce7ed6680 x1870705709230976/t77309411437(77309411437) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047348 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047338.597513:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784047338.598832:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784047338.598836:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 4 00000004:00080000:0.0:1784047338.598886:0:88405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047338.598888:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784047338.599500:0:87104:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784047338.599506:0:87104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:2.0:1784047338.599516:0:87104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:0.0:1784047338.600271:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784047338.600275:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968750 gen 4 00000004:00080000:0.0:1784047338.600292:0:88405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047338.600294:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784047338.600593:0:87106:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784047338.600633:0:87106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:3.0:1784047338.600642:0:87106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:0.0:1784047338.601382:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773fd4 00000020:00000080:0.0:1784047338.601391:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc5e57800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047338.602013:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773fe9 00000020:00000080:0.0:1784047338.602019:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc3567800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047338.602024:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784047338.602030:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047338.602042:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784047338.602046:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99cce497b380) has no exports 00000004:01000000:0.0:1784047338.602192:0:88405:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784047338.602200:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77406e 00000020:00000080:0.0:1784047338.602204:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cbcadfa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047338.602208:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784047338.602212:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047338.602219:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784047338.602222:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99ccc4ac0000) has no exports 00000020:00000080:0.0:1784047338.602227:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774067 00000020:00000080:0.0:1784047338.602230:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cbc1d82800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784047338.602563:0:88405:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784047338.602577:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784047338.602580:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968750 gen 5 00000004:00080000:0.0:1784047338.602585:0:88405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047338.602587:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047338.602638:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047338.602646:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047338.602654:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774052 00000020:00000080:0.0:1784047338.602658:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccf7598000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047338.602662:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784047338.602665:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047338.602669:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784047338.602671:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99cd00100000) has no exports 00000020:00000080:0.0:1784047338.602675:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774044 00000020:00000080:0.0:1784047338.602677:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccd0018000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784047338.602976:0:88405:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784047338.602979:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784047338.602981:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968750 gen 5 00000004:00080000:0.0:1784047338.602985:0:88405:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047338.602986:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047338.603011:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047338.603017:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784047338.603027:0:88405:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784047338.603031:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774036 00000020:00000080:0.0:1784047338.603035:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc5e50800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047338.603038:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784047338.603041:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047338.603045:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784047338.603047:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99ccc4ac19c0) has no exports 00000020:00000080:0.0:1784047338.603051:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77402f 00000020:00000080:0.0:1784047338.603054:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccff3d4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047338.603603:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e57800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047338.603632:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3567800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1784047338.603636:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcadfa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784047338.603641:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc1d82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047338.603645:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc1d83800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784047338.603650:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccc48bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047338.603652:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc48bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784047338.603656:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784047338.603732:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7598000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784047338.603738:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd0018000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047338.603741:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd001a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784047338.603744:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccc5e53000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047338.603746:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784047338.603749:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784047338.603774:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e50800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784047338.603777:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccff3d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784047338.611752:0:88405:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784047338.611763:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047338.611767:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784047338.611775:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047338.611840:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047338.611857:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047338.611892:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047338.611896:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047338.611902:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc3558000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047338.611907:0:88405:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3558000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784047338.611914:0:88405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047338.612029:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773ff0 00000020:00000080:2.0:1784047338.612039:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc3564800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784047338.612043:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784047338.612048:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047338.612054:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047338.612058:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cce497cd40) has no exports 00000020:00000080:2.0:1784047338.612083:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047338.612087:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784047338.612091:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773ff7 00000020:00000080:2.0:1784047338.612095:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc3565800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784047338.612102:0:88405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbcae51000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784047338.612105:0:88405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbcae51000 3 00000020:01000004:2.0:1784047338.612109:0:88405:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cbcae51000 from lustre-MDT0000 00000020:00000080:2.0:1784047338.612128:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047338.612143:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784047338.612146:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc5e53800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784047338.612148:0:88405:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e53800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784047338.612155:0:88405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784047338.612189:0:88405:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784047338.612193:0:88405:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784047338.612196:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784047338.612199:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047338.612202:0:88405:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784047338.612210:0:88405:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99cbc1d84000 d42aef96-772a-4ce2-a768-bea713505b5b 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047338.612216:0:88405:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccc5c02000 6e36843b-2016-43fe-8842-da5818d68597 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047338.612220:0:88405:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff99cd00104d40) has exports, disconnecting them 00000020:00080000:2.0:1784047338.612225:0:88405:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.40@tcp (ffff99cbc1d84000), last request at 1784047302 00000020:00000080:2.0:1784047338.612246:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7740a6 00000020:00010000:2.0:1784047338.612250:0:88405:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cbc1d84000: total 2 00000100:00080000:2.0:1784047338.612255:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d80800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047338.612268:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99cbc1d84000): rc 0 00000020:00080000:2.0:1784047338.612271:0:88405:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ccc5c02000), last request at 1784047301 00000020:00000080:2.0:1784047338.612316:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773f9c 00000020:00010000:2.0:1784047338.612319:0:88405:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccc5c02000: total 2 00000100:00080000:2.0:1784047338.612322:0:88405:0:(import.c:65:import_set_state_nolock()) ffff99ccc5c06800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047338.612334:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc5c02000): rc 0 00000020:00080000:2.0:1784047338.612338:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99cd00104d40) has no exports 00000100:00100000:2.0:1784047338.612405:0:87097:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99cbc9c5da00:87097] 3 exiting: rc = 0 00000100:00100000:3.0:1784047338.612550:0:87092:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ccc1341000:87092] 1 exiting: rc = 0 00000020:00000080:3.0:1784047338.612592:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcaee2000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784047338.612597:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccc5e51800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047338.612599:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e51800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784047338.612630:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784047338.612682:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3564800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784047338.612686:0:45180:0:(genops.c:906:class_export_put()) final put ffff99ccf7570000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784047338.612688:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7570000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784047338.612691:0:45180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784047338.612725:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3565800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1784047338.617533:0:87093:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99cbc6e50c00:87093] 2 exiting: rc = 0 00000020:00010000:2.0:1784047338.617668:0:16468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cbc1d84000: total 0 00010000:00010000:2.0:1784047338.617723:0:16468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cbc1d84000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1784047338.617761:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24bc00/0x4426598c0c774194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae18e expref: 5 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617799:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6de00/0x4426598c0c774186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae180 expref: 4 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617810:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4e00/0x4426598c0c77418d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae187 expref: 3 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617820:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419c00/0x4426598c0c77419b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae195 expref: 2 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617829:0:16468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cbc1d84000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1784047338.617851:0:16468:0:(genops.c:906:class_export_put()) final put ffff99cbc1d84000/d42aef96-772a-4ce2-a768-bea713505b5b 00000020:00010000:2.0:1784047338.617867:0:16468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccc5c02000: total 1 00010000:00010000:2.0:1784047338.617885:0:16468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccc5c02000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784047338.617902:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418000/0x4426598c0c77410f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774108 expref: 14 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617914:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419800/0x4426598c0c77411d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774116 expref: 13 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617924:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0030c00/0x4426598c0c774139 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774132 expref: 12 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617934:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0030a00/0x4426598c0c77412b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774124 expref: 11 pid: 87093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617944:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4000/0x4426598c0c7740e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7740de expref: 10 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617959:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0031200/0x4426598c0c774163 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77415c expref: 9 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617980:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418800/0x4426598c0c774147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774140 expref: 8 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.617990:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419200/0x4426598c0c7740d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7740d0 expref: 7 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.618000:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77414e expref: 6 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.618009:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5200/0x4426598c0c7740f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7740ec expref: 5 pid: 87091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.618019:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c774171 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77416a expref: 4 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.618030:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0031a00/0x4426598c0c774101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7740fa expref: 3 pid: 87092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.618041:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0030600/0x4426598c0c77417f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774178 expref: 2 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047338.618051:0:16468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccc5c02000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784047338.618064:0:16468:0:(genops.c:906:class_export_put()) final put ffff99ccc5c02000/6e36843b-2016-43fe-8842-da5818d68597 00010000:00010000:2.0:1784047338.618069:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047338.618071:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047338.618074:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784047338.618083:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc1d84000/d42aef96-772a-4ce2-a768-bea713505b5b for MGS 00000020:00000080:2.0:1784047338.618125:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c02000/6e36843b-2016-43fe-8842-da5818d68597 for MGS 00000020:00000080:2.0:1784047338.618138:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc1d80800 for MGS 00000020:00000080:2.0:1784047338.618150:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5c06800 for MGS 00000100:00100000:2.0:1784047338.691959:0:87091:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ccff2b6a00:87091] 0 exiting: rc = 1 00010000:00010000:2.0:1784047338.692068:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047338.692133:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692142:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692148:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692154:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692160:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692165:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692172:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692178:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692184:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692193:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692199:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692206:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692213:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692218:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692224:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692229:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692235:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692241:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692246:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692251:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692257:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692262:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692268:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692273:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692278:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692284:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692289:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692294:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692300:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692305:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692311:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692317:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692322:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692327:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692347:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692353:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692368:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692374:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692380:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692386:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692392:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692397:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692403:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692408:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692414:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692420:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692425:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692431:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692437:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692451:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692457:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692462:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692467:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692472:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692477:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692483:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692489:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692494:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692500:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692505:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692512:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692517:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692523:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784047338.692528:0:88405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1784047338.693240:0:88405:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cce7e1ac60 - data ffff99ccf78366c0/ffff99ccefd7a000 00000020:01000000:3.0:1784047338.693355:0:88405:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc5a323c0 - data ffff99ccf79ee948/ffff99cbc6529400 00000020:00000080:3.0:1784047338.693838:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773f95 00000020:00000080:3.0:1784047338.693847:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cd00cff800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784047338.693868:0:88405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbcae51000 from MGS, refs=2 00000020:01000004:3.0:1784047338.693871:0:88405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbcae51000 2 00000020:01000004:3.0:1784047338.693875:0:88405:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cbcae51000 from MGS 00000020:00000080:3.0:1784047338.693898:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047338.693906:0:88405:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784047338.693909:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cbc7a6f000/MGS 00000020:00000080:3.0:1784047338.693912:0:88405:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7a6f000/MGS for MGS 00000020:01000000:3.0:1784047338.693918:0:88405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784047338.693986:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784047338.693990:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047338.693999:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784047338.694006:0:88405:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ccc832a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784047338.694012:0:88405:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99ccfebb19c0) has exports, disconnecting them 00000020:00080000:3.0:1784047338.694016:0:88405:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ccc832a800), last request at 1784047302 00000020:00000080:3.0:1784047338.694021:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7740b4 00000020:00080000:3.0:1784047338.694030:0:88405:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc832a800): rc 0 00000020:00000080:3.0:1784047338.694036:0:88405:0:(genops.c:906:class_export_put()) final put ffff99ccc832a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784047338.694686:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd00cff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047338.694695:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc832a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784047338.695739:0:88405:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784047338.695744:0:88405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047338.695749:0:88405:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784047338.695755:0:88405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047338.695778:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc1d87800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784047338.695910:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047338.695920:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1784047338.695925:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cd00328800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784047338.695928:0:88405:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd00328800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1784047338.695933:0:88405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784047338.696015:0:88405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbcae51000 1 00000020:00000080:2.0:1784047338.696021:0:88405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c773f87 00000020:00000080:2.0:1784047338.696026:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cbc7a68800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784047338.696034:0:88405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784047338.696041:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7a68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047338.696050:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047338.696054:0:88405:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784047338.696057:0:88405:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99cce49799c0) has no exports 00000020:00000080:2.0:1784047338.747172:0:88405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047338.747188:0:88405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784047338.747194:0:88405:0:(genops.c:906:class_export_put()) final put ffff99cbcae52800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047338.747198:0:88405:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcae52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784047338.747209:0:88405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784047338.747319:0:88405:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cbcae51800 00000020:02000400:2.0:1784047338.747438:0:88405:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1784047338.776825:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047338.776848:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709231360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047338.776922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047338.776968:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709231488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047338.776993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047338.777028:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709231360 00000100:00100000:0.0:1784047338.777037:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709231360 00000100:00100000:0.0:1784047338.777078:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709231488 00000100:00100000:0.0:1784047338.777081:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709231488 00000100:00100000:0.0:1784047338.777101:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:0.0:1784047338.777110:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709231360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047338.777139:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047338.777181:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709231360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047338.777188:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:0.0:1784047338.777204:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1784047338.777209:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709231488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047338.777224:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047338.777254:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709231488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047338.777260:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1784047338.777301:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709231360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047338.777335:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709231488:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784047338.783510:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047339.797235:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784047340.182531:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689423232 offset 0 length 224: 4 00000100:00100000:0.0:1784047340.182577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047340.182660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047340.182682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047340.182739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047340.182781:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689423744 00000100:00100000:0.0:1784047340.182792:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689423744 00000100:00100000:3.0:1784047340.182813:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689423616 00000100:00100000:3.0:1784047340.182828:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689423616 00000100:00100000:0.0:1784047340.182873:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2464 00000100:00100000:1.0:1784047340.182940:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689423488 00000100:00100000:1.0:1784047340.182946:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689423488 00000100:00100000:1.0:1784047340.182985:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689423360 00000100:00100000:1.0:1784047340.182988:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689423360 00000100:00100000:1.0:1784047340.183005:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1169 00000100:00100000:1.0:1784047340.183014:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689423488:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047340.183099:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689423488:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 86us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047340.183107:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1169 00000100:00100000:1.0:1784047340.183127:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1168 00000100:00100000:1.0:1784047340.183131:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870705689423360:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:1.0:1784047340.183138:0:68026:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:1.0:1784047340.183162:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870705689423360:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (479us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047340.183168:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1168 00000100:00080000:1.0:1784047340.183322:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047340.183327:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047340.183330:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047340.183396:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689423744:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047340.183451:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689423744:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 568us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047340.188372:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2465 00000100:00100000:3.0:1784047340.188453:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689423616:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047340.188834:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689423616:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 396us (6092us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047340.188847:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2465 00000100:00100000:0.0:1784047340.189822:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2464 00000100:00100000:1.0:1784047340.200601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047340.201132:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689423872 00000100:00100000:2.0:1784047340.201143:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689423872 00000100:00100000:2.0:1784047340.201200:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1169 00000100:00100000:2.0:1784047340.201210:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689423872:12345-192.168.204.40@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784047340.201236:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047340.201325:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689423872:12345-192.168.204.40@tcp:38:ptlrpcd_00_01.0 Request processed in 115us (733us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047340.201332:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1169 00010000:00010000:2.0:1784047340.836572:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047341.843226:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047342.866909:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047343.378887:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709231616:0@lo:400:kworker.0 00000400:00000100:2.0:1784047343.378951:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709231616 offset 0 length 224: 4 00000100:00100000:2.0:1784047343.379019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709232128:0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.379048:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709231872:0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.379057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.379079:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709232640:0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.379088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.379110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047343.379116:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709232384:0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.379135:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784047343.379143:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709232000:0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.379150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.379172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047343.379193:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784047343.379198:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709232512:0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.379203:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709231744:0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.379227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047343.379241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.379261:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232128 00000100:00100000:3.0:1784047343.379264:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709232256:0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.379270:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232128 00000100:00100000:3.0:1784047343.379293:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047343.379330:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232384 00000100:00100000:3.0:1784047343.379335:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232384 00000100:00100000:2.0:1784047343.379343:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709231872 00000100:00100000:2.0:1784047343.379348:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709231872 00000100:00100000:3.0:1784047343.379379:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232512 00000100:00100000:3.0:1784047343.379384:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232512 00000100:00100000:2.0:1784047343.379392:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232640 00000100:00100000:2.0:1784047343.379397:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232640 00000100:00100000:2.0:1784047343.379409:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232000 00000100:00100000:2.0:1784047343.379412:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232000 00000100:00100000:3.0:1784047343.379418:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1784047343.379423:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709231744 00000100:00100000:2.0:1784047343.379427:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709231744 00000100:00100000:3.0:1784047343.379431:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709232384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.379442:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1784047343.379450:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709232128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.379493:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709232384:12345-0@lo:400:kworker.0 Request processed in 65us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047343.379502:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1784047343.379507:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709232128:12345-0@lo:400:kworker.0 Request processed in 56us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047343.379665:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709232768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047343.379672:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:3.0:1784047343.379683:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709232512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047343.379698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047343.379728:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709232512:12345-0@lo:400:kworker.0 Request processed in 46us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047343.379735:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:3.0:1784047343.379777:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709232384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.379810:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232256 00000100:00100000:3.0:1784047343.379813:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232256 00000100:00100000:3.0:1784047343.379836:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232768 00000100:00100000:3.0:1784047343.379839:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232768 00000100:00100000:2.0:1784047343.379844:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1784047343.379859:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1784047343.379865:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1870705709232256:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784047343.379877:0:8442:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784047343.379916:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1870705709232256:12345-0@lo:400:kworker.0 Request processed in 50us (622us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047343.379923:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1784047343.379936:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1784047343.379952:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870705709232768:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1784047343.379957:0:8442:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784047343.379983:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870705709232768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (285us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047343.379989:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:1.0:1784047343.380366:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1784047343.380378:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709231872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047343.380416:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709231872:12345-0@lo:400:kworker.0 Request processed in 43us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047343.380424:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1784047343.380440:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1784047343.380444:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870705709232640:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047343.380450:0:66221:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047343.380471:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870705709232640:12345-0@lo:400:kworker.0 Request processed in 26us (1362us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047343.380477:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1784047343.380487:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1784047343.380490:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870705709232000:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047343.380495:0:66221:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047343.380515:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870705709232000:12345-0@lo:400:kworker.0 Request processed in 24us (1345us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047343.381240:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1784047343.381261:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1784047343.381268:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1870705709231744:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047343.381275:0:66221:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047343.381310:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1870705709231744:12345-0@lo:400:kworker.0 Request processed in 41us (2071us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047343.381316:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:1.0:1784047343.381338:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047343.381343:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047343.381346:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:02020000:1.0:1784047343.381464:0:3645:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784047343.384668:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047343.384677:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047343.384683:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784047343.384811:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784047343.384815:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784047343.384818:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784047343.384823:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047343.384827:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3405 00000100:00080000:2.0:1784047343.384838:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047343.384879:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c20e00 x1870705709232896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047343.384915:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709231744:0@lo:400:kworker.0 00000100:00080000:2.0:1784047343.384929:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784047343.384932:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784047343.384934:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784047343.384939:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047343.384942:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3405 00000100:00080000:2.0:1784047343.384974:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047343.384992:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c20a80 x1870705709233024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047343.385003:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709232256:0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.385024:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709231872:0@lo:400:kworker.0 00000100:00100000:2.0:1784047343.385082:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709232896:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784047343.388143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.388203:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709233024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784047343.388247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.388294:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232896 00000100:00100000:2.0:1784047343.388302:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232896 00000100:00100000:2.0:1784047343.388662:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1784047343.388671:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709232896:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784047343.388693:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047343.388742:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709232896:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 69us (606us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047343.388750:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:2.0:1784047343.388792:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047343.388798:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047343.388802:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709232896:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784047343.392111:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233024 00000100:00100000:3.0:1784047343.392127:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233024 00000100:00100000:3.0:1784047343.392193:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:3.0:1784047343.392201:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709233024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784047343.392222:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047343.392304:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709233024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 102us (4055us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047343.392311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00080000:3.0:1784047343.392369:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047343.392374:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047343.392379:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709233024:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1784047343.396668:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047343.396676:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99cbc6531800 already not connected (conn 47, was 46): DISCONN 00000100:00080000:0.0:1784047343.440132:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047343.440148:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3405 00000100:00080000:0.0:1784047343.440159:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047343.440202:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0062f100 x1870705709233152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047343.440237:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709232000:0@lo:400:kworker.0 00000100:00100000:0.0:1784047343.440276:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709232512:0@lo:400:kworker.0 00000100:00100000:0.0:1784047343.440291:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709232128:0@lo:400:kworker.0 00000100:00080000:0.0:1784047343.440305:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047343.440309:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1784047343.441048:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709233152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784047343.441122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047343.441396:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233152 00000100:00100000:1.0:1784047343.441404:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233152 00000100:00100000:1.0:1784047343.441501:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1784047343.441510:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709233152:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1784047343.441546:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047343.441598:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709233152:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 87us (475us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047343.441624:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00080000:3.0:1784047343.441690:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047343.441695:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047343.441699:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709233152:0@lo:38:ptlrpcd_00_03.0 00000100:02000400:0.0:1784047343.441884:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784047343.441890:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047343.441894:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3405 00000100:00080000:0.0:1784047343.441901:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047343.441924:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0062c000 x1870705709233280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047343.441944:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709232640:0@lo:400:kworker.0 00000100:00100000:3.0:1784047343.442404:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709233280:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784047343.442455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.442701:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233280 00000100:00100000:2.0:1784047343.442709:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233280 00000100:00100000:2.0:1784047343.442756:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1784047343.442763:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709233280:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1784047343.442787:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047343.442825:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709233280:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 61us (369us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047343.442832:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:2.0:1784047343.442869:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047343.442874:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047343.442877:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709233280:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1784047343.890861:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047343.890888:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709233408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047343.890977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047343.891022:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233408 00000100:00100000:0.0:1784047343.891041:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233408 00000100:00100000:0.0:1784047343.891100:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1784047343.891110:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709233408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047343.891145:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047343.891189:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709233408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047343.891195:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1784047343.891245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709233408:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784047343.891280:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047343.891532:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709233536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047343.891561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047343.891670:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233536 00000100:00100000:2.0:1784047343.891676:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233536 00000100:00100000:2.0:1784047343.891715:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1784047343.891723:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709233536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047343.891741:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047343.893400:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709233536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1670us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047343.893414:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1784047343.894360:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709233536:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784047344.914979:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784047344.918477:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047344.918487:0:8425:0:(genops.c:906:class_export_put()) final put ffff99cbcad88800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047344.918803:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcad88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784047344.918877:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccfe692800 for lustre-OST0000 00000001:00100000:0.0:1784047344.927725:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047344.927736:0:9510:0:(genops.c:906:class_export_put()) final put ffff99cbcadfd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047344.928144:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcadfd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784047344.928213:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc355b000 for lustre-OST0001 00000001:00100000:2.0:1784047344.928822:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784047344.928833:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411437 is committed 00000020:00000080:2.0:1784047344.928837:0:75662:0:(genops.c:906:class_export_put()) final put ffff99ccebeb8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047344.928882:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebeb8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1784047344.928944:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccebebb000 for lustre-MDT0001 00000100:00100000:2.0:1784047345.288564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047345.288665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:2.0:1784047345.288695:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689424256 offset 0 length 224: 4 00000100:00100000:2.0:1784047345.288718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047345.288744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047345.288779:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689424512 00000100:00100000:2.0:1784047345.288801:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689424512 00000100:00100000:3.0:1784047345.288854:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689424768 00000100:00100000:2.0:1784047345.288866:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689424384 00000100:00100000:3.0:1784047345.288869:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689424768 00000100:00100000:2.0:1784047345.288873:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689424384 00000100:00100000:2.0:1784047345.288900:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1172 00000100:00100000:2.0:1784047345.288913:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689424512:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047345.288944:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689424640 00000100:00100000:3.0:1784047345.288950:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689424640 00000100:00100000:3.0:1784047345.288992:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2468 00000100:00100000:3.0:1784047345.289012:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689424768:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047345.289012:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689424512:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 93us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047345.289035:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1172 00000100:00100000:2.0:1784047345.289062:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1176 00000100:00100000:2.0:1784047345.289067:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689424384:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047345.289088:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047345.289101:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689424768:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 96us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047345.289112:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2468 00000100:00100000:2.0:1784047345.289127:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689424384:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 56us (378us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047345.289145:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2469 00000100:00100000:2.0:1784047345.289147:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1176 00000100:00100000:3.0:1784047345.289164:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689424640:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047345.289202:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689424640:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047345.289213:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2469 00000100:00080000:1.0:1784047345.289508:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047345.289514:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047345.289518:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784047345.945547:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047346.962997:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047347.990085:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047348.503405:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784047348.503427:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1784047348.503429:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047348.503436:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047348.503448:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3441 00000100:00080000:0.0:1784047348.503455:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047348.503465:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047348.503469:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709233664:0@lo:400:kworker.0 00000100:00100000:0.0:1784047348.503493:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0062f100 x1870705709233792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047348.503538:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000100:3.0:1784047348.503541:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709233664 offset 0 length 224: 4 00000100:00080000:0.0:1784047348.503545:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047348.503548:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047348.503553:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3441 00000100:00080000:0.0:1784047348.503556:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047348.503561:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047348.503573:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd33100 x1870705709234048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047348.503594:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047348.503597:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047348.503599:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047348.503602:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3441 00000100:00100000:3.0:1784047348.503636:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709234176:0@lo:400:kworker.0 00000100:00080000:0.0:1784047348.503637:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047348.503646:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047348.503660:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc5a27800 x1870705709234304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047348.503689:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784047348.503697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047348.503701:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047348.503704:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047348.503708:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3441 00000100:00080000:0.0:1784047348.503712:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047348.503717:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047348.503726:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047348.503732:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc5a26d80 x1870705709234688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047348.503743:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709233920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.503775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047348.503818:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234176 00000100:00100000:3.0:1784047348.503827:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234176 00000100:00100000:0.0:1784047348.503887:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709233792:0@lo:38:kworker.0 00000100:00100000:3.0:1784047348.503897:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233920 00000100:00100000:3.0:1784047348.503902:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233920 00000100:00100000:0.0:1784047348.503928:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047348.503984:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047348.504056:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709234560:0@lo:400:kworker.0 00000100:00100000:2.0:1784047348.504094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047348.504132:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047348.504138:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709234432:0@lo:400:kworker.0 00000100:00100000:2.0:1784047348.504161:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047348.507271:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709234048:0@lo:38:kworker.0 00000100:00100000:0.0:1784047348.507363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047348.512237:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709233792 00000100:00100000:3.0:1784047348.512270:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709233792 00000100:00100000:3.0:1784047348.512356:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1784047348.512382:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709234176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.512650:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709234176:12345-0@lo:400:kworker.0 Request processed in 282us (8953us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047348.512724:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1784047348.512752:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1784047348.512759:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.512797:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709233920:12345-0@lo:400:kworker.0 Request processed in 38us (9021us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047348.512804:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1784047348.512820:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1784047348.512824:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709233792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047348.512849:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047348.512888:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709233792:12345-0@lo:38:kworker.0 Request processed in 63us (8960us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047348.512895:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1784047348.513040:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709233920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.513056:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709234176:0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.513448:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234560 00000100:00100000:3.0:1784047348.513455:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234560 00000100:00100000:3.0:1784047348.513592:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234432 00000100:00100000:3.0:1784047348.513597:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234432 00000100:00100000:3.0:1784047348.513649:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00080000:1.0:1784047348.513769:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047348.513775:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047348.513812:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709234560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.513876:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709234560:12345-0@lo:400:kworker.0 Request processed in 67us (9780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047348.523582:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234048 00000100:00100000:0.0:1784047348.523621:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234048 00000100:00100000:2.0:1784047348.523786:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1784047348.523799:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709234048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047348.523831:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047348.524112:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709234048:12345-0@lo:38:kworker.0 Request processed in 314us (16747us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047348.524131:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00080000:0.0:1784047348.524296:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047348.524302:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047348.524317:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709234048:0@lo:38:kworker.0 00000100:00100000:0.0:1784047348.524331:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709234304:0@lo:38:kworker.0 00000100:00100000:0.0:1784047348.524378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047348.524409:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234304 00000100:00100000:0.0:1784047348.524414:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234304 00000100:00100000:0.0:1784047348.524437:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:0.0:1784047348.524442:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709234304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047348.524454:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047348.524480:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709234304:12345-0@lo:38:kworker.0 Request processed in 37us (102us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047348.524496:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00080000:0.0:1784047348.524522:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047348.524526:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047348.524529:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709234304:0@lo:38:kworker.0 00000100:00100000:0.0:1784047348.524537:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709234688:0@lo:38:kworker.0 00000100:00100000:0.0:1784047348.524562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047348.524578:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:1.0:1784047348.524600:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709234432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784047348.524638:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047348.524644:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047348.524648:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709233792:0@lo:38:kworker.0 00000100:00100000:0.0:1784047348.524672:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234688 00000100:00100000:0.0:1784047348.524676:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234688 00000100:00100000:1.0:1784047348.524697:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709234432:12345-0@lo:400:kworker.0 Request processed in 108us (20534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047348.524701:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1784047348.524710:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709234688:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784047348.524713:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00010000:00020000:0.0:1784047348.524725:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047348.524760:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709234688:12345-0@lo:38:kworker.0 Request processed in 49us (196us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047348.524768:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00080000:1.0:1784047348.524786:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047348.524792:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047348.524803:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709234688:0@lo:38:kworker.0 00000100:00100000:1.0:1784047348.524907:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709234432:0@lo:400:kworker.0 00000100:00100000:1.0:1784047348.524933:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709234560:0@lo:400:kworker.0 00000100:00100000:3.0:1784047348.529904:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00010000:00010000:0.0:1784047349.011418:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047349.011650:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709234816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047349.011887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047349.011949:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047349.011956:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709234944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047349.011981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047349.018180:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234816 00000100:00100000:1.0:1784047349.018204:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234816 00000100:00100000:1.0:1784047349.019384:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709234944 00000100:00100000:1.0:1784047349.019395:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709234944 00000100:00100000:1.0:1784047349.019442:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1784047349.019455:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709234816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047349.019505:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047349.019510:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:3.0:1784047349.019525:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709234944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047349.019548:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047349.020543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709234816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1087us (8652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047349.020553:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:3.0:1784047349.023261:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709234944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3718us (11255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047349.023280:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1784047349.031102:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709234944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047349.031138:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709234816:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784047350.041497:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1784047350.405036:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689424896 offset 0 length 224: 4 00000100:00100000:2.0:1784047350.410985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047350.411040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047350.411091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047350.411210:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047350.411334:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689425152 00000100:00100000:0.0:1784047350.411347:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689425152 00000100:00100000:0.0:1784047350.411515:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689425024 00000100:00100000:0.0:1784047350.411519:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689425024 00000100:00100000:0.0:1784047350.411542:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1175 00000100:00100000:0.0:1784047350.411556:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689425152:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047350.411711:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689425152:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 158us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047350.411732:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1175 00000100:00100000:3.0:1784047350.411749:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1180 00000100:00100000:3.0:1784047350.411759:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689425024:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047350.411787:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047350.411902:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689425280 00000100:00100000:1.0:1784047350.411908:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689425280 00000100:00100000:1.0:1784047350.411951:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689425408 00000100:00100000:1.0:1784047350.411954:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689425408 00000100:00100000:1.0:1784047350.411980:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4958 00000100:00100000:1.0:1784047350.411989:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689425280:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:1.0:1784047350.412016:0:26185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7743d2 00000100:00080000:1.0:1784047350.412026:0:26185:0:(import.c:65:import_set_state_nolock()) ffff99cbc753c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047350.412085:0:26185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968750 00000100:00100000:1.0:1784047350.412258:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+2:2398:x1870705689425280:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 270us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047350.412265:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4958 00000100:00100000:1.0:1784047350.412287:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4959 00000100:00100000:1.0:1784047350.412293:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689425408:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:1.0:1784047350.412307:0:26185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7743d9 00000100:00080000:1.0:1784047350.412312:0:26185:0:(import.c:65:import_set_state_nolock()) ffff99ccc6daa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047350.412337:0:26185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968750 00000100:00100000:1.0:1784047350.412484:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+2:2398:x1870705689425408:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 190us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047350.412492:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4959 00000100:00100000:3.0:1784047350.412520:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689425024:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 759us (1477us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047350.412529:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1180 00000100:00080000:2.0:1784047350.412662:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047350.412667:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047350.412670:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784047350.413316:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047350.418565:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047351.061166:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047352.087970:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047353.109631:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784047353.618850:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047353.618857:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047353.618875:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047353.618884:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3446 00000100:00080000:3.0:1784047353.618890:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784047353.618898:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047353.618923:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9ede300 x1870705709235200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047353.618960:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047353.618963:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047353.618965:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047353.618968:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3446 00000100:00080000:3.0:1784047353.618971:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784047353.618975:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047353.618985:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edca80 x1870705709235456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047353.619009:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047353.619012:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047353.619014:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047353.619017:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3446 00000100:00080000:3.0:1784047353.619019:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784047353.619023:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047353.619036:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd33100 x1870705709235712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047353.619058:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047353.619061:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047353.619069:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047353.619072:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3446 00000100:00080000:3.0:1784047353.619074:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784047353.619077:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047353.619088:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9be4700 x1870705709236096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047353.619123:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709235584:0@lo:400:kworker.0 00000100:00100000:3.0:1784047353.619209:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047353.619258:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047353.619264:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709235840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047353.619291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047353.619335:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235840 00000100:00100000:3.0:1784047353.619344:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235840 00000100:00100000:3.0:1784047353.619409:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1784047353.619421:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709235840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047353.619474:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709235840:12345-0@lo:400:kworker.0 Request processed in 56us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047353.619482:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1784047353.619526:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709235840:0@lo:400:kworker.0 00000100:00100000:2.0:1784047353.619643:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709235328:0@lo:400:kworker.0 00000100:00100000:2.0:1784047353.619674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047353.619695:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784047353.619701:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709235072:0@lo:400:kworker.0 00000400:00000100:2.0:1784047353.619719:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709235072 offset 0 length 224: 4 00000100:00100000:2.0:1784047353.619740:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709235968:0@lo:400:kworker.0 00000100:00100000:2.0:1784047353.619759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047353.619795:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047353.619808:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235968 00000100:00100000:2.0:1784047353.619812:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235968 00000100:00100000:2.0:1784047353.619844:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1784047353.619851:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709235968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047353.619889:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709235968:12345-0@lo:400:kworker.0 Request processed in 39us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047353.619895:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00080000:2.0:1784047353.619911:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047353.619930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709235968:0@lo:400:kworker.0 00000100:00100000:0.0:1784047353.620674:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235584 00000100:00100000:0.0:1784047353.620681:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235584 00000100:00100000:0.0:1784047353.620729:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235328 00000100:00100000:0.0:1784047353.620733:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235328 00000100:00100000:0.0:1784047353.620754:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1784047353.620762:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709235584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047353.620813:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709235584:12345-0@lo:400:kworker.0 Request processed in 52us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047353.620820:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1784047353.620834:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1784047353.620840:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709235328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047353.620870:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709235328:12345-0@lo:400:kworker.0 Request processed in 31us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047353.620877:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:2.0:1784047353.620947:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047353.620976:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709235328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047353.621073:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709235584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047353.622458:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709235200:0@lo:38:kworker.0 00000100:00100000:1.0:1784047353.622529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047353.622559:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709235456:0@lo:38:kworker.0 00000100:00100000:1.0:1784047353.622581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047353.622690:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235200 00000100:00100000:0.0:1784047353.622699:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235200 00000100:00100000:0.0:1784047353.622745:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235456 00000100:00100000:0.0:1784047353.622748:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235456 00000100:00100000:0.0:1784047353.622765:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1784047353.622771:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709235200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047353.622799:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047353.622853:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709235200:12345-0@lo:38:kworker.0 Request processed in 81us (322us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047353.622863:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1784047353.622896:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1784047353.622901:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709235456:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047353.622911:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047353.622950:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709235456:12345-0@lo:38:kworker.0 Request processed in 45us (365us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047353.622961:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1784047353.623081:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709235712:0@lo:38:kworker.0 00000100:00100000:1.0:1784047353.623125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047353.624441:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709236096:0@lo:38:kworker.0 00000100:00100000:1.0:1784047353.624487:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047353.624535:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047353.624540:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047353.624544:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709235200:0@lo:38:kworker.0 00000100:00080000:1.0:1784047353.624554:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047353.624558:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047353.624561:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709235456:0@lo:38:kworker.0 00000100:00100000:3.0:1784047353.625957:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236096 00000100:00100000:3.0:1784047353.625966:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236096 00000100:00100000:3.0:1784047353.626006:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1784047353.626013:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709236096:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047353.626031:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047353.626101:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709236096:12345-0@lo:38:kworker.0 Request processed in 87us (1612us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047353.626108:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00080000:3.0:1784047353.626146:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047353.626151:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047353.626154:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709236096:0@lo:38:kworker.0 00000100:00100000:2.0:1784047353.627337:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709235712 00000100:00100000:2.0:1784047353.627354:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709235712 00000100:00100000:2.0:1784047353.627414:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:2.0:1784047353.627426:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709235712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047353.627452:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047353.627520:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709235712:12345-0@lo:38:kworker.0 Request processed in 96us (4396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047353.627528:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00080000:2.0:1784047353.627571:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047353.627576:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047353.627579:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709235712:0@lo:38:kworker.0 00000100:00100000:0.0:1784047354.131378:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709236224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047354.131482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047354.131571:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236224 00000100:00100000:0.0:1784047354.131581:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236224 00000100:00100000:0.0:1784047354.131666:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:0.0:1784047354.131675:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709236224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047354.131713:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047354.131762:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709236224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047354.131770:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:0.0:1784047354.131828:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709236224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047354.132290:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047354.132315:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709236352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047354.132351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047354.132384:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236352 00000100:00100000:1.0:1784047354.132388:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236352 00000100:00100000:1.0:1784047354.132423:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:1.0:1784047354.132431:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709236352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047354.132452:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047354.132488:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709236352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047354.132496:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:1.0:1784047354.132532:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709236352:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047354.134405:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047355.155870:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1784047355.525246:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689425536 offset 0 length 224: 4 00000100:00100000:3.0:1784047355.525314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047355.525440:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689425792 00000100:00100000:2.0:1784047355.525453:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689425792 00000100:00100000:2.0:1784047355.525566:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1178 00000100:00100000:2.0:1784047355.525597:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689425792:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047355.525797:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689425792:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 219us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047355.525806:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1178 00000100:00080000:0.0:1784047355.525897:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047355.528743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047355.529306:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689425664 00000100:00100000:2.0:1784047355.529324:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689425664 00000100:00100000:2.0:1784047355.529387:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1184 00000100:00100000:2.0:1784047355.529397:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689425664:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047355.529427:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047355.529526:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689425664:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 128us (800us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047355.529534:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1184 00000001:00100000:2.0:1784047355.670479:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047355.670491:0:8425:0:(genops.c:906:class_export_put()) final put ffff99cbc753c000/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:3.0:1784047355.671425:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc753c000/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0000 00000020:00000080:3.0:1784047355.671482:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc753c800 for lustre-OST0000 00000001:00100000:0.0:1784047355.679457:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:0.0:1784047355.679469:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccc6dae800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047355.679696:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dae800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0001 00000020:00000080:2.0:1784047355.679746:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6daa800 for lustre-OST0001 00010000:00010000:2.0:1784047356.186747:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047356.553814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:1.0:1784047356.553854:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689425920 offset 0 length 520: 4 00000100:00100000:1.0:1784047356.553879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047356.553912:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426176 00000100:00100000:1.0:1784047356.553921:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426176 00000100:00100000:1.0:1784047356.553973:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426048 00000100:00100000:1.0:1784047356.553976:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426048 00000100:00100000:1.0:1784047356.553996:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1179 00000100:00100000:1.0:1784047356.554006:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689426176:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047356.554077:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689426176:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047356.554085:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1179 00000100:00100000:1.0:1784047356.554116:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1185 00000100:00100000:1.0:1784047356.554121:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689426048:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:1.0:1784047356.554153:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047356.554180:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689426048:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 57us (300us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047356.554186:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1185 00010000:00010000:0.0:1784047357.203372:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047358.227924:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047358.739036:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047358.739043:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047358.739047:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047358.739055:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3451 00000100:00080000:2.0:1784047358.739071:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047358.739077:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047358.739098:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00fc2680 x1870705709236608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047358.739159:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047358.739163:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047358.739165:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047358.739168:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3451 00000100:00080000:2.0:1784047358.739171:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047358.739174:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047358.739185:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00fc2a00 x1870705709236864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047358.739215:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047358.739218:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047358.739220:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047358.739224:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3451 00000100:00080000:2.0:1784047358.739226:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047358.739229:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047358.739239:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00fc0380 x1870705709237120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047358.739258:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047358.739261:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047358.739263:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047358.739266:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3451 00000100:00080000:2.0:1784047358.739268:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047358.739271:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047358.739279:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edc380 x1870705709237504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047358.739316:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709236608:0@lo:38:kworker.0 00000100:00100000:2.0:1784047358.739385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047358.739417:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709236864:0@lo:38:kworker.0 00000100:00100000:2.0:1784047358.739437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047358.739449:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709237120:0@lo:38:kworker.0 00000100:00100000:2.0:1784047358.739467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047358.739481:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709237504:0@lo:38:kworker.0 00000100:00100000:2.0:1784047358.739496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047358.739524:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709236736:0@lo:400:kworker.0 00000100:00100000:2.0:1784047358.739543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047358.739560:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047358.739565:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709236992:0@lo:400:kworker.0 00000100:00100000:2.0:1784047358.739586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047358.739651:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236608 00000100:00100000:2.0:1784047358.739658:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236608 00000100:00100000:2.0:1784047358.739699:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236864 00000100:00100000:2.0:1784047358.739702:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236864 00000100:00100000:2.0:1784047358.739714:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709237504 00000100:00100000:2.0:1784047358.739716:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709237504 00000100:00100000:2.0:1784047358.739723:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236736 00000100:00100000:2.0:1784047358.739725:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236736 00000100:00100000:2.0:1784047358.739754:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709236992 00000100:00100000:2.0:1784047358.739756:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709236992 00000100:00100000:2.0:1784047358.739773:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1784047358.739781:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709236736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047358.739835:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709236736:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047358.739850:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1784047358.739867:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1784047358.739873:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709236992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047358.739903:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709236992:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047358.739908:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1784047358.739921:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1784047358.739925:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709236608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047358.739941:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047358.739972:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709236608:12345-0@lo:38:kworker.0 Request processed in 45us (586us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047358.739978:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1784047358.739990:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1784047358.739994:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709236864:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047358.740003:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047358.740027:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709236864:12345-0@lo:38:kworker.0 Request processed in 31us (589us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047358.740032:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1784047358.740043:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1784047358.740046:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709237504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047358.740053:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047358.740086:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709237504:12345-0@lo:38:kworker.0 Request processed in 38us (589us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047358.740092:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1784047358.740120:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709237120 00000100:00100000:2.0:1784047358.740124:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709237120 00000100:00100000:2.0:1784047358.740146:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:2.0:1784047358.740150:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709237120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047358.740158:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047358.740184:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709237120:12345-0@lo:38:kworker.0 Request processed in 32us (715us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047358.740190:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00080000:2.0:1784047358.740215:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047358.740248:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709236992:0@lo:400:kworker.0 00000100:00100000:2.0:1784047358.740259:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709236736:0@lo:400:kworker.0 00000100:00080000:2.0:1784047358.740289:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047358.740293:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047358.740295:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709236608:0@lo:38:kworker.0 00000100:00080000:2.0:1784047358.740302:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047358.740305:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047358.740308:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709236864:0@lo:38:kworker.0 00000100:00080000:2.0:1784047358.740314:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047358.740317:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047358.740319:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709237120:0@lo:38:kworker.0 00000100:00080000:2.0:1784047358.740326:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047358.740329:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047358.740331:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709237504:0@lo:38:kworker.0 00000100:00100000:3.0:1784047358.742182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709237248:0@lo:400:kworker.0 00000100:00100000:3.0:1784047358.742255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047358.742358:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784047358.742366:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709236480:0@lo:400:kworker.0 00000400:00000100:3.0:1784047358.742386:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709236480 offset 0 length 224: 4 00000100:00100000:3.0:1784047358.742409:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709237376:0@lo:400:kworker.0 00000100:00100000:3.0:1784047358.742430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047358.742475:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709237248 00000100:00100000:3.0:1784047358.742482:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709237248 00000100:00100000:3.0:1784047358.742532:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709237376 00000100:00100000:3.0:1784047358.742535:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709237376 00000100:00100000:3.0:1784047358.742557:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1784047358.742565:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709237248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047358.742716:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:0.0:1784047358.742728:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709237376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047358.742765:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709237376:12345-0@lo:400:kworker.0 Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047358.742772:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00080000:0.0:1784047358.749841:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047358.749851:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047358.749921:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709237376:0@lo:400:kworker.0 00000100:00100000:3.0:1784047358.758652:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709237248:12345-0@lo:400:kworker.0 Request processed in 16076us (16384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047358.758704:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:0.0:1784047358.762085:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709237248:0@lo:400:kworker.0 00000100:00000400:1.0:1784047359.236871:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047343/real 1784047343] req@ffff99cd00414e00 x1870705709231616/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047359.236904:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99cd00414e00 x1870705709231616/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047359.236913:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784047359.236917:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784047359.236920:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784047359.236922:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784047359.236926:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cd00414e00 x1870705709231616/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047359.236934:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cd0062c000 x1870705709233664/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047359.236952:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbc9eded80 x1870705709235072/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047359.236961:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cd00fc0000 x1870705709236480/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784047359.236972:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784047359.236974:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784047359.236976:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784047359.236977:0:3648:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1784047359.237011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709235072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047359.237017:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709231616:0@lo:400:kworker.0 00000100:00080000:1.0:1784047359.237074:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047359.237078:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784047359.237080:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047359.237085:0:52247:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3400 00000100:00080000:1.0:1784047359.237105:0:52247:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047359.237132:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c17480 x1870705709237632/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047359.237151:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047359.237154:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047359.237156:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047359.237159:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3456 00000100:00080000:1.0:1784047359.237161:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047359.237164:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047359.237176:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c16300 x1870705709237760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047359.237197:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047359.237199:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047359.237201:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047359.237203:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3456 00000100:00080000:1.0:1784047359.237206:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047359.237208:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047359.237220:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c16d80 x1870705709238016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047359.237233:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047359.237244:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047359.237246:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047359.237250:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3456 00000100:00080000:1.0:1784047359.237252:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047359.237255:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047359.237283:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c15880 x1870705709238272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047359.237315:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047359.237318:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047359.237319:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047359.237323:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3456 00000100:00080000:1.0:1784047359.237325:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047359.237328:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047359.237338:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfde0ea00 x1870705709238656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047359.237572:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709237632:0@lo:250:kworker.0 00000400:00000100:1.0:1784047359.237775:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709237632 offset 0 length 520: 4 00000100:00100000:1.0:1784047359.237810:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709237760:0@lo:38:kworker.0 00000100:00100000:0.0:1784047359.237950:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709238400:0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.237988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047359.238020:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709236480:0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.238036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047359.238041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709238528:0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.238075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047359.238124:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238400 00000100:00100000:0.0:1784047359.238131:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238400 00000100:00100000:0.0:1784047359.238168:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238528 00000100:00100000:0.0:1784047359.238171:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238528 00000100:00100000:0.0:1784047359.238192:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1784047359.238201:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709238400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.238248:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709238400:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047359.238269:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1784047359.238285:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:0.0:1784047359.238291:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709238528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.238318:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709238528:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047359.238324:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:0.0:1784047359.238517:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709238528:0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.238539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709238400:0@lo:400:kworker.0 00000100:00100000:1.0:1784047359.238963:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047359.238989:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709238016:0@lo:38:kworker.0 00000100:00100000:1.0:1784047359.239016:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047359.239035:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709238272:0@lo:38:kworker.0 00000100:00100000:1.0:1784047359.239068:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047359.239086:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709238656:0@lo:38:kworker.0 00000100:00100000:1.0:1784047359.239131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047359.239174:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709237760 00000100:00100000:1.0:1784047359.239178:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709237760 00000100:00100000:1.0:1784047359.239200:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238016 00000100:00100000:1.0:1784047359.239204:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238016 00000100:00100000:1.0:1784047359.239215:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238656 00000100:00100000:1.0:1784047359.239217:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238656 00000100:00100000:1.0:1784047359.239226:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1784047359.239232:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709237760:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047359.239249:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047359.239591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709237888:0@lo:400:kworker.0 00000100:00100000:2.0:1784047359.239659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047359.239678:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709233664:0@lo:400:kworker.0 00000100:00100000:2.0:1784047359.239695:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047359.239701:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709238144:0@lo:400:kworker.0 00000100:00100000:2.0:1784047359.239735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047359.239805:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709237888 00000100:00100000:0.0:1784047359.239810:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709237888 00000100:00100000:0.0:1784047359.239834:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238144 00000100:00100000:0.0:1784047359.239848:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238144 00000100:00100000:0.0:1784047359.239860:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1784047359.239866:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709237888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.239912:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709237888:12345-0@lo:400:kworker.0 Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047359.239919:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1784047359.239932:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1784047359.239937:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709238144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047359.239963:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709238144:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047359.239969:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1784047359.239981:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1784047359.239985:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709238016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047359.239995:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047359.240026:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709238016:12345-0@lo:38:kworker.0 Request processed in 39us (1009us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047359.240031:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1784047359.240043:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1784047359.240047:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709238656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047359.240068:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047359.240091:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709238656:12345-0@lo:38:kworker.0 Request processed in 42us (959us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047359.240115:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1784047359.240270:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709237760:12345-0@lo:38:kworker.0 Request processed in 1036us (1307us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047359.240277:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1784047359.240297:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238272 00000100:00100000:1.0:1784047359.240301:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238272 00000100:00100000:1.0:1784047359.240327:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:1.0:1784047359.240332:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709238272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047359.240522:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047359.240551:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709238272:12345-0@lo:38:kworker.0 Request processed in 217us (1481us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047359.240558:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00080000:1.0:1784047359.240832:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047359.240956:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047359.240960:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709237760:0@lo:38:kworker.0 00000100:00080000:1.0:1784047359.240974:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047359.240977:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047359.240980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709238016:0@lo:38:kworker.0 00000100:00080000:1.0:1784047359.241000:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047359.241003:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047359.241006:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709238272:0@lo:38:kworker.0 00000100:00080000:1.0:1784047359.241015:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047359.241018:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047359.241021:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709238656:0@lo:38:kworker.0 00000100:00100000:2.0:1784047359.249285:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709238144:0@lo:400:kworker.0 00000100:00100000:2.0:1784047359.249306:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709237888:0@lo:400:kworker.0 00010000:00010000:3.0:1784047359.253639:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047359.254779:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047359.254801:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709238784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047359.254882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047359.254936:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238784 00000100:00100000:3.0:1784047359.254944:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238784 00000100:00100000:3.0:1784047359.254995:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1784047359.255005:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709238784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047359.255033:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047359.255086:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709238784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047359.255093:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1784047359.255142:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709238784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047359.257574:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047359.257596:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709238912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047359.257695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047359.257759:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709238912 00000100:00100000:2.0:1784047359.257767:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709238912 00000100:00100000:2.0:1784047359.257813:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1784047359.257821:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709238912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047359.258009:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047359.258071:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709238912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 250us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047359.258079:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:3.0:1784047359.258165:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709238912:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784047360.276277:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047361.298862:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047361.670755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047361.670828:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426304 00000100:00100000:2.0:1784047361.670840:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426304 00000100:00100000:2.0:1784047361.670888:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1192 00000100:00100000:2.0:1784047361.670896:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689426304:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047361.670919:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047361.670989:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689426304:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 91us (240us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047361.671014:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1192 00000100:00100000:3.0:1784047361.673044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047361.673121:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426432 00000100:00100000:1.0:1784047361.673133:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426432 00000100:00100000:1.0:1784047361.673227:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1184 00000100:00100000:1.0:1784047361.673239:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689426432:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047361.673314:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689426432:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047361.673322:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1184 00000100:00080000:3.0:1784047361.673897:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047362.322731:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784047362.504103:0:89023:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784047362.504110:0:89023:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784047362.504111:0:89023:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784047362.504987:0:89023:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ccebeba000 00000020:01000004:3.0:1784047362.505018:0:89023:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784047362.505034:0:89023:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784047362.505051:0:89023:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cceff399c0) 00000020:00000080:3.0:1784047362.505070:0:89023:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784047362.719492:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784047362.720391:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.738369:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.743564:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784047362.745087:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.745898:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.746180:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.746546:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784047362.746996:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784047362.747190:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.747544:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.748165:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784047362.748552:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1784047362.749075:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784047362.749368:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784047362.749983:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.750236:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.750545:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.751375:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.751875:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.753094:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.753928:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.754907:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.755700:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.756518:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.757457:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.758186:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.758820:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.759079:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.759458:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.759884:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.760104:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784047362.760338:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784047362.760579:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1784047362.764717:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.765478:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784047362.766739:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784047362.767093:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784047362.767527:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.768211:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784047362.768503:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.768880:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.769135:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.769845:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.770275:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784047362.770549:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784047362.771222:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784047362.779403:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784047362.781077:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784047362.781382:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784047362.783333:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784047362.783688:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784047362.784880:0:89023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1784047362.788318:0:89023:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784047362.788533:0:89023:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784047362.788545:0:89023:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784047362.788558:0:89023:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774530 00000020:01000004:1.0:1784047362.788565:0:89023:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784047362.788576:0:89023:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784047362.788581:0:89023:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccebeba000 from MGS 00000020:01000004:1.0:1784047362.788584:0:89023:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784047362.791920:0:89023:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99ccfebb19c0) 00000020:00000080:0.0:1784047362.791968:0:89023:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:0.0:1784047362.792073:0:89023:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccebeba000 from MGS, refs=2 00080000:01000000:0.0:1784047362.792081:0:89023:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784047362.792088:0:89023:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c77453e 00010000:00010000:0.0:1784047362.792820:0:89023:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784047362.807845:0:89023:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1784047362.814503:0:89027:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784047362.828407:0:89023:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784047362.828502:0:89023:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784047362.832118:0:89023:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784047362.832516:0:89023:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784047362.834386:0:89023:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784047362.834394:0:89023:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784047362.836493:0:89023:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784047362.836506:0:89023:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784047362.838915:0:89023:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784047362.838926:0:89023:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784047362.839554:0:89023:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784047362.839580:0:89023:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1784047362.839581:0:89023:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1784047362.839711:0:89023:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1784047362.839718:0:89023:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 64, was 0): CONNECTING 00000100:00100000:0.0:1784047362.839724:0:89023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:2.0:1784047363.346996:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047364.370801:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047364.370873:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047364.370880:0:45180:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784047364.370883:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047364.370886:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047364.370891:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047364.370900:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3457 00000100:00080000:2.0:1784047364.370904:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047364.370912:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047364.370966:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3d500 x1870705709239040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047364.371019:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047364.371023:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047364.371025:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047364.371028:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3457 00000100:00080000:2.0:1784047364.371031:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047364.371034:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047364.371046:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3fb80 x1870705709239296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047364.371060:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047364.371063:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047364.371078:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047364.371081:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3457 00000100:00080000:2.0:1784047364.371084:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047364.371087:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047364.371099:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3c000 x1870705709239552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047364.371129:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047364.371132:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047364.371134:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047364.371137:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3457 00000100:00080000:2.0:1784047364.371139:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047364.371143:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047364.371153:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3ea00 x1870705709239936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047364.371222:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709239040:0@lo:38:kworker.0 00000100:00100000:1.0:1784047364.371454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.371496:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709239296:0@lo:38:kworker.0 00000100:00100000:0.0:1784047364.371505:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709239424:0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.371523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.371545:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709239552:0@lo:38:kworker.0 00000100:00100000:0.0:1784047364.371551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047364.371637:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239040 00000100:00100000:2.0:1784047364.371645:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239040 00000100:00100000:3.0:1784047364.371671:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709239680:0@lo:400:kworker.0 00000100:00100000:2.0:1784047364.371680:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239296 00000100:00100000:2.0:1784047364.371685:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239296 00000100:00100000:2.0:1784047364.371702:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239424 00000100:00100000:2.0:1784047364.371705:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239424 00000100:00100000:2.0:1784047364.371741:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1784047364.371750:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709239424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.372540:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.372572:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709239936:0@lo:38:kworker.0 00000100:00100000:1.0:1784047364.372601:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.372657:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239936 00000100:00100000:1.0:1784047364.372661:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239936 00000100:00100000:1.0:1784047364.372695:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1784047364.372701:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709239040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047364.372721:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047364.372761:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709239040:12345-0@lo:38:kworker.0 Request processed in 58us (1306us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047364.372768:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1784047364.372787:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1784047364.372791:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709239296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047364.372801:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047364.372826:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709239296:12345-0@lo:38:kworker.0 Request processed in 33us (1303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047364.372832:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1784047364.372843:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1784047364.372848:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709239936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047364.372856:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047364.372879:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709239936:12345-0@lo:38:kworker.0 Request processed in 30us (276us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047364.372885:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1784047364.372911:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239552 00000100:00100000:1.0:1784047364.372914:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239552 00000100:00100000:1.0:1784047364.372934:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:1.0:1784047364.372938:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709239552:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047364.372946:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047364.372983:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709239552:12345-0@lo:38:kworker.0 Request processed in 43us (445us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047364.372998:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00080000:1.0:1784047364.373035:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047364.373040:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047364.373044:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709239040:0@lo:38:kworker.0 00000100:00080000:1.0:1784047364.373054:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047364.373057:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047364.373060:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709239296:0@lo:38:kworker.0 00000100:00080000:1.0:1784047364.373067:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047364.373069:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047364.373072:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709239552:0@lo:38:kworker.0 00000100:00080000:1.0:1784047364.373079:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047364.373081:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047364.373084:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709239936:0@lo:38:kworker.0 00000100:00100000:1.0:1784047364.373140:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709239808:0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.373171:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.373198:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239808 00000100:00100000:1.0:1784047364.373201:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239808 00000100:00100000:1.0:1784047364.373233:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1784047364.373239:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709239808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.373272:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709239808:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047364.373278:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1784047364.373304:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709239808:0@lo:400:kworker.0 00000100:00080000:1.0:1784047364.373354:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047364.373358:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047364.373401:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709239168:0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.373426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.373443:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709240064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047364.373465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.373494:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239168 00000100:00100000:1.0:1784047364.373498:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239168 00000100:00100000:1.0:1784047364.373527:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1784047364.373533:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709239168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.373566:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709239168:12345-0@lo:400:kworker.0 Request processed in 33us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047364.373572:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:1.0:1784047364.373587:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047364.373602:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709239168:0@lo:400:kworker.0 00000100:00100000:1.0:1784047364.373679:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047364.373686:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709240192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047364.373708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047364.373745:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240064 00000100:00100000:1.0:1784047364.373749:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240064 00000100:00100000:1.0:1784047364.373776:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240192 00000100:00100000:1.0:1784047364.373779:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240192 00000100:00100000:1.0:1784047364.373796:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1784047364.373802:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709240064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047364.373822:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047364.373859:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709240064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047364.373871:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1784047364.373883:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1784047364.373888:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709240192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047364.373903:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047364.373930:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709240192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047364.373935:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00080000:1.0:1784047364.373951:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047364.373982:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709240192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047364.373994:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709240064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047364.380765:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709239424:12345-0@lo:400:kworker.0 Request processed in 9004us (9204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047364.380788:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1784047364.380852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047364.380901:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709239680 00000100:00100000:2.0:1784047364.380909:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709239680 00000100:00100000:2.0:1784047364.380984:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1784047364.380994:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709239680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047364.380994:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709239424:0@lo:400:kworker.0 00000100:00100000:2.0:1784047364.381061:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709239680:12345-0@lo:400:kworker.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047364.381068:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:3.0:1784047364.381162:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709239680:0@lo:400:kworker.0 00010000:00010000:3.0:1784047365.395016:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047366.418847:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047366.797023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047366.797078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047366.797127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047366.797300:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426816 00000100:00100000:3.0:1784047366.797310:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426816 00000100:00100000:3.0:1784047366.797378:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426688 00000100:00100000:3.0:1784047366.797382:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426688 00000100:00100000:3.0:1784047366.797400:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1187 00000100:00100000:3.0:1784047366.797410:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689426816:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047366.797487:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689426816:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 78us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047366.797496:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1187 00000100:00100000:3.0:1784047366.797515:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1196 00000100:00100000:3.0:1784047366.797519:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689426688:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047366.797538:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047366.797581:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689426688:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 59us (457us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047366.797588:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1196 00000100:00100000:0.0:1784047366.797806:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426560 00000100:00100000:0.0:1784047366.797822:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426560 00000100:00100000:0.0:1784047366.797853:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1784047366.797858:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1870705689426560:12345-192.168.204.40@tcp:250:kworker.0 00010000:00080000:0.0:1784047366.797874:0:89029:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d42aef96-772a-4ce2-a768-bea713505b5b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3465 last 0 00000020:00000080:0.0:1784047366.797901:0:89029:0:(genops.c:1406:class_connect()) connect: client d42aef96-772a-4ce2-a768-bea713505b5b, cookie 0x4426598c0c774545 00000100:00080000:0.0:1784047366.798052:0:89029:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d77800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047366.798092:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+5:2398:x1870705689426560:12345-192.168.204.40@tcp:250:kworker.0 Request processed in 232us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047366.798100:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00080000:2.0:1784047366.798290:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784047367.442718:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047368.467598:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047368.646091:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047368.646521:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689426944 00000100:00100000:1.0:1784047368.646532:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689426944 00000100:00100000:1.0:1784047368.646592:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1784047368.646603:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+5:42435:x1870705689426944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047368.646645:0:89032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047368.646665:0:89032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1f7 expref: -99 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.646705:0:89032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 6 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.646716:0:89032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 6 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.646724:0:89032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cee00, rc 0) 00000100:00100000:1.0:1784047368.646795:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689426944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 194us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047368.646803:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1784047368.658974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047368.665797:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427072 00000100:00100000:3.0:1784047368.665827:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427072 00000100:00100000:3.0:1784047368.666026:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:3.0:1784047368.666041:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689427072:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784047368.671427:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689427072:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 5368us (12446us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047368.671448:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:3.0:1784047368.687262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047368.690231:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427200 00000100:00100000:0.0:1784047368.690249:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427200 00000100:00100000:0.0:1784047368.690341:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1784047368.690353:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689427200:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047368.690370:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047368.690396:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd200/0x4426598c0c774553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1fe expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047368.690424:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd200/0x4426598c0c774553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1fe expref: 7 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047368.690436:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbd200/0x4426598c0c774553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1fe expref: 7 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047368.690445:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd200, rc 0) 00000100:00100000:0.0:1784047368.690521:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689427200:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 170us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047368.690529:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:2.0:1784047368.698110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047368.698220:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427328 00000100:00100000:3.0:1784047368.698235:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427328 00000100:00100000:3.0:1784047368.698314:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:3.0:1784047368.698328:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689427328:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784047368.700401:0:89033:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784047368.700583:0:89031:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 113 20000000:01000000:2.0:1784047368.714334:0:89034:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784047368.714343:0:89034:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784047368.714347:0:89034:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784047368.714349:0:89034:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784047368.716855:0:89034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784047368.718205:0:89031:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784047368.718331:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689427328:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 19996us (20227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047368.718346:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:3.0:1784047368.724372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047368.732280:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427456 00000100:00100000:1.0:1784047368.732303:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427456 00000100:00100000:1.0:1784047368.732410:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1784047368.732424:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689427456:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047368.732693:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689427456:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 270us (8334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047368.732702:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:2.0:1784047368.742121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047368.742495:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427584 00000100:00100000:1.0:1784047368.742520:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427584 00000100:00100000:1.0:1784047368.742635:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1784047368.742648:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689427584:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047368.742670:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047368.742696:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce600/0x4426598c0c77455a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae205 expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.742735:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce600/0x4426598c0c77455a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae205 expref: 9 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.742750:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce600/0x4426598c0c77455a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae205 expref: 9 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.742783:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce600, rc 0) 00000100:00100000:1.0:1784047368.742878:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689427584:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 223us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047368.742887:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:3.0:1784047368.755555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047368.757073:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427712 00000100:00100000:0.0:1784047368.757089:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427712 00000100:00100000:0.0:1784047368.757178:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:0.0:1784047368.757189:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689427712:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047368.757376:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689427712:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 188us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047368.757399:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1784047368.760962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047368.761101:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427840 00000100:00100000:2.0:1784047368.761130:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427840 00000100:00100000:2.0:1784047368.761196:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:2.0:1784047368.761206:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689427840:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047368.761385:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689427840:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 180us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047368.761393:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:2.0:1784047368.768776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047368.768928:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689427968 00000100:00100000:1.0:1784047368.768941:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689427968 00000100:00100000:1.0:1784047368.769028:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1784047368.769042:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689427968:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047368.769065:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047368.769094:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce800/0x4426598c0c774561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae20c expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.769134:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce800/0x4426598c0c774561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae20c expref: 10 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.769148:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce800/0x4426598c0c774561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae20c expref: 10 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047368.769160:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce800, rc 0) 00000100:00100000:1.0:1784047368.769238:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689427968:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 198us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047368.769246:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:3.0:1784047368.773283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047368.773502:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428096 00000100:00100000:0.0:1784047368.773515:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428096 00000100:00100000:0.0:1784047368.773592:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:0.0:1784047368.773604:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689428096:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047368.773801:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689428096:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 198us (533us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047368.773810:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1784047369.490874:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047359/real 1784047359] req@ffff99ccf2c17480 x1870705709237632/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047369.490916:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047369.490919:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ccf2c17480 x1870705709237632/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047369.490956:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047369.490974:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784047369.490984:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709237632:0@lo:250:kworker.0 00000100:00100000:3.0:1784047369.491010:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709240320:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1784047369.491021:0:89023:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1784047369.491043:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.491057:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.491064:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784047369.491079:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.491092:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4800/0x4426598c0c77416a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774171 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047369.491108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047369.491188:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047369.491196:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784047369.491208:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784047369.491215:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709240448:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784047369.491216:0:45180:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3457 00000100:00080000:2.0:1784047369.491225:0:45180:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784047369.491233:0:45180:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047369.491258:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3f800 x1870705709240576/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047369.491259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047369.491280:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047369.491285:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047369.491287:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047369.491292:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3462 00010000:00010000:0.0:1784047369.491296:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047369.491297:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047369.491305:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047369.491307:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240320 10000000:00010000:0.0:1784047369.491310:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.491321:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784047369.491324:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240320 00000100:00100000:2.0:1784047369.491326:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3f100 x1870705709240704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784047369.491342:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.491350:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0030e00/0x4426598c0c7740d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7740d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.491365:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047369.491375:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:0.0:1784047369.491375:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047369.491384:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047369.491388:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:01000000:0.0:1784047369.491389:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784047369.491393:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240448 00000100:00080000:2.0:1784047369.491395:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3462 00000100:00100000:3.0:1784047369.491397:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240448 00000100:00080000:2.0:1784047369.491400:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1784047369.491405:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784047369.491406:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.491421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709240832:0@lo:400:kworker.0 00000100:00100000:2.0:1784047369.491425:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3c000 x1870705709240960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047369.491432:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1784047369.491447:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709240320:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784047369.491454:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047369.491459:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047369.491461:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784047369.491473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047369.491476:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3462 00000100:00080000:2.0:1784047369.491481:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047369.491486:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00002000:00000024:3.0:1784047369.491487:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047369.491504:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3d500 x1870705709241216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047369.491508:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709241088:0@lo:400:kworker.0 00000100:00080000:2.0:1784047369.491524:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047369.491528:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047369.491531:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047369.491537:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3462 00000100:00100000:3.0:1784047369.491538:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709240320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (428us total) trans 0 rc 0/0 00000100:00080000:2.0:1784047369.491541:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047369.491549:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047369.491553:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:2.0:1784047369.491567:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9eded80 x1870705709241344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047369.491578:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1784047369.491586:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709240448:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784047369.491592:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784047369.491603:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784047369.491630:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047369.491663:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709240448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.491670:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1784047369.491716:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709240448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047369.491743:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709240320:0@lo:13:osp-pre-1-1.0 00000100:00020000:3.0:1784047369.491768:0:3644:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff99cbc9c3f800 x1870705709240576/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047369.491780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.491828:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240832 00000100:00100000:0.0:1784047369.491833:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240832 00000100:00100000:0.0:1784047369.491883:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241088 00000100:00100000:0.0:1784047369.491887:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241088 00000100:00080000:2.0:1784047369.491910:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047369.491911:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1784047369.491920:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709240832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047369.491942:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1784047369.491954:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709241088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047369.491988:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709240832:12345-0@lo:400:kworker.0 Request processed in 66us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.491998:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1784047369.492003:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709241088:12345-0@lo:400:kworker.0 Request processed in 52us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.492011:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1784047369.492051:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709241088:0@lo:400:kworker.0 00000100:00100000:0.0:1784047369.492063:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709240832:0@lo:400:kworker.0 00010000:00010000:0.0:1784047369.492094:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492108:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff419600/0x4426598c0c7740ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7740f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492121:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492128:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492135:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492140:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492144:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c774116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77411d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492154:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492162:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492168:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492191:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492196:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c774124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77412b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492207:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492215:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492239:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492243:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492248:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492258:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492272:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492279:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492286:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492291:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77414e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774155 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492303:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492309:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492315:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492337:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492341:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c774178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77417f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492357:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492383:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492389:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492393:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492398:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418400/0x4426598c0c7740de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7740e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492420:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492427:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492432:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.492436:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492440:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c7740fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492452:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492457:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492471:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047369.492474:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492478:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c774108 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77410f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492500:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492507:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492520:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047369.492524:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492530:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0000/0x4426598c0c774132 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.492550:0:89023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.492556:0:89023:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.492567:0:89023:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047369.492570:0:89023:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047369.492574:0:89023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c77415c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784047369.530341:0:89023:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 65, was 0): CONNECTING 00000100:00080000:0.0:1784047369.530359:0:89023:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1784047369.541726:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047369.541764:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1784047369.541777:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:0:1870705709240576:0@lo:250:kworker.0 00000100:00080000:0.0:1784047369.541807:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047369.541818:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784047369.541823:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047369.541834:0:45180:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3467 00000100:00100000:3.0:1784047369.541853:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709240704:0@lo:38:kworker.0 00000100:00080000:0.0:1784047369.541881:0:45180:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784047369.541895:0:45180:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.541946:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc5a26d80 x1870705709241472/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047369.541962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.542010:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709240960:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.542118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.542166:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709241216:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.542203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.542223:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709241344:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.542247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.542295:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709241472:0@lo:250:kworker.0 00000100:00100000:0.0:1784047369.542324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.542663:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240704 00000100:00100000:3.0:1784047369.542674:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240704 00000100:00100000:3.0:1784047369.542718:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709240960 00000100:00100000:3.0:1784047369.542722:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709240960 00000100:00100000:3.0:1784047369.542745:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241344 00000100:00100000:3.0:1784047369.542749:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241344 00000100:00100000:3.0:1784047369.542769:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1784047369.542777:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709240704:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047369.542803:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047369.542810:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1784047369.542822:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709240960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047369.542843:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047369.542909:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709240704:12345-0@lo:38:kworker.0 Request processed in 123us (948us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047369.542918:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1784047369.542940:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1784047369.542945:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709241344:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047369.542956:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047369.543165:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709240960:12345-0@lo:38:kworker.0 Request processed in 343us (1046us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047369.543174:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:0.0:1784047369.543233:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.543239:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047369.543242:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709240704:0@lo:38:kworker.0 00000100:00080000:0.0:1784047369.543252:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.543256:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047369.543259:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709240960:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.543334:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241216 00000100:00100000:0.0:1784047369.543352:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241216 00000100:00100000:0.0:1784047369.543456:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1784047369.543461:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709241216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047369.543474:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047369.543514:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709241216:12345-0@lo:38:kworker.0 Request processed in 52us (1310us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047369.543520:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00080000:0.0:1784047369.543737:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.543741:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047369.543745:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709241216:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.548797:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241472 00000100:00100000:0.0:1784047369.548818:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241472 00000100:00100000:0.0:1784047369.548909:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784047369.548922:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870705709241472:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1784047369.548965:0:89029:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6e36843b-2016-43fe-8842-da5818d68597@0@lo t0 exp 0000000000000000 cur 3467 last 0 00000020:00000080:0.0:1784047369.549025:0:89029:0:(genops.c:1406:class_connect()) connect: client 6e36843b-2016-43fe-8842-da5818d68597, cookie 0x4426598c0c774568 00000100:00080000:0.0:1784047369.549216:0:89029:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d70000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047369.549489:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+5:3644:x1870705709241472:12345-0@lo:250:kworker.0 Request processed in 568us (7162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.549496:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047369.549895:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 26 00000100:00080000:1.0:1784047369.549906:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:1.0:1784047369.549914:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784047369.549921:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784047369.549926:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784047369.549930:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784047369.549969:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784047369.549986:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709241472:0@lo:250:kworker.0 00000020:01000000:0.0:1784047369.550113:0:45180:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.140@tcp 10000000:01000000:0.0:1784047369.550137:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784047369.550141:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784047369.550143:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784047369.550145:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.550146:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.550148:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.550149:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.550157:0:45180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784047369.550159:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.550160:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047369.550254:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709241600:0@lo:253:kworker.0 00000100:00080000:3.0:1784047369.550273:0:89023:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000000:0.0:1784047369.550496:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784047369.550507:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1784047369.550511:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784047369.550512:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784047369.550515:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.550516:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.550517:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.550519:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.550520:0:45180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784047369.550522:0:89023:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784047369.550523:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.550528:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:3.0:1784047369.550579:0:89023:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784047369.550585:0:89023:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:1.0:1784047369.550738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784047369.550746:0:89023:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000000:0.0:1784047369.550756:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784047369.550764:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1784047369.550767:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784047369.550768:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784047369.550769:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.550770:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.550771:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.550773:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.550774:0:45180:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047369.550776:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.550780:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:3.0:1784047369.550793:0:89023:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000100:00100000:1.0:1784047369.550795:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000004:3.0:1784047369.550805:0:89023:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000100:00100000:1.0:1784047369.550810:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709241728:0@lo:253:kworker.0 00000100:00100000:1.0:1784047369.550842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047369.550882:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241600 00000100:00100000:1.0:1784047369.550888:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241600 00000100:00100000:1.0:1784047369.550928:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241728 00000100:00100000:1.0:1784047369.550930:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241728 00000100:00100000:1.0:1784047369.550943:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784047369.550951:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+6:3647:x1870705709241600:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784047369.550980:0:89031:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784047369.550997:0:89031:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:3.0:1784047369.550998:0:89023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784047369.551002:0:89023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047369.551004:0:89023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047369.551005:0:89023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047369.551008:0:89023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047369.551009:0:89023:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784047369.551010:0:89023:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784047369.551012:0:89023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047369.551019:0:89023:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784047369.551022:0:89023:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784047369.551025:0:89023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784047369.551028:0:89023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784047369.551029:0:89023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047369.551029:0:89023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047369.551030:0:89023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047369.551031:0:89023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047369.551032:0:89023:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784047369.551033:0:89023:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784047369.551034:0:89023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047369.551035:0:89023:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784047369.551126:0:89023:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784047369.551150:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709241984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784047369.551231:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.551422:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc81553c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047369.551480:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241984 00000100:00100000:3.0:1784047369.551486:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241984 00000100:00100000:3.0:1784047369.551531:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784047369.551539:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3647:x1870705709241728:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784047369.551568:0:89029:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000000:0.0:1784047369.551882:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1784047369.551948:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709241856:0@lo:253:kworker.0 00000100:00100000:0.0:1784047369.552004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.552143:0:89032:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1784047369.552154:0:89032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1784047369.552521:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709241856 00000100:00100000:0.0:1784047369.552528:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709241856 00000100:00100000:3.0:1784047369.552653:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784047369.552672:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:89023:x1870705709241984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784047369.552708:0:89035:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784047369.552711:0:89035:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784047369.552716:0:89035:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784047369.552724:0:89035:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784047369.553048:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709241344:12345-0@lo:38:kworker.0 Request processed in 10099us (10797us total) trans 0 rc -19/-19 00000100:00080000:1.0:1784047369.553100:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047369.553110:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047369.553122:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1784047369.553129:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709241344:0@lo:38:kworker.0 20000000:01000000:2.0:1784047369.559038:0:89031:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784047369.559069:0:89031:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784047369.559298:0:89029:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784047369.559534:0:89033:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784047369.559545:0:89033:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784047369.559577:0:89033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.559622:0:89033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 9 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.559634:0:89033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.559689:0:89033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 9 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.559710:0:89033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 9 pid: 89032 timeout: 3567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047369.559740:0:89033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89033:1870705709242112:192.168.204.40@tcp:104: 00000100:00100000:0.0:1784047369.563893:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:89023:x1870705709241984:12345-0@lo:253:mount.lustre.0 Request processed in 11212us (12648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.563912:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784047369.563992:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784047369.564007:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+7:3645:x1870705709241856:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784047369.564480:0:89035:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:0.0:1784047369.565030:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784047369.565034:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784047369.565036:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.565037:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.565038:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.565040:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.565042:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784047369.565045:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.565047:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047369.565052:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709241600:0@lo:253:kworker.0 00000100:00100000:2.0:1784047369.565498:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+7:3647:x1870705709241600:12345-0@lo:253:kworker.0 Request processed in 14535us (14752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.565517:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784047369.572127:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709241984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784047369.572154:0:89023:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784047369.572175:0:89023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784047369.572177:0:89023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784047369.572178:0:89023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047369.572179:0:89023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047369.572181:0:89023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047369.572182:0:89023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047369.572183:0:89023:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784047369.572185:0:89023:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784047369.572187:0:89023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047369.572188:0:89023:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784047369.573221:0:89023:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccebeba000 from lustre-MDT0000 10000000:01000000:2.0:1784047369.573495:0:89023:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784047369.573499:0:89023:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784047369.573509:0:89023:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccebeba000 10000000:01000000:2.0:1784047369.573514:0:89023:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784047369.573519:0:89023:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ccebeba000 10000000:01000000:2.0:1784047369.573523:0:89023:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784047369.573526:0:89023:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccebeba000 from 1 10000000:01000000:2.0:1784047369.573528:0:89023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784047369.573569:0:89023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.573581:0:89023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.573593:0:89023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.573642:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784047369.573710:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.573756:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709242240 00000100:00100000:2.0:1784047369.573763:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709242240 00000100:00100000:2.0:1784047369.573820:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047369.573832:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+7:89023:x1870705709242240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047369.573845:0:89032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784047369.573870:0:89033:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494540 going to sleep for 11 seconds 00010000:00010000:2.0:1784047369.573875:0:89032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1000/0x4426598c0c77457d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774576 expref: -99 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.573920:0:89032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1000/0x4426598c0c77457d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774576 expref: 8 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.573932:0:89032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1000/0x4426598c0c77457d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774576 expref: 8 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.573943:0:89032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1000, rc 0) 00000100:00100000:2.0:1784047369.573974:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:89023:x1870705709242240:12345-0@lo:101:mount.lustre.0 Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.573981:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047369.574020:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.574039:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047369.574052:0:89023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574061:0:89023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047369.574077:0:89023:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784047369.574102:0:89023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574110:0:89023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047369.574118:0:89023:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784047369.574121:0:89023:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784047369.574131:0:89023:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ccebeba000 10000000:01000000:2.0:1784047369.574134:0:89023:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784047369.574136:0:89023:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784047369.574139:0:89023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784047369.574154:0:89023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574160:0:89023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574167:0:89023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.574180:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784047369.574203:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.574223:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709242368 00000100:00100000:2.0:1784047369.574227:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709242368 00000100:00100000:2.0:1784047369.574248:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784047369.574266:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:89023:x1870705709242368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047369.574272:0:89032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047369.574280:0:89032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0e00/0x4426598c0c77458b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774584 expref: -99 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574293:0:89032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0e00/0x4426598c0c77458b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774584 expref: 9 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574301:0:89032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0e00/0x4426598c0c77458b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774584 expref: 9 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574308:0:89032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0e00, rc 0) 00000100:00100000:2.0:1784047369.574519:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:89023:x1870705709242368:12345-0@lo:101:mount.lustre.0 Request processed in 254us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.574525:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784047369.574549:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.574562:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047369.574571:0:89023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.574579:0:89023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.574651:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047369.574674:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.574693:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709242496 00000100:00100000:2.0:1784047369.574696:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709242496 00000100:00100000:2.0:1784047369.574715:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784047369.574720:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:89023:x1870705709242496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047369.574918:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709242496:12345-0@lo:501:mount.lustre.0 Request processed in 133us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.574927:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784047369.574950:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.574961:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047369.574986:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047369.575024:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.575042:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709242624 00000100:00100000:2.0:1784047369.575046:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709242624 00000100:00100000:2.0:1784047369.575070:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784047369.575076:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709242624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047369.575229:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0020e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.583385:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709242624:12345-0@lo:503:mount.lustre.0 Request processed in 8298us (8350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.583401:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784047369.585172:0:89033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89033:1870705709242112:192.168.204.40@tcp:104: 00010000:00010000:0.0:1784047369.585203:0:89033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.585778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047369.588327:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428224 00000100:00100000:3.0:1784047369.588343:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428224 00010000:00010000:3.0:1784047369.588389:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 10 pid: 89032 timeout: 3567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047369.588436:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2537 00000100:00100000:3.0:1784047369.588447:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689428224:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047369.588462:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047369.588468:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 10 pid: 89032 timeout: 3567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588481:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 10 pid: 89032 timeout: 3567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588500:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cee00/0x4426598c0c77454c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1f7 expref: 10 pid: 89032 timeout: 3567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588519:0:10393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588527:0:10393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784047369.588561:0:10393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029018217s 00010000:00010000:3.0:1784047369.588567:0:10393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588574:0:10393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588581:0:10393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588589:0:10393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588595:0:10393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047369.588599:0:10393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588649:0:10393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588666:0:10393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.588677:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047369.588737:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d42aef96-772a-4ce2-a768-bea713505b5b+9:2401:x1870705689428224:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 291us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.588746:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2537 00010000:00010000:2.0:1784047369.590344:0:89033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.590360:0:89033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.590368:0:89033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce000/0x4426598c0c77456f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047369.591735:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709242624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047369.592459:0:89036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89036:1870705709242752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047369.592539:0:89036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.593377:0:89036:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00ed3c00 going to sleep for 11 seconds 20000000:01000000:0.0:1784047369.593506:0:89029:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047369.593522:0:89029:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784047369.593718:0:89035:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784047369.595936:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:3647:x1870705709241728:12345-0@lo:253:kworker.0 Request processed in 44388us (45083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.595949:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784047369.595994:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709242752 00000100:00100000:0.0:1784047369.596003:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709242752 00000020:01000004:1.0:1784047369.596098:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784047369.596101:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784047369.596103:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047369.596104:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047369.596105:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047369.596107:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047369.596109:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047369.596110:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047369.596111:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047369.596115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709241728:0@lo:253:kworker.0 20000000:01000000:3.0:1784047369.596395:0:89033:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784047369.596400:0:89033:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784047369.596426:0:89033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596445:0:89033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784047369.596457:0:89033:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029018217s 00010000:00010000:3.0:1784047369.596461:0:89033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596468:0:89033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596474:0:89033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596481:0:89033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596488:0:89033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047369.596494:0:89033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596502:0:89033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596516:0:89033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596524:0:89033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.596538:0:89033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419a00/0x4426598c0c774592 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.601158:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784047369.601188:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:89036:x1870705709242752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047369.602471:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:89036:x1870705709242752:12345-0@lo:502:llog_process_th.0 Request processed in 1294us (9926us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.602483:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784047369.602572:0:89036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89036:1870705709242752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047369.602672:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047369.602683:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.602686:0:89036:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 20000000:01000000:3.0:1784047369.602691:0:89035:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000020:01000000:1.0:1784047369.602692:0:89036:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784047369.602697:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 20000000:01000000:3.0:1784047369.602711:0:89035:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000020:00000080:1.0:1784047369.602713:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cd00104d40) 00000020:00000080:1.0:1784047369.602739:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1784047369.602745:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1784047369.603035:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3645:x1870705709241856:12345-0@lo:253:kworker.0 Request processed in 39033us (51029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.603044:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 20000000:01000000:2.0:1784047369.603082:0:89033:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047369.603087:0:89033:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047369.603108:0:89033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603124:0:89033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784047369.603145:0:89033:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029018217s 00010000:00010000:2.0:1784047369.603150:0:89033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603156:0:89033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603163:0:89033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603170:0:89033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603176:0:89033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047369.603180:0:89033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603189:0:89033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:01000000:1.0:1784047369.603196:0:89036:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00010000:00010000:2.0:1784047369.603203:0:89033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784047369.603204:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7745a7 00010000:00010000:2.0:1784047369.603210:0:89033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.603217:0:89033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0200/0x4426598c0c7745a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784047369.603670:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784047369.603677:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047369.603682:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.603683:0:89036:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784047369.603686:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047369.603690:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.603691:0:89036:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784047369.603694:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047369.603703:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cd00100000) 00000020:00000080:1.0:1784047369.603716:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1784047369.603719:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784047369.603721:0:89036:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784047369.603724:0:89036:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784047369.603730:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784047369.603776:0:89036:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccebeba000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784047369.603788:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cd00103380) 00000020:00000080:1.0:1784047369.603798:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1784047369.604162:0:89036:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784047369.604170:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c7745bc 00000020:01000004:0.0:1784047369.604291:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784047369.604295:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784047369.604297:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.604298:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.604300:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.604301:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.604303:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047369.604305:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.604306:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047369.604310:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709241856:0@lo:253:kworker.0 00000020:00000080:1.0:1784047369.604755:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784047369.604773:0:89036:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784047369.604780:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4426598c0c7745c3 00080000:01000000:1.0:1784047369.604786:0:89036:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784047369.604790:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7745ca 00010000:00010000:0.0:1784047369.681245:0:89036:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1784047369.681411:0:89036:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a2569b5-a558-4441-a96a-1d77608df16b idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:0.0:1784047369.681458:0:89036:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:0.0:1784047369.681481:0:89036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:0.0:1784047369.681599:0:89036:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1784047369.681678:0:89036:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cd0060bc00: xid 1870705689418880, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:0.0:1784047369.681690:0:89036:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cd0060b540: xid 1870705689419136, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:0.0:1784047369.682228:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ccfebb4d40) 00000020:00000080:0.0:1784047369.682254:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1784047369.682336:0:89036:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784047369.682344:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7745e6 00000020:00000080:1.0:1784047369.682893:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784047369.705689:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4426598c0c7745ed 00000020:00000080:1.0:1784047369.709158:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784047369.709173:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047369.709180:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.709183:0:89036:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784047369.709187:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784047369.709190:0:89036:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784047369.709191:0:89036:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047369.709192:0:89036:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047369.709194:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784047369.709197:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.709198:0:89036:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784047369.709201:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047369.709206:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.709208:0:89036:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784047369.709212:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784047369.709264:0:89036:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784047369.709278:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047369.709281:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.709282:0:89036:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784047369.709285:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047369.709288:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.709290:0:89036:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784047369.709292:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784047369.709298:0:89036:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:1.0:1784047369.709333:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047369.709349:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99cd001019c0) 00000020:00000080:1.0:1784047369.709426:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784047369.709433:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784047369.709505:0:89036:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784047369.709511:0:89036:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784047369.709518:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7745fb 00010000:00080000:1.0:1784047369.709799:0:89036:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbcaee7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1784047369.712787:0:89036:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1784047369.714333:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047369.714348:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784047369.714387:0:89036:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784047369.714412:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774602 00000100:00080000:1.0:1784047369.714424:0:89036:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784047369.714430:0:89036:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cbcaee7800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047369.714464:0:89036:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c15880 x1870705709242880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047369.714496:0:89036:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784047369.714587:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709242880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047369.714677:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.714813:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709242880 00000020:01000000:1.0:1784047369.714816:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047369.714821:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.714825:0:89036:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784047369.714828:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:2.0:1784047369.714829:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709242880 00000020:01000000:1.0:1784047369.714831:0:89036:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1784047369.714834:0:89036:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047369.714836:0:89036:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047369.714837:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784047369.714840:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.714842:0:89036:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784047369.714845:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784047369.714850:0:89036:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784047369.714865:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047369.714867:0:89036:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784047369.714870:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784047369.714874:0:89036:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:1.0:1784047369.714896:0:89036:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784047369.714903:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047369.714916:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cbc9898000) 00000020:00000080:1.0:1784047369.714939:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1784047369.714945:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1784047369.714993:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000004:00080000:1.0:1784047369.715008:0:89036:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784047369.715016:0:89036:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784047369.715022:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774610 00010000:00080000:1.0:1784047369.715051:0:89036:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cce4927800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00000100:00100000:2.0:1784047369.715068:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709242880:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784047369.715099:0:23872:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3467 last 0 00000020:00000080:2.0:1784047369.715142:0:23872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774617 00000004:00100000:2.0:1784047369.715158:0:23872:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047369.715275:0:23872:0:(import.c:65:import_set_state_nolock()) ffff99ccc5c01800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047369.715339:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709242880:12345-0@lo:38:llog_process_th.0 Request processed in 273us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.715360:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00010000:00010000:1.0:1784047369.715583:0:89036:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1784047369.715636:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047369.715646:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1784047369.715653:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784047369.715658:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784047369.715661:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784047369.715936:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709242880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047369.715977:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709243008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047369.716018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.716139:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243008 00000100:00100000:0.0:1784047369.716145:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243008 00000100:00100000:0.0:1784047369.716183:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1784047369.716192:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709243008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047369.716220:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047369.716266:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709243008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.716273:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:1.0:1784047369.716349:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709243008:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1784047369.717937:0:89036:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784047369.717986:0:89036:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784047369.718268:0:89036:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1784047369.719675:0:89036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784047369.719709:0:89036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:0.0:1784047369.719894:0:89036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1784047369.720258:0:89042:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1784047369.720271:0:89042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784047369.720429:0:89042:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1784047369.720445:0:89042:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784047369.720589:0:89042:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1784047369.720593:0:89042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784047369.721265:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047369.721279:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784047369.721322:0:89036:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784047369.721448:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77461e 00000100:00080000:0.0:1784047369.721458:0:89036:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047369.721463:0:89036:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cce4927800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.721549:0:89036:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3d500 x1870705709243136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047369.721629:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709243136:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784047369.721692:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047369.721746:0:89036:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784047369.721793:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047369.721796:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.721798:0:89036:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784047369.721801:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784047369.721803:0:89036:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1784047369.721804:0:89036:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047369.721806:0:89036:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047369.721807:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784047369.721809:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.721810:0:89036:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784047369.721812:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784047369.721815:0:89036:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784047369.721818:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.721819:0:89036:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784047369.721820:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784047369.721823:0:89036:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:0.0:1784047369.721840:0:89036:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784047369.721843:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784047369.721863:0:89036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cbc76ccd40) 00000020:00000080:0.0:1784047369.721880:0:89036:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1784047369.721886:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1784047369.721928:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243136 00000100:00100000:1.0:1784047369.721938:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243136 00000004:00080000:0.0:1784047369.721964:0:89036:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784047369.721970:0:89036:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784047369.721985:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c77462c 00000100:00100000:1.0:1784047369.721990:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4960 00000100:00100000:1.0:1784047369.722000:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3644:x1870705709243136:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784047369.722028:0:26180:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3467 last 0 00000020:00000080:1.0:1784047369.722050:0:26180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774633 00002000:00100000:1.0:1784047369.722064:0:26180:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ccec801000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784047369.722069:0:26180:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784047369.722072:0:26180:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1784047369.722094:0:89036:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccf2d7f000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00002000:00080000:1.0:1784047369.722136:0:26180:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784047369.722158:0:26180:0:(import.c:65:import_set_state_nolock()) ffff99ccec804800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047369.722225:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709243136:12345-0@lo:8:llog_process_th.0 Request processed in 225us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047369.722235:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4960 00000100:00100000:2.0:1784047369.722266:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047369.722278:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784047369.722285:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784047369.722292:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784047369.722295:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1784047369.722296:0:89036:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000004:00080000:2.0:1784047369.722311:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784047369.722317:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709243136:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784047369.722410:0:89042:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000040:01000000:0.0:1784047369.722451:0:89036:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:1.0:1784047369.722462:0:89042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3467974854406ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784047369.722468:0:89042:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:01000000:0.0:1784047369.722471:0:89036:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784047369.722695:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709243264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047369.722743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047369.722782:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243264 00000100:00100000:1.0:1784047369.722787:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243264 00000100:00100000:1.0:1784047369.722844:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:1.0:1784047369.722866:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709243264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047369.722885:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047369.722934:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709243264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047369.722940:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00080000:0.0:1784047369.722950:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047369.723027:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709243264:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1784047369.723335:0:89036:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000004:00080000:3.0:1784047369.724266:0:89024:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1784047369.724432:0:89036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784047369.724464:0:89036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:0.0:1784047369.724640:0:89036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:2.0:1784047369.725154:0:89044:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:2.0:1784047369.725159:0:89044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784047369.725288:0:89044:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1784047369.725303:0:89044:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784047369.725428:0:89044:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:2.0:1784047369.725431:0:89044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784047369.726365:0:89036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047369.726375:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784047369.726405:0:89036:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784047369.726427:0:89036:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77463a 00000100:00080000:0.0:1784047369.726436:0:89036:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047369.726440:0:89036:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ccf2d7f000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.726468:0:89036:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3f800 x1870705709243392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047369.726489:0:89036:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784047369.726568:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709243392:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784047369.726669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784047369.726791:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047369.726795:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.726797:0:89036:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784047369.726800:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047369.726803:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.726805:0:89036:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784047369.726808:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784047369.726809:0:89036:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784047369.726811:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047369.726814:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.726815:0:89036:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784047369.726818:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047369.726826:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.726828:0:89036:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784047369.726832:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784047369.726870:0:89036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89036:1870705709243520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.726914:0:89036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.726944:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243520 00000100:00100000:0.0:1784047369.726950:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243520 00000100:00100000:0.0:1784047369.726986:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047369.726995:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:89036:x1870705709243520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.727111:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:89036:x1870705709243520:12345-0@lo:502:llog_process_th.0 Request processed in 115us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.727118:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047369.727153:0:89036:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc34810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.727172:0:89036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89036:1870705709243520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784047369.727196:0:89036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047369.727199:0:89036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.727201:0:89036:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784047369.727204:0:89036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1784047369.727601:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243392 00000100:00100000:1.0:1784047369.727635:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243392 00000100:00100000:1.0:1784047369.727662:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961 00000100:00100000:1.0:1784047369.727667:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870705709243392:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784047369.727693:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3467 last 0 00000020:00000080:1.0:1784047369.727733:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774641 00002000:00100000:1.0:1784047369.727753:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99ccec800000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784047369.727757:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784047369.727760:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784047369.727825:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784047369.727849:0:8433:0:(import.c:65:import_set_state_nolock()) ffff99ccec805800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047369.727911:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709243392:12345-0@lo:8:llog_process_th.0 Request processed in 241us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047369.727918:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961 00000020:01000000:2.0:1784047369.728088:0:89023:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1784047369.728115:0:89023:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784047369.728128:0:89023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.728139:0:89023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047369.728148:0:89023:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccebeba000 from 1 10000000:01000000:2.0:1784047369.728150:0:89023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784047369.728180:0:89023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.728188:0:89023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047369.728244:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784047369.728252:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:2.0:1784047369.728254:0:89023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784047369.728258:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784047369.728263:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784047369.728265:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784047369.728270:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709243648:0@lo:101:mount.lustre.0 00000004:00080000:0.0:1784047369.728281:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784047369.728287:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709243392:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784047369.728314:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.728336:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243648 00000100:00100000:2.0:1784047369.728338:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483180 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.728340:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243648 00000100:00100000:0.0:1784047369.728374:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784047369.728380:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709243776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047369.728387:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:89023:x1870705709243648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047369.728396:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784047369.728405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047369.728410:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774648 expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.728430:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774648 expref: 9 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.728437:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243776 00000100:00100000:2.0:1784047369.728440:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243776 00010000:00010000:0.0:1784047369.728440:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774648 expref: 9 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.728449:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd800, rc 0) 00000100:00100000:2.0:1784047369.728471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1784047369.728477:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709243776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047369.728478:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:89023:x1870705709243648:12345-0@lo:101:mount.lustre.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.728484:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00002000:00000024:2.0:1784047369.728489:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047369.728533:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709243776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.728540:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00080000:2.0:1784047369.728556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047369.728576:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709243648:0@lo:101:mount.lustre.0 00000004:00080000:1.0:1784047369.728587:0:89044:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1784047369.728588:0:89023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.728597:0:89023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047369.728670:0:89044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3467981062354ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784047369.728676:0:89044:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784047369.728996:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709243776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047369.729479:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709243904:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784047369.729655:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.729680:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483180 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.729780:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709243904 00000100:00100000:0.0:1784047369.729787:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709243904 00000100:00100000:0.0:1784047369.729866:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784047369.729874:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:89023:x1870705709243904:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784047369.729890:0:89031:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784047369.729906:0:89031:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784047369.729910:0:89031:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784047369.729913:0:89031:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784047369.729916:0:89031:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 116 00000100:00100000:0.0:1784047369.730013:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:89023:x1870705709243904:12345-0@lo:256:mount.lustre.0 Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.730022:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784047369.730339:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709243904:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784047369.730970:0:89023:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784047369.730986:0:89023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.731005:0:89023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047369.731013:0:89023:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccebeba000 from 1 10000000:01000000:2.0:1784047369.731016:0:89023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047369.731045:0:89023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.731053:0:89023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.731068:0:89023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.731087:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784047369.731118:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784047369.731416:0:89024:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784047369.731678:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047369.731777:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244032 00000100:00100000:3.0:1784047369.731783:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244032 00000100:00100000:3.0:1784047369.731829:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784047369.731838:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:89023:x1870705709244032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047369.731849:0:89035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047369.731871:0:89035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419a00/0x4426598c0c77465d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774656 expref: -99 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.731895:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419a00/0x4426598c0c77465d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774656 expref: 10 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.731906:0:89035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419a00/0x4426598c0c77465d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774656 expref: 10 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.731928:0:89035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419a00, rc 0) 00000100:00100000:3.0:1784047369.731969:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709244032:12345-0@lo:101:mount.lustre.0 Request processed in 132us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.731976:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784047369.732100:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047369.732113:0:89023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.732121:0:89023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.732177:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047369.732202:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.732219:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047369.732319:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244160 00000100:00100000:3.0:1784047369.732322:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244160 00000100:00100000:3.0:1784047369.732347:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784047369.732352:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709244160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047369.732448:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709244160:12345-0@lo:501:mount.lustre.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.732454:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784047369.732583:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047369.732651:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047369.732689:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.732705:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047369.732784:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244288 00000100:00100000:3.0:1784047369.732788:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244288 00000100:00100000:3.0:1784047369.732844:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784047369.732860:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709244288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047369.732944:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709244288:12345-0@lo:503:mount.lustre.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.732949:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784047369.733010:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047369.733580:0:89046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89046:1870705709244416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.733685:0:89046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.733745:0:89046:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc5184780 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.733777:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244416 00000100:00100000:2.0:1784047369.733781:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244416 00000100:00100000:2.0:1784047369.733847:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784047369.733863:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:89046:x1870705709244416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047369.734342:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:89046:x1870705709244416:12345-0@lo:502:llog_process_th.0 Request processed in 487us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.734350:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784047369.734467:0:89046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89046:1870705709244416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784047369.734493:0:89046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047369.734502:0:89046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.734504:0:89046:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784047369.734511:0:89046:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccebeba000 00000020:00000080:0.0:1784047369.734514:0:89046:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784047369.734523:0:89046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047369.734525:0:89046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.734527:0:89046:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784047369.734529:0:89046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047369.734533:0:89046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.734534:0:89046:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784047369.734538:0:89046:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccebeba000 00000020:00000080:0.0:1784047369.734540:0:89046:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784047369.734640:0:89046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89046:1870705709244544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.734678:0:89046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.736830:0:89046:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc83743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047369.736920:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244544 00000100:00100000:1.0:1784047369.736931:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244544 00000100:00100000:1.0:1784047369.736988:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784047369.736998:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:89046:x1870705709244544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047369.737257:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:89046:x1870705709244544:12345-0@lo:502:llog_process_th.0 Request processed in 260us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047369.737265:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784047369.737471:0:89046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89046:1870705709244544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784047369.737504:0:89046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047369.737511:0:89046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047369.737513:0:89046:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784047369.737517:0:89046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784047369.737787:0:89023:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784047369.737811:0:89023:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784047369.737880:0:89023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.737893:0:89023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047369.737960:0:89023:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784047369.737964:0:89023:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccebeba000 10000000:01000000:3.0:1784047369.737967:0:89023:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccebeba000 10000000:01000000:3.0:1784047369.737971:0:89023:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784047369.737976:0:89023:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccebeba000 from 1 10000000:01000000:3.0:1784047369.737979:0:89023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047369.738014:0:89023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.738022:0:89023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047369.738031:0:89023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047369.738052:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784047369.738105:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.738141:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.738240:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244672 00000100:00100000:0.0:1784047369.738245:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244672 00000100:00100000:0.0:1784047369.738283:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784047369.738291:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:89023:x1870705709244672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047369.738318:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047369.738331:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77466b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774664 expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.738354:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77466b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774664 expref: 11 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.738364:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77466b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774664 expref: 11 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.738372:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd400, rc 0) 00000100:00100000:0.0:1784047369.738405:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709244672:12345-0@lo:101:mount.lustre.0 Request processed in 114us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.738411:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784047369.738446:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047369.738458:0:89023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.738467:0:89023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047369.738516:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047369.738541:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.738555:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc83743c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.738697:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244800 00000100:00100000:0.0:1784047369.738701:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244800 00000100:00100000:0.0:1784047369.738727:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047369.738732:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709244800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047369.738849:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709244800:12345-0@lo:501:mount.lustre.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.738868:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047369.738904:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047369.738931:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047369.738966:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.738985:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc834fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.738996:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709244928 00000100:00100000:0.0:1784047369.739000:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709244928 00000100:00100000:0.0:1784047369.739019:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784047369.739025:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709244928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047369.739107:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709244928:12345-0@lo:503:mount.lustre.0 Request processed in 81us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.739114:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784047369.739154:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709244928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047369.739440:0:89048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89048:1870705709245056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.739472:0:89048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.739492:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245056 00000100:00100000:0.0:1784047369.739496:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245056 00000100:00100000:0.0:1784047369.739517:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784047369.739522:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:89048:x1870705709245056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.739592:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:89048:x1870705709245056:12345-0@lo:502:llog_process_th.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.739598:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784047369.739650:0:89048:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc83743c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.739662:0:89048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89048:1870705709245056:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784047369.739715:0:89048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784047369.739730:0:89048:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99cbc76c8000) 00000020:00000080:0.0:1784047369.739757:0:89048:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784047369.739913:0:89048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccebeba000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784047369.739918:0:89048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccebeba000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784047369.739921:0:89048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccebeba000 4 00010000:00080000:0.0:1784047369.739954:0:89048:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccff387000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1784047369.745434:0:89048:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784047369.745550:0:89048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784047369.745600:0:89048:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784047369.746176:0:89048:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4426598c0c774679 00000100:00080000:0.0:1784047369.746189:0:89048:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047369.746195:0:89048:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccff387000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.746230:0:89048:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3f800 x1870705709245184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047369.746269:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709245184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047369.746412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.746474:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245184 00000100:00100000:0.0:1784047369.746481:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245184 00000100:00100000:0.0:1784047369.746511:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1784047369.746518:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709245184:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047369.746571:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709245184:12345-0@lo:38:llog_process_th.0 Request processed in 51us (158us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784047369.746579:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1784047369.746904:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784047369.746919:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.746934:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047369.746938:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709245184:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1784047369.746957:0:89048:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784047369.747221:0:89048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89048:1870705709245312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.747265:0:89048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.747288:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245312 00000100:00100000:0.0:1784047369.747292:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245312 00000100:00100000:0.0:1784047369.747334:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784047369.747341:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:89048:x1870705709245312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.747438:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:89048:x1870705709245312:12345-0@lo:502:llog_process_th.0 Request processed in 96us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.747445:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784047369.747484:0:89048:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc1457d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.747499:0:89048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89048:1870705709245312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.747532:0:89048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89048:1870705709245440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.747562:0:89048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.747581:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245440 00000100:00100000:0.0:1784047369.747585:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245440 00000100:00100000:0.0:1784047369.747645:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784047369.747652:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:89048:x1870705709245440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047369.747712:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:89048:x1870705709245440:12345-0@lo:502:llog_process_th.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.747719:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784047369.747769:0:89048:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc1457d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.747786:0:89048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:89048:1870705709245440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784047369.747803:0:89048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784047369.747872:0:89023:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784047369.747898:0:89023:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047369.747918:0:89023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.747929:0:89023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784047369.747983:0:89023:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784047369.747986:0:89023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047369.747987:0:89023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.747988:0:89023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.747989:0:89023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.747990:0:89023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.747992:0:89023:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047369.747994:0:89023:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047369.747996:0:89023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.747998:0:89023:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784047369.748001:0:89023:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784047369.748004:0:89023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784047369.748006:0:89023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047369.748007:0:89023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047369.748008:0:89023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.748009:0:89023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047369.748010:0:89023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.748012:0:89023:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047369.748013:0:89023:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047369.748014:0:89023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.748015:0:89023:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784047369.748029:0:89023:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784047369.748038:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709245568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784047369.748068:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.748092:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.748116:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245568 00000100:00100000:0.0:1784047369.748120:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245568 00000100:00100000:0.0:1784047369.748143:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784047369.748149:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709245568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784047369.748168:0:89032:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784047369.748182:0:89032:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784047369.748742:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709245696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047369.748775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047369.748824:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047369.748829:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047369.748832:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047369.748838:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3467 00000100:00080000:0.0:1784047369.748842:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047369.748847:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.748879:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00416d80 x1870705709245824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047369.749197:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047369.749205:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709245952:0@lo:400:kworker.0 00000100:00100000:1.0:1784047369.749235:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047369.749397:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047369.749401:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047369.749403:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047369.749406:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3467 00000100:00080000:0.0:1784047369.749409:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047369.749413:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.749428:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0062c000 x1870705709246080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047369.749479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709246208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.749510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047369.749559:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047369.749563:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047369.749564:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047369.749573:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3467 00000100:00080000:0.0:1784047369.749576:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047369.749579:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.749595:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc6d40e00 x1870705709246336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047369.749711:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245952 00000100:00100000:1.0:1784047369.749718:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245952 00000100:00100000:1.0:1784047369.749764:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246208 00000100:00100000:1.0:1784047369.749767:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246208 00000100:00100000:1.0:1784047369.749790:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1784047369.749801:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709245952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047369.749863:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709245952:12345-0@lo:400:kworker.0 Request processed in 65us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.749916:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047369.749922:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709246464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.749953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.749981:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246464 00000100:00100000:3.0:1784047369.749985:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246464 00000100:00100000:3.0:1784047369.750012:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:3.0:1784047369.750018:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709246464:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784047369.750150:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047369.750153:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047369.750156:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047369.750159:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3467 00000100:00080000:0.0:1784047369.750162:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047369.750165:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.750176:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc6d41180 x1870705709246720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047369.750201:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784047369.750204:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047369.750205:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047369.750209:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccff387000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047369.750220:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec86c000 x1870705709247232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047369.750243:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709246848:0@lo:400:kworker.0 00000100:00100000:0.0:1784047369.750325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750346:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047369.750351:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709246592:0@lo:400:kworker.0 00000100:00100000:0.0:1784047369.750372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750404:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709245824:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.750429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750445:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709246080:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.750464:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750473:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709246336:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.750490:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750506:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709246720:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.750523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750532:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709247232:0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.750548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047369.750571:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245824 00000100:00100000:0.0:1784047369.750575:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245824 00000100:00100000:2.0:1784047369.750588:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1784047369.750599:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.750617:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709246464:12345-0@lo:400:kworker.0 Request processed in 586us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.750625:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:3.0:1784047369.750640:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246592 00000100:00100000:3.0:1784047369.750643:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246592 00000100:00100000:2.0:1784047369.750649:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709246208:12345-0@lo:400:kworker.0 Request processed in 54us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.750656:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1784047369.750663:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:3.0:1784047369.750668:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709246592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047369.750668:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246080 00000100:00100000:2.0:1784047369.750671:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246080 00000100:00100000:2.0:1784047369.750680:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246720 00000100:00100000:2.0:1784047369.750683:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246720 00000100:00100000:2.0:1784047369.750690:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247232 00000100:00100000:2.0:1784047369.750692:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247232 00000100:00100000:3.0:1784047369.750699:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709246592:12345-0@lo:400:kworker.0 Request processed in 32us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.750702:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1784047369.750705:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709246080:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784047369.750706:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:3.0:1784047369.750724:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709246976:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.750747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.750748:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709246080:12345-0@lo:38:kworker.0 Request processed in 40us (282us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784047369.750760:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1784047369.750777:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709246464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.750787:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709246208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.750804:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047369.750808:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709247104:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.750833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047369.750869:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246976 00000100:00100000:3.0:1784047369.750872:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246976 00000100:00100000:3.0:1784047369.750892:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247104 00000100:00100000:3.0:1784047369.750894:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247104 00000100:00100000:3.0:1784047369.750913:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1784047369.750919:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709246976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.750951:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709246976:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.750957:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1784047369.750976:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:3.0:1784047369.750982:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709247104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.751013:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709247104:12345-0@lo:400:kworker.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047369.751018:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:3.0:1784047369.751045:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709247104:0@lo:400:kworker.0 00000100:00100000:3.0:1784047369.751053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709246976:0@lo:400:kworker.0 00000100:00100000:2.0:1784047369.752171:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1784047369.752177:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709246720:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784047369.752237:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709246720:12345-0@lo:38:kworker.0 Request processed in 59us (1712us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784047369.752244:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1784047369.752254:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1784047369.752259:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709247232:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784047369.752285:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709247232:12345-0@lo:38:kworker.0 Request processed in 25us (1736us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784047369.752291:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1784047369.752678:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246848 00000100:00100000:2.0:1784047369.752685:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246848 00000100:00100000:2.0:1784047369.752721:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709246336 00000100:00100000:2.0:1784047369.752724:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709246336 00000100:00100000:2.0:1784047369.752739:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1784047369.752745:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709246848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047369.753160:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1784047369.753217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709245952:0@lo:400:kworker.0 00000100:00100000:2.0:1784047369.754198:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709246848:12345-0@lo:400:kworker.0 Request processed in 1448us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.754207:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1784047369.754226:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1784047369.754231:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709246336:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784047369.754267:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709246336:12345-0@lo:38:kworker.0 Request processed in 35us (3776us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784047369.754273:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1784047369.754322:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709245696 00000100:00100000:2.0:1784047369.754335:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709245696 00000100:00100000:2.0:1784047369.754367:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784047369.754373:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:3645:x1870705709245696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047369.754410:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:3645:x1870705709245696:12345-0@lo:400:kworker.0 Request processed in 37us (5634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.754416:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784047369.754452:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709245696:0@lo:400:kworker.0 00000100:00100000:0.0:1784047369.755438:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1784047369.755446:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709245824:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784047369.755499:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709245824:12345-0@lo:38:kworker.0 Request processed in 53us (5068us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784047369.755505:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1784047369.755560:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709246592:0@lo:400:kworker.0 00000100:00100000:0.0:1784047369.755571:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709246848:0@lo:400:kworker.0 00000100:00080000:0.0:1784047369.755598:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.755620:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047369.755623:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709245824:0@lo:38:kworker.0 00000100:00080000:0.0:1784047369.755634:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.755637:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047369.755649:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709246080:0@lo:38:kworker.0 00000100:00080000:0.0:1784047369.755660:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.755663:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047369.755665:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709246336:0@lo:38:kworker.0 00000100:00080000:0.0:1784047369.755673:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.755676:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047369.755678:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709246720:0@lo:38:kworker.0 00000100:00080000:0.0:1784047369.755686:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047369.755689:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784047369.755691:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709247232:0@lo:38:kworker.0 20000000:01000000:0.0:1784047369.761418:0:89032:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047369.761439:0:89032:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784047369.761663:0:89033:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047369.761668:0:89033:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047369.761691:0:89033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.761714:0:89033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774648 expref: 11 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.761723:0:89033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.761767:0:89033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c774648 expref: 11 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.761780:0:89033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c774648 expref: 11 pid: 89029 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.761796:0:89033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89033:1870705709247360:0@lo:104: 00000100:00100000:2.0:1784047369.761874:0:89033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.761913:0:89033:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047369.762018:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247360 00000100:00100000:0.0:1784047369.762025:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247360 00000100:00100000:0.0:1784047369.762074:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784047369.762082:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:89033:x1870705709247360:12345-0@lo:104: 00010000:00010000:0.0:1784047369.762095:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047369.762112:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:89023:x1870705709245568:12345-0@lo:253:mount.lustre.0 Request processed in 13962us (14041us total) trans 0 rc 0/0 00010000:00010000:0.0:1784047369.762134:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047369.762136:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784047369.762139:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:89033:x1870705709247360:12345-0@lo:104: Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047369.762144:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:0.0:1784047369.762158:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047369.762164:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.762182:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047369.762185:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.762193:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047369.762201:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047369.762206:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047369.762243:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.762250:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047369.762276:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047369.762283:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77464f expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047369.762296:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709247488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047369.762298:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047369.762300:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047369.762302:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047369.762326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047369.762372:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247488 00000100:00100000:1.0:1784047369.762377:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247488 00010000:00010000:1.0:1784047369.762395:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c774648 expref: 11 pid: 89029 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047369.762410:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:89023:1870705709245568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784047369.762415:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 10000000:01000000:0.0:1784047369.762420:0:89023:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:1.0:1784047369.762421:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+11:3645:x1870705709247488:12345-0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1784047369.762423:0:89023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784047369.762424:0:89023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047369.762426:0:89023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:1.0:1784047369.762430:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:0.0:1784047369.762432:0:89023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047369.762433:0:89023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1784047369.762435:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c774648 expref: 11 pid: 89029 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784047369.762435:0:89023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047369.762436:0:89023:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047369.762438:0:89023:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047369.762440:0:89023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047369.762441:0:89023:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1784047369.762444:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c774648 expref: 11 pid: 89029 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1784047369.762455:0:89023:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784047369.762459:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762466:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047369.762479:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029018217s 00010000:00010000:1.0:1784047369.762483:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762490:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762505:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762511:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762515:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047369.762519:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762525:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762533:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047369.762542:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047369.762570:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+11:3645:x1870705709247488:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047369.762576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1784047369.762600:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709247488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047369.763213:0:89033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbd800/0x4426598c0c77464f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c774648 expref: 10 pid: 89029 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047369.763236:0:89033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89033:1870705709247360:0@lo:104: 00010000:00010000:2.0:1784047369.763250:0:89033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.763258:0:89033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.763264:0:89033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047369.763270:0:89033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774680 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784047369.781459:0:89023:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411365 00000040:01000000:3.0:1784047369.781918:0:89023:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784047369.782051:0:89054:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411365 00000020:00080000:2.0:1784047369.782056:0:89054:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411365 00000040:01000000:3.0:1784047369.782276:0:89055:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784047369.782496:0:89023:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1784047369.782627:0:89055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784047369.783264:0:89056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89056:1870705709247616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047369.783344:0:89056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.783384:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247616 00000100:00100000:2.0:1784047369.783390:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247616 00000100:00100000:2.0:1784047369.783434:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:2.0:1784047369.783442:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89056:x1870705709247616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047369.783513:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89056:x1870705709247616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.783521:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000040:01000000:1.0:1784047369.783534:0:89023:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:2.0:1784047369.783545:0:89056:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3e05240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.783569:0:89056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89056:1870705709247616:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784047369.783587:0:89023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1784047369.783601:0:89056:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784047369.783639:0:89056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89056:1870705709247744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047369.783665:0:89056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.783686:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247744 00000100:00100000:2.0:1784047369.783689:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247744 00000100:00100000:2.0:1784047369.783715:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1784047369.783720:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89056:x1870705709247744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047369.783808:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89056:x1870705709247744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.783814:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1784047369.783826:0:89056:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3e05240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.783837:0:89056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89056:1870705709247744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047369.783882:0:89056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89056:1870705709247872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047369.783901:0:89056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047369.783916:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709247872 00000100:00100000:2.0:1784047369.783919:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709247872 00000100:00100000:2.0:1784047369.783934:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1784047369.783939:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89056:x1870705709247872:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000080:1.0:1784047369.784055:0:89023:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784047369.784062:0:89023:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784047369.784096:0:89023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784047369.784257:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89056:x1870705709247872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 317us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047369.784264:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1784047369.784281:0:89056:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3e05240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047369.784292:0:89056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89056:1870705709247872:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784047369.784323:0:89056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047369.785305:0:89023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784047369.786004:0:89023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784047369.786053:0:89023:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784047369.786178:0:89023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784047369.786673:0:89023:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00000040:00080000:2.0:1784047369.791516:0:89056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1784047369.791634:0:89055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784047369.791707:0:89055:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784047369.791925:0:89056:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784047369.791929:0:89056:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1784047369.796161:0:89023:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00010000:00080000:0.0:1784047369.797602:0:89057:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89057 00010000:02000000:0.0:1784047369.797640:0:89057:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1784047369.797643:0:89057:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784047369.797647:0:89057:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1784047369.797794:0:89023:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784047369.797810:0:89023:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784047369.797833:0:89023:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784047369.797860:0:89023:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784047369.801994:0:89023:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784047369.802308:0:89023:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784047370.515907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047371.270129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047371.274075:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428352 00000100:00100000:0.0:1784047371.274091:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428352 00000100:00100000:0.0:1784047371.274166:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:0.0:1784047371.274176:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689428352:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.274202:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.274227:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc200/0x4426598c0c774687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae213 expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.274254:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc200/0x4426598c0c774687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae213 expref: 10 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.274266:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbc200/0x4426598c0c774687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae213 expref: 10 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.274275:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc200, rc 0) 00000100:00100000:0.0:1784047371.274348:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689428352:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 172us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.274356:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:3.0:1784047371.279137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047371.279235:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428480 00000100:00100000:1.0:1784047371.279245:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428480 00000100:00100000:1.0:1784047371.279300:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:1.0:1784047371.279310:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689428480:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784047371.279335:0:89035:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1784047371.279359:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784047371.279363:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784047371.279366:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784047371.279374:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784047371.279377:0:89035:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 117 00000100:00100000:1.0:1784047371.283503:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689428480:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 4184us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.284313:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:3.0:1784047371.288504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047371.290653:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428608 00000100:00100000:1.0:1784047371.290668:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428608 00000100:00100000:1.0:1784047371.290721:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1205 00000100:00100000:1.0:1784047371.290729:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689428608:12345-192.168.204.40@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1784047371.290765:0:68026:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a2569b5-a558-4441-a96a-1d77608df16b' at ffff99cbc79c2000, cookie 0x4426598c0c7745d1 00010000:00080000:1.0:1784047371.290770:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp recovering/t107374182407 exp ffff99cbc79c2000 cur 3469 last 1784047369 00010000:02000400:1.0:1784047371.290793:0:68026:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1784047371.290799:0:68026:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1784047371.290838:0:68026:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784047371.290998:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e51800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047371.291080:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689428608:12345-192.168.204.40@tcp:38:ll_cfg_requeue.0 Request processed in 349us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.291088:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1205 00000100:00100000:3.0:1784047371.295447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047371.296657:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420032 00000100:00100000:2.0:1784047371.296669:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420032 00000100:00100000:2.0:1784047371.296753:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1206 00000100:00100000:2.0:1784047371.296765:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689420032:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00080000:2.0:1784047371.296787:0:66219:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:2.0:1784047371.296803:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689420032:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 41us (1367us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047371.296810:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1206 00010000:00080000:1.0:1784047371.297704:0:89057:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:1.0:1784047371.346744:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784047371.346753:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccebeba000 from 117 10000000:01000000:1.0:1784047371.346759:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047371.346806:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.346819:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.346842:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.346869:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.346951:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.347003:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9d06780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.347180:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248000 00000100:00100000:0.0:1784047371.347200:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248000 00000100:00100000:0.0:1784047371.347252:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784047371.347261:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:6515:x1870705709248000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.347273:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.347286:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbde00/0x4426598c0c774695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77468e expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.347307:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbde00/0x4426598c0c774695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77468e expref: 11 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.347317:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbde00/0x4426598c0c774695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77468e expref: 11 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.347326:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbde00, rc 0) 00000100:00100000:0.0:1784047371.347371:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709248000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.347378:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784047371.347801:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047371.347818:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.348531:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047371.348600:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.348667:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.348893:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.353891:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248128 00000100:00100000:1.0:1784047371.353907:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248128 00000100:00100000:1.0:1784047371.353992:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784047371.354004:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709248128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784047371.354103:0:89032:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784047371.354135:0:89032:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784047371.354139:0:89032:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 117 00000100:00100000:1.0:1784047371.354947:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709248128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 942us (6276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.354959:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784047371.355174:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784047371.355235:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784047371.355245:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.355254:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047371.355265:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047371.355267:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 52 10000000:01000000:3.0:1784047371.355270:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047371.355370:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.355378:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.355886:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047371.355910:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.355953:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.355983:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.356116:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248256 00000100:00100000:0.0:1784047371.356123:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248256 00000100:00100000:0.0:1784047371.356166:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784047371.356174:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709248256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.356185:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.356197:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7746a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77469c expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.356218:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7746a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77469c expref: 12 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.356228:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7746a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77469c expref: 12 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.356245:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc400, rc 0) 00000100:00100000:0.0:1784047371.356885:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709248256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 709us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.356895:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784047371.357002:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047371.357019:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.357413:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047371.358235:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.358303:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.358336:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.359754:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248384 00000100:00100000:1.0:1784047371.359765:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248384 00000100:00100000:1.0:1784047371.359829:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784047371.359840:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709248384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.360015:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709248384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.360023:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784047371.360463:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.360745:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.360805:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.360852:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.360912:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248512 00000100:00100000:1.0:1784047371.360918:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248512 00000100:00100000:1.0:1784047371.360955:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784047371.360962:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf282dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709248512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.361149:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf282dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709248512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.361157:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784047371.362416:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047371.365192:0:89118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047371.370910:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047371.370960:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047371.370974:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.370987:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047371.370997:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784047371.371016:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 114 10000000:01000000:1.0:1784047371.371019:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047371.371166:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.371174:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.371184:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.371208:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.371269:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.371426:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9d06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047371.371976:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248640 00000100:00100000:3.0:1784047371.371986:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248640 00000100:00100000:3.0:1784047371.372100:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784047371.372110:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709248640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047371.372125:0:89032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047371.372138:0:89032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418400/0x4426598c0c7746b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746aa expref: -99 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.372164:0:89032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418400/0x4426598c0c7746b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746aa expref: 13 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.372175:0:89032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418400/0x4426598c0c7746b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746aa expref: 13 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.372183:0:89032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418400, rc 0) 00000100:00100000:3.0:1784047371.372312:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709248640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047371.372329:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784047371.386112:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.386148:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.386160:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047371.386247:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.386323:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.386360:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.386958:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248768 00000100:00100000:0.0:1784047371.386966:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248768 00000100:00100000:0.0:1784047371.387043:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047371.387054:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709248768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784047371.387076:0:89035:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784047371.387096:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784047371.387099:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784047371.387103:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784047371.387105:0:89035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784047371.387108:0:89035:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 117 00000100:00100000:0.0:1784047371.387222:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709248768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.387229:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784047371.387993:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784047371.388100:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047371.388111:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.388128:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047371.388138:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784047371.388141:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784047371.388144:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784047371.388177:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.388185:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.388207:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.388226:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.388264:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.388310:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9d06b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047371.388504:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709248896 00000100:00100000:2.0:1784047371.388523:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709248896 00000100:00100000:2.0:1784047371.388566:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784047371.388574:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709248896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.388585:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047371.388597:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0000/0x4426598c0c7746bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746b8 expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.388653:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0000/0x4426598c0c7746bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746b8 expref: 14 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.388662:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0000/0x4426598c0c7746bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746b8 expref: 14 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.388670:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0000, rc 0) 00000100:00100000:2.0:1784047371.388710:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709248896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047371.388717:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784047371.388757:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709248896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.388769:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.388777:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047371.388846:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.388872:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.388884:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.389450:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249024 00000100:00100000:1.0:1784047371.389456:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249024 00000100:00100000:1.0:1784047371.389494:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784047371.389501:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709249024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.389704:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709249024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.389712:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784047371.390090:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.390134:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.390181:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.390215:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.390293:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249152 00000100:00100000:0.0:1784047371.390299:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249152 00000100:00100000:0.0:1784047371.390335:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784047371.390342:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709249152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.393849:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709249152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3499us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.393865:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784047371.394690:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047371.395882:0:89119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1784047371.396339:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1784047371.396381:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784047371.396392:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.396403:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047371.396413:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1784047371.396415:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc355c000 from 1 10000000:01000000:2.0:1784047371.396418:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784047371.396453:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.396460:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.396470:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047371.396494:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.396571:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.396603:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.396797:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249280 00000100:00100000:0.0:1784047371.396804:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249280 00000100:00100000:0.0:1784047371.396877:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784047371.396887:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709249280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.396901:0:89032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.396913:0:89032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c7746cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746c6 expref: -99 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.396938:0:89032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c7746cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746c6 expref: 15 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.396951:0:89032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c7746cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746c6 expref: 15 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.396961:0:89032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbdc00, rc 0) 00000100:00100000:0.0:1784047371.397005:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709249280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.397011:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784047371.397961:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.397984:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.397995:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047371.398013:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784047371.398100:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.398108:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047371.398117:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784047371.398119:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc355c000 from 7 10000000:01000000:2.0:1784047371.398122:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047371.398144:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.398151:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.398159:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047371.398178:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.398218:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.398254:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b300 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.398737:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249408 00000100:00100000:1.0:1784047371.398744:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249408 00000100:00100000:1.0:1784047371.398782:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784047371.398790:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709249408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047371.398800:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047371.398813:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce200/0x4426598c0c7746db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746d4 expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.398843:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce200/0x4426598c0c7746db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746d4 expref: 16 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.398866:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce200/0x4426598c0c7746db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746d4 expref: 16 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.398874:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce200, rc 0) 00000100:00100000:1.0:1784047371.398927:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709249408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.398934:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784047371.399116:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.399128:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.399136:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047371.399193:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.399231:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.399300:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.413358:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249536 00000100:00100000:0.0:1784047371.413376:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249536 00000100:00100000:0.0:1784047371.413456:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784047371.413467:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709249536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.413916:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709249536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (14682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.413925:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784047371.414048:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.414108:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.414168:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.414207:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b300 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.414261:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249664 00000100:00100000:1.0:1784047371.414266:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249664 00000100:00100000:1.0:1784047371.414303:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784047371.414312:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cccc02d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709249664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.414425:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cccc02d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709249664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.414432:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784047371.414764:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047371.415926:0:89120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784047371.416119:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784047371.416142:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047371.416153:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.416166:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047371.416189:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047371.416192:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 52 10000000:01000000:0.0:1784047371.416195:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047371.416226:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.416233:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.416243:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.416264:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.416318:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.416357:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.416412:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249792 00000100:00100000:1.0:1784047371.416419:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249792 00000100:00100000:1.0:1784047371.416464:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784047371.416473:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709249792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047371.416483:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047371.416497:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7746e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746e2 expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.416536:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7746e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746e2 expref: 17 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.416546:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7746e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746e2 expref: 17 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.416564:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfe00, rc 0) 00000100:00100000:1.0:1784047371.416637:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709249792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.416643:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784047371.416887:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.416901:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.416910:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.416963:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.416986:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.417014:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.417120:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709249920 00000100:00100000:1.0:1784047371.417125:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709249920 00000100:00100000:1.0:1784047371.417159:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784047371.417167:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd054a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709249920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.417273:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd054a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709249920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.417280:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784047371.421208:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709249920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.421282:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.421373:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.421424:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.421492:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250048 00000100:00100000:1.0:1784047371.421498:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250048 00000100:00100000:1.0:1784047371.421569:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784047371.421581:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd054a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709250048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.421744:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd054a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709250048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.421752:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784047371.421864:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047371.423261:0:89121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047371.423553:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047371.423580:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047371.423594:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.423630:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047371.423659:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784047371.423662:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784047371.423665:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784047371.423700:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.423709:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.423719:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.423744:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.423799:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.423845:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.423962:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250176 00000100:00100000:0.0:1784047371.423970:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250176 00000100:00100000:0.0:1784047371.424021:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784047371.424039:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd054b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709250176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.424052:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.424065:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7746f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746f0 expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.424088:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7746f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746f0 expref: 18 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.424099:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7746f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746f0 expref: 18 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.424108:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd000, rc 0) 00000100:00100000:0.0:1784047371.424149:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd054b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709250176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.424156:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784047371.427147:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.427183:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.427197:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047371.427294:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.427366:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.427409:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.427641:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250304 00000100:00100000:1.0:1784047371.427649:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250304 00000100:00100000:1.0:1784047371.427702:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784047371.427711:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709250304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.427878:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709250304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.427887:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784047371.428068:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.428103:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.428150:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047371.428178:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.428286:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250432 00000100:00100000:0.0:1784047371.428291:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250432 00000100:00100000:0.0:1784047371.428328:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784047371.428336:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709250432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.429528:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709250432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1187us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.429541:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784047371.429851:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047371.431240:0:89122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784047371.431466:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784047371.431491:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784047371.431518:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.431542:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047371.431552:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784047371.431554:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccf756a000 from 7 10000000:01000000:1.0:1784047371.431557:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047371.431597:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.431635:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.431647:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.431673:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.431739:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.431776:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.432150:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250560 00000100:00100000:0.0:1784047371.432167:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250560 00000100:00100000:0.0:1784047371.432225:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784047371.432234:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709250560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.432247:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.432260:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbce00/0x4426598c0c774705 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7746fe expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.432283:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbce00/0x4426598c0c774705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7746fe expref: 19 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.432293:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c774705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7746fe expref: 19 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.432302:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbce00, rc 0) 00000100:00100000:0.0:1784047371.432352:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709250560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.432360:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784047371.432445:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047371.432460:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.432469:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.432751:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.432781:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.432810:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.432875:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250688 00000100:00100000:0.0:1784047371.432881:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250688 00000100:00100000:0.0:1784047371.432915:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784047371.432922:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709250688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.433086:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709250688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.433095:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784047371.437907:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.437976:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.438163:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.438212:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.438276:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250816 00000100:00100000:0.0:1784047371.438284:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250816 00000100:00100000:0.0:1784047371.438346:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784047371.438357:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709250816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.438491:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709250816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.438499:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784047371.438865:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047371.452898:0:89123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784047371.453121:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784047371.453163:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784047371.453174:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.453186:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047371.453196:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047371.453198:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 52 10000000:01000000:1.0:1784047371.453201:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047371.453240:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.453248:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.453260:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.453285:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.453349:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.453384:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.453542:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709250944 00000100:00100000:0.0:1784047371.453549:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709250944 00000100:00100000:0.0:1784047371.453625:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784047371.453636:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709250944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.453649:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047371.453662:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c774713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77470c expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.453684:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c774713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77470c expref: 20 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.453694:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c774713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77470c expref: 20 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.453702:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbcc00, rc 0) 00000100:00100000:0.0:1784047371.453741:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709250944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.453748:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784047371.454036:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709250944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047371.454052:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.454061:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047371.454120:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.454145:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.454169:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.454228:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251072 00000100:00100000:1.0:1784047371.454233:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251072 00000100:00100000:1.0:1784047371.454267:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784047371.454273:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc698a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709251072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.454383:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc698a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709251072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.454406:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784047371.455255:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.455308:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.455354:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047371.455384:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047371.455427:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251200 00000100:00100000:0.0:1784047371.455432:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251200 00000100:00100000:0.0:1784047371.455471:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784047371.455478:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709251200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.455580:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709251200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047371.455594:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784047371.456368:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047371.457865:0:89124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784047371.466431:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784047371.466512:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047371.466525:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.466538:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047371.466776:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784047371.466781:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1784047371.466784:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784047371.466833:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.466843:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.466853:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.466880:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.466966:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.467022:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.467174:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251328 00000100:00100000:1.0:1784047371.467183:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251328 00000100:00100000:1.0:1784047371.467239:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784047371.467249:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709251328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047371.467266:0:89029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047371.467293:0:89029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cee00/0x4426598c0c774721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77471a expref: -99 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.467322:0:89029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cee00/0x4426598c0c774721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77471a expref: 21 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.467334:0:89029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cee00/0x4426598c0c774721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77471a expref: 21 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.467343:0:89029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cee00, rc 0) 00000100:00100000:1.0:1784047371.467390:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709251328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.467398:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784047371.467704:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.467721:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.467732:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.467795:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.467834:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.467864:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047371.467957:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251456 00000100:00100000:3.0:1784047371.467962:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251456 00000100:00100000:3.0:1784047371.467994:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784047371.468001:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709251456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.468167:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709251456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047371.468174:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784047371.468410:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.468469:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.468520:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.468542:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047371.468595:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251584 00000100:00100000:2.0:1784047371.468600:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251584 00000100:00100000:2.0:1784047371.468739:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784047371.468747:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709251584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.479391:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709251584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10634us (10860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.479407:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784047371.480192:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047371.483244:0:89125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784047371.483769:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784047371.483795:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784047371.483806:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.483830:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047371.483855:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784047371.483858:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfe6b8800 from 7 10000000:01000000:1.0:1784047371.483861:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047371.483899:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.483908:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.483918:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047371.483945:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.484020:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047371.484065:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc298a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047371.484213:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251712 00000100:00100000:2.0:1784047371.484221:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251712 00000100:00100000:2.0:1784047371.484265:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784047371.484274:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709251712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047371.484303:0:89032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047371.484318:0:89032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0600/0x4426598c0c77472f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774728 expref: -99 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.484343:0:89032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0600/0x4426598c0c77472f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774728 expref: 22 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.484354:0:89032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0600/0x4426598c0c77472f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774728 expref: 22 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.484362:0:89032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0600, rc 0) 00000100:00100000:2.0:1784047371.484414:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709251712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047371.484420:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784047371.484771:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.484788:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.484800:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.484878:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.484909:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.484938:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04600 going to sleep for 11 seconds 00000100:00100000:2.0:1784047371.485006:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251840 00000100:00100000:2.0:1784047371.485020:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251840 00000100:00100000:2.0:1784047371.485053:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784047371.485059:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709251840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047371.485170:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709251840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047371.485178:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784047371.485277:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.485318:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.485357:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.485376:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04600 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.485640:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709251968 00000100:00100000:1.0:1784047371.485645:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709251968 00000100:00100000:1.0:1784047371.485677:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784047371.485684:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709251968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047371.485790:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709251968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.485797:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784047371.485971:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709251968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047371.491170:0:89126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784047371.491547:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784047371.491572:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047371.491584:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.491597:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047371.491659:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784047371.491662:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047371.491665:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784047371.491701:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.491711:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.491722:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.491749:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709252096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.491836:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.491883:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047371.492217:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252096 00000100:00100000:3.0:1784047371.492224:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252096 00000100:00100000:3.0:1784047371.492287:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784047371.492299:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709252096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047371.492313:0:89035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047371.492327:0:89035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418600/0x4426598c0c77473d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774736 expref: -99 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.492352:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418600/0x4426598c0c77473d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774736 expref: 23 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.492363:0:89035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418600/0x4426598c0c77473d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774736 expref: 23 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047371.492371:0:89035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418600, rc 0) 00000100:00100000:3.0:1784047371.492420:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709252096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047371.492427:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784047371.492746:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709252096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.492765:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.492775:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047371.492798:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784047371.492804:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.492811:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047371.492841:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784047371.492843:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047371.492846:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784047371.492865:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.492873:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.492880:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.492895:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709252224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.492926:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.492957:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04600 going to sleep for 11 seconds 00000100:00100000:1.0:1784047371.493030:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252224 00000100:00100000:1.0:1784047371.493035:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252224 00000100:00100000:1.0:1784047371.493075:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784047371.493083:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709252224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047371.493101:0:89031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047371.493111:0:89031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c77474b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774744 expref: -99 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.493125:0:89031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c77474b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774744 expref: 24 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.493134:0:89031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c77474b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774744 expref: 24 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047371.493141:0:89031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfa00, rc 0) 00000100:00100000:1.0:1784047371.493173:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709252224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047371.493180:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784047371.493290:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709252224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047371.493300:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.493308:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047371.493367:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709252352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047371.493391:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047371.493414:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047371.493647:0:89029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252352 00000100:00100000:3.0:1784047371.493652:0:89029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252352 00000100:00100000:3.0:1784047371.493687:0:89029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784047371.493695:0:89029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709252352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047371.493778:0:89029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709252352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (385us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047371.493785:0:89029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784047371.493888:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709252352:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784047371.493916:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784047371.493922:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047371.493930:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047371.538714:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047371.920359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047371.927331:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428736 00000100:00100000:2.0:1784047371.927347:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428736 00000100:00100000:2.0:1784047371.927472:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1192 00000100:00100000:2.0:1784047371.927483:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689428736:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047371.927570:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689428736:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 90us (7222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047371.927590:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1192 00000100:00080000:0.0:1784047371.934411:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784047372.564745:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047373.588091:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047374.617872:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047374.617901:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709252480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047374.617980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047374.618025:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047374.618041:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252480 00000100:00100000:0.0:1784047374.618049:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252480 00000100:00100000:0.0:1784047374.618105:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1784047374.618115:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709252480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047374.618156:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047374.618207:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709252480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047374.618215:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00080000:0.0:1784047374.618238:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047374.618276:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709252480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047374.618462:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047374.618472:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709252608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047374.618502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047374.618530:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252608 00000100:00100000:2.0:1784047374.618534:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252608 00000100:00100000:2.0:1784047374.618579:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:2.0:1784047374.618587:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709252608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047374.618627:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047374.618664:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709252608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047374.618671:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:2.0:1784047374.618707:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709252608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784047374.618786:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047375.123887:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047375.123911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709252736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047375.123989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047375.124035:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252736 00000100:00100000:1.0:1784047375.124043:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252736 00000100:00100000:1.0:1784047375.124093:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1784047375.124102:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709252736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047375.124137:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047375.124181:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709252736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047375.124189:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1784047375.124248:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709252736:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784047375.124907:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047375.124912:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047375.124915:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047375.124924:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047375.124944:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00fc0380 x1870705709252992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047375.124969:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047375.124973:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047375.124974:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047375.124979:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047375.124990:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edca80 x1870705709253248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047375.125011:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047375.125015:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047375.125016:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047375.125021:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047375.125033:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce3c6fb80 x1870705709253504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047375.125063:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047375.125067:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047375.125068:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047375.125073:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047375.125083:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce3c6d880 x1870705709253888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047375.125103:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784047375.125106:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047375.125108:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047375.125112:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccff387000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047375.125122:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce4119c00 x1870705709254272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047375.125146:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709253120:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125219:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709254016:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125262:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784047375.125267:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709252864:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709253760:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125372:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709252992:0@lo:38:kworker.0 00000100:00100000:2.0:1784047375.125395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125417:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709253248:0@lo:38:kworker.0 00000100:00100000:2.0:1784047375.125438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125452:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709253504:0@lo:38:kworker.0 00000100:00100000:2.0:1784047375.125472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125487:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709253888:0@lo:38:kworker.0 00000100:00100000:2.0:1784047375.125507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125521:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709254272:0@lo:38:kworker.0 00000100:00100000:2.0:1784047375.125546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125572:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709253632:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125632:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784047375.125637:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709253376:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125660:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125670:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709254144:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.125719:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253120 00000100:00100000:2.0:1784047375.125724:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253120 00000100:00100000:2.0:1784047375.125773:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252992 00000100:00100000:2.0:1784047375.125777:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252992 00000100:00100000:2.0:1784047375.125786:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253248 00000100:00100000:2.0:1784047375.125788:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253248 00000100:00100000:2.0:1784047375.125797:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253888 00000100:00100000:2.0:1784047375.125799:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253888 00000100:00100000:2.0:1784047375.125805:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254272 00000100:00100000:2.0:1784047375.125808:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254272 00000100:00100000:2.0:1784047375.125814:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253376 00000100:00100000:2.0:1784047375.125817:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253376 00000100:00100000:2.0:1784047375.125832:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1784047375.125847:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709253120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125893:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709253120:12345-0@lo:400:kworker.0 Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.125900:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1784047375.125915:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1784047375.125921:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709253376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.125953:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709253376:12345-0@lo:400:kworker.0 Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.125959:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1784047375.125971:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1784047375.125975:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709252992:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047375.125998:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3473 last 0 00000020:00000080:2.0:1784047375.126031:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c774752 00000004:00100000:2.0:1784047375.126046:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047375.126173:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccd0018000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047375.126209:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709252992:12345-0@lo:38:kworker.0 Request processed in 232us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126217:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1784047375.126230:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1784047375.126235:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709253248:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047375.126247:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3473 last 0 00000020:00000080:2.0:1784047375.126267:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4426598c0c774759 00000004:00100000:2.0:1784047375.126273:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047375.126288:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccd001a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047375.126314:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870705709253248:12345-0@lo:38:kworker.0 Request processed in 77us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126326:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1784047375.126338:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1784047375.126342:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709253888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047375.126354:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3473 last 0 00000020:00000080:2.0:1784047375.126375:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4426598c0c774760 00000004:00100000:2.0:1784047375.126381:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047375.126393:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccc3564800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047375.126418:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870705709253888:12345-0@lo:38:kworker.0 Request processed in 74us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126425:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1784047375.126436:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1784047375.126440:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709254272:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047375.126451:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3473 last 0 00000020:00000080:2.0:1784047375.126471:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4426598c0c774767 00000004:00100000:2.0:1784047375.126476:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047375.126489:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccc3567800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047375.126514:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709254272:12345-0@lo:38:kworker.0 Request processed in 73us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126520:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1784047375.126543:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254016 00000100:00100000:2.0:1784047375.126547:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254016 00000100:00100000:2.0:1784047375.126574:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253760 00000100:00100000:2.0:1784047375.126577:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253760 00000100:00100000:2.0:1784047375.126591:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253632 00000100:00100000:2.0:1784047375.126594:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253632 00000100:00100000:2.0:1784047375.126627:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254144 00000100:00100000:2.0:1784047375.126636:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254144 00000100:00100000:2.0:1784047375.126657:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:2.0:1784047375.126663:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709254016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.126695:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709254016:12345-0@lo:400:kworker.0 Request processed in 32us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126701:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:2.0:1784047375.126712:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1784047375.126717:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709253760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.126743:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709253760:12345-0@lo:400:kworker.0 Request processed in 26us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126765:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1784047375.126777:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1784047375.126782:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709253632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.126809:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709253632:12345-0@lo:400:kworker.0 Request processed in 27us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126815:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1784047375.126824:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1784047375.126829:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709254144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.126854:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709254144:12345-0@lo:400:kworker.0 Request processed in 25us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.126860:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1784047375.127040:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709252864 00000100:00100000:2.0:1784047375.127044:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709252864 00000100:00100000:2.0:1784047375.127071:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784047375.127078:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709252864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.127108:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709252864:12345-0@lo:400:kworker.0 Request processed in 30us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.127121:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784047375.127163:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709253504 00000100:00100000:2.0:1784047375.127168:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709253504 00000100:00100000:2.0:1784047375.127189:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1784047375.127193:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709253504:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047375.127209:0:8442:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99ccc832a800, cookie 0x4426598c0c7745d8 00010000:00080000:2.0:1784047375.127214:0:8442:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff99ccc832a800 cur 3473 last 1784047369 00000004:00100000:2.0:1784047375.127225:0:8442:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047375.127245:0:8442:0:(import.c:65:import_set_state_nolock()) ffff99cbc64cd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047375.127279:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709253504:12345-0@lo:38:kworker.0 Request processed in 84us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.127286:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00080000:2.0:1784047375.127308:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047375.127312:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047375.127314:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047375.127360:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709253376:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.127373:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709254144:0@lo:400:kworker.0 00000100:00100000:2.0:1784047375.127383:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709253632:0@lo:400:kworker.0 00010000:00080000:2.0:1784047375.127425:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cd00fc0380 x1870705709252992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047375.127438:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00010000:00080000:1.0:1784047375.128035:0:89057:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784047375.128042:0:89057:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:1.0:1784047375.128048:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.128051:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:1.0:1784047375.128056:0:89057:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:1.0:1784047375.128058:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.128068:0:89057:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689420032 t107374182407 from 192.168.204.40@tcp req@ffff99cbc9b97b80 x1870705689420032/t0(107374182407) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:502/0 lens 528/0 e 0 to 0 dl 1784047382 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1784047375.128684:0:89057:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 560us 00000100:00100000:3.0:1784047375.132706:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709252864:0@lo:400:kworker.0 00000100:00100000:3.0:1784047375.132731:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709253760:0@lo:400:kworker.0 00000100:00100000:3.0:1784047375.132745:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709253120:0@lo:400:kworker.0 00000100:00100000:3.0:1784047375.132772:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709254016:0@lo:400:kworker.0 00000100:00080000:2.0:1784047375.134278:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99cd00fc0380 x1870705709252992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047400 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047375.134292:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784047375.134314:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784047375.134319:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784047375.134325:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709252992:0@lo:38:kworker.0 00010000:00080000:2.0:1784047375.134356:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9edca80 x1870705709253248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047375.135316:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:2.0:1784047375.143487:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99cbc9edca80 x1870705709253248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047400 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047375.143503:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784047375.143509:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784047375.143514:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784047375.143521:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709253248:0@lo:38:kworker.0 00000100:00080000:2.0:1784047375.143559:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:2.0:1784047375.143570:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1784047375.143574:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1784047375.143576:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:2.0:1784047375.143580:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc6531800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:2.0:1784047375.143583:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00010000:1.0:1784047375.152561:0:89057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.152587:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.152602:0:89057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.152637:0:89057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.152644:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.152651:0:89057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153047:0:89057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153069:0:89057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153077:0:89057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153084:0:89057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047375.153088:0:89057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153096:0:89057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153110:0:89057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:1.0:1784047375.153113:0:89057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047375.153117:0:89057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153125:0:89057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77476e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047375.153141:0:89057:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4726d30 reply state 0000000048c49a98 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153152:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.153159:0:89057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37b6800) 00010000:00010000:1.0:1784047375.153162:0:89057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047375.153165:0:89057:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784047375.153270:0:89057:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047375.153297:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.153300:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:1.0:1784047375.153304:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.153307:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000001:00080000:2.0:1784047375.155572:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00000100:00100000:3.0:1784047375.156711:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709253504:0@lo:38:kworker.0 00010000:00080000:3.0:1784047375.156768:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cce3c6d880 x1870705709253888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047375.156786:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00010000:00010000:1.0:1784047375.157048:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.157060:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.157067:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.157073:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047375.157077:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.157084:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.157100:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc37b6800) 00010000:00010000:1.0:1784047375.157103:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047375.157107:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.157113:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c774775 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784047375.157564:0:89296:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1784047375.157569:0:89296:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1784047375.157574:0:89296:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1784047375.158013:0:89296:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1784047375.159365:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99cce3c6d880 x1870705709253888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047400 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047375.159378:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784047375.159383:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784047375.159388:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784047375.159409:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709253888:0@lo:38:kworker.0 00010000:00080000:3.0:1784047375.159453:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cce4119c00 x1870705709254272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047375.163727:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:3.0:1784047375.163744:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784047375.163762:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784047375.163767:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784047375.163780:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709254272:0@lo:38:kworker.0 00000100:00100000:3.0:1784047375.163887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047375.163922:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689420544 00000100:00100000:3.0:1784047375.163931:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689420544 00000100:00100000:3.0:1784047375.164936:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1211 00000100:00100000:3.0:1784047375.164952:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689420544:12345-192.168.204.40@tcp:36:rm.0 00010000:00080000:3.0:1784047375.165547:0:66221:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1784047375.165630:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689420544:12345-192.168.204.40@tcp:36:rm.0 Request processed in 659us (1720us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047375.165637:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1211 00000100:00100000:3.0:1784047375.165662:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709254400:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784047375.165731:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047375.166121:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254400 00000100:00100000:0.0:1784047375.166131:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254400 00000100:00100000:0.0:1784047375.166182:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:0.0:1784047375.166191:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709254400:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784047375.166206:0:8441:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cbc9b97800 x1870705709254400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:506/0 lens 224/0 e 0 to 0 dl 1784047386 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00080000:1.0:1784047375.176192:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.176201:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:1.0:1784047375.176206:0:89057:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:1.0:1784047375.176217:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.176232:0:89057:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689420544 t107374182408 from 192.168.204.40@tcp req@ffff99cbc9b95500 x1870705689420544/t0(107374182408) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 512/0 e 0 to 0 dl 1784047386 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784047375.176337:0:89057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176354:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176366:0:89057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176378:0:89057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176386:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176393:0:89057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176478:0:89057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176487:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176495:0:89057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176732:0:89057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176764:0:89057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176772:0:89057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176779:0:89057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047375.176784:0:89057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176791:0:89057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176803:0:89057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff99cd001e7800) 00010000:00010000:1.0:1784047375.176807:0:89057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784047375.176811:0:89057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176818:0:89057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c77478a lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176840:0:89057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176846:0:89057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176852:0:89057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176857:0:89057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ec00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047375.176866:0:89057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176873:0:89057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176881:0:89057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:1.0:1784047375.176884:0:89057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047375.176887:0:89057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176893:0:89057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c77477c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047375.176906:0:89057:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3300d42 reply state 00000000e82c5038 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176917:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.176923:0:89057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cd001e7200) 00010000:00010000:1.0:1784047375.176926:0:89057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047375.176929:0:89057:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047375.177446:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709254400:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 11252us (11709us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047375.177459:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00010000:00080000:1.0:1784047375.178198:0:89057:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047375.178219:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.178222:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:1.0:1784047375.178227:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.178229:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:3.0:1784047375.182417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047375.182512:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422592 00000100:00100000:2.0:1784047375.182528:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422592 00000100:00100000:2.0:1784047375.182593:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1212 00000100:00100000:2.0:1784047375.182623:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689422592:12345-192.168.204.40@tcp:36:dd.0 00010000:00080000:2.0:1784047375.182643:0:66220:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:2.0:1784047375.182658:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689422592:12345-192.168.204.40@tcp:36:dd.0 Request processed in 56us (251us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047375.182664:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1212 00000020:00080000:1.0:1784047375.182731:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.182736:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:1.0:1784047375.182740:0:89057:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182407) 00000020:00080000:1.0:1784047375.182762:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.182772:0:89057:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689422592 t107374182410 from 192.168.204.40@tcp req@ffff99cbc9b96680 x1870705689422592/t0(107374182410) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 488/0 e 0 to 0 dl 1784047386 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784047375.184106:0:89057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.184128:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.184139:0:89057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047375.184259:0:89057:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a751e7e reply state 0000000000303191 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.184273:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.184281:0:89057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99cd001e7300) 00010000:00010000:1.0:1784047375.184284:0:89057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047375.184288:0:89057:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784047375.184404:0:89057:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047375.184423:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.184426:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:1.0:1784047375.184431:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.184433:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:0.0:1784047375.194134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047375.194213:0:66234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689422848 00000100:00100000:3.0:1784047375.194224:0:66234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689422848 00000100:00100000:3.0:1784047375.194298:0:66234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:3.0:1784047375.194310:0:66234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689422848:12345-192.168.204.40@tcp:10:dd.0 00010000:00080000:3.0:1784047375.194329:0:66234:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:3.0:1784047375.194400:0:66234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689422848:12345-192.168.204.40@tcp:10:dd.0 Request processed in 91us (276us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047375.194408:0:66234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000020:00080000:1.0:1784047375.201440:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.201450:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:1.0:1784047375.201458:0:89057:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:1.0:1784047375.201475:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.201493:0:89057:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689422848 t107374182411 from 192.168.204.40@tcp req@ffff99cd00459f80 x1870705689422848/t0(107374182411) o10->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 440/0 e 0 to 0 dl 1784047386 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047375.201842:0:89057:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047375.201867:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.201870:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:1.0:1784047375.201873:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.201876:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000100:00100000:0.0:1784047375.220158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047375.220660:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428864 00000100:00100000:1.0:1784047375.220669:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428864 00000100:00100000:1.0:1784047375.220720:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1213 00000100:00100000:1.0:1784047375.220730:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689428864:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1784047375.220765:0:68026:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd0045bb80 x1870705689428864/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 328/0 e 0 to 0 dl 1784047386 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047375.220786:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689428864:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 58us (638us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047375.220868:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1213 00000020:00080000:1.0:1784047375.220888:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.220892:0:89057:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:1.0:1784047375.220896:0:89057:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1784047375.220899:0:89057:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047375.220905:0:89057:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047375.220907:0:89057:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047375.220913:0:89057:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd0045bb80 x1870705689428864/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 328/0 e 0 to 0 dl 1784047386 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784047375.220930:0:89057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047375.221027:0:89057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae1e9 expref: -99 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.221056:0:89057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 12 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.221071:0:89057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 12 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.221082:0:89057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7ec00, rc 0) 00010000:00080000:1.0:1784047375.221141:0:89057:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1784047375.221152:0:89057:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1784047375.237782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047375.237936:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689428992 00000100:00100000:3.0:1784047375.237945:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689428992 00000100:00100000:3.0:1784047375.238109:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1195 00000100:00100000:3.0:1784047375.238121:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:2398:x1870705689428992:12345-192.168.204.40@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1784047375.238141:0:66221:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cd00458a80 x1870705689428992/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 224/0 e 0 to 0 dl 1784047386 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047375.238163:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:2398:x1870705689428992:12345-192.168.204.40@tcp:400:ptlrpcd_rcv.0 Request processed in 45us (389us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047375.238171:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1195 00010000:00080000:1.0:1784047375.238209:0:89057:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1784047375.238310:0:89057:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:3.0:1784047375.240634:0:89024:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00100000:3.0:1784047375.240646:0:89024:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784047375.240667:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00010000:00010000:0.0:1784047375.240912:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.240925:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.240933:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.240939:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047375.240944:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.240961:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.240980:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.240986:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774783 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241010:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241017:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241022:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241027:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047375.241036:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241042:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241050:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.241056:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774791 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89057 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047375.241716:0:89057:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1784047375.241780:0:89057:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1784047375.241801:0:89057:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99cbc9b97800 x1870705709254400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:506/0 lens 224/0 e 0 to 0 dl 1784047386 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784047375.241916:0:89057:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.40@tcp: req@ffff99cd00458a80 x1870705689428992/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 224/0 e 0 to 0 dl 1784047386 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047375.241982:0:89057:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1784047375.246371:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784047375.246389:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99ccfdd08380 x1870705709254400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047391 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047375.246402:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99ccfdd08380 x1870705709254400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047391 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047375.246410:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047375.246421:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1784047375.246427:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cb33439e): req@ffff99cce7ed5f80 x1870705709232768/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047359 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047375.246449:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709254400:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784047375.249738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047375.250915:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709232768 00000100:00100000:0.0:1784047375.250928:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709232768 00000100:00100000:0.0:1784047375.253138:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:0.0:1784047375.253158:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709232768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047375.253196:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444995072 avail 1298755584 00000100:00100000:0.0:1784047375.253279:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709232768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047375.253287:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:0.0:1784047375.253347:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709232768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047375.253483:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709254528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047375.253523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047375.253560:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254528 00000100:00100000:2.0:1784047375.253566:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254528 00000100:00100000:2.0:1784047375.253593:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1784047375.253600:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709254528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047375.253632:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444995072 avail 1298755584 00000100:00100000:2.0:1784047375.253668:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709254528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047375.253674:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1784047375.253701:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709254528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047375.255888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047375.255927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047375.256100:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689424000 00000100:00100000:0.0:1784047375.256109:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689424000 00002000:00100000:0.0:1784047375.256153:0:66236:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99ccec86c700 x1870705689424000/t0(0) o4->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 496/0 e 0 to 0 dl 1784047386 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784047375.256163:0:66236:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99ccec86c700 with x1870705689424000 00002000:00010000:0.0:1784047375.256175:0:66236:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 7 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047375.256207:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:0.0:1784047375.256216:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:0:x1870705689424000:12345-192.168.204.40@tcp:4:dd.0 00000100:00100000:2.0:1784047375.256878:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689424128 00000100:00100000:2.0:1784047375.256885:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689424128 00000100:00100000:2.0:1784047375.256921:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1214 00000100:00100000:2.0:1784047375.256929:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:0:x1870705689424128:12345-192.168.204.40@tcp:16:kworker.0 00000100:00100000:3.0:1784047375.262153:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:0:x1870705689424128:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 5214us (6263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047375.262168:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1214 00000100:00100000:0.0:1784047375.262227:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:0:x1870705689424000:12345-192.168.204.40@tcp:4:dd.0 Request processed in 5737us (6024us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1784047375.262237:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00002000:00100000:0.0:1784047375.262249:0:66236:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99ccec86c700 x1870705689424000/t111669149697(0) o4->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:506/0 lens 496/448 e 0 to 0 dl 1784047386 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784047375.262258:0:66236:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99ccec86c700 with x1870705689424000 00002000:00010000:0.0:1784047375.262267:0:66236:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 9 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1784047375.279830:0:89057:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc9141fb7e10 00100000:10000000:1.0:1784047375.279844:0:89057:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1784047375.281910:0:89043:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4b0:0x0] 00000100:00100000:1.0:1784047375.282019:0:89043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89043:1870705709254656:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784047375.282083:0:89043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047375.282110:0:89043:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9de40 going to sleep for 11 seconds 00000004:00080000:1.0:1784047375.282131:0:89045:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6a2:0x0] 00000100:00100000:1.0:1784047375.282147:0:89045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89045:1870705709254784:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784047375.282172:0:89045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047375.282184:0:89045:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047375.282202:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254656 00000100:00100000:1.0:1784047375.282207:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254656 00000100:00100000:1.0:1784047375.282241:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254784 00000100:00100000:1.0:1784047375.282243:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254784 00000100:00100000:1.0:1784047375.282260:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962 00000100:00100000:1.0:1784047375.282267:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:89043:x1870705709254656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784047375.282292:0:26184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -625 00002000:02000040:1.0:1784047375.282297:0:26184:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1201 to 0x280000401:1825) 00000100:00100000:0.0:1784047375.283912:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1784047375.283942:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:89045:x1870705709254784:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784047375.283969:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -127 00002000:02000040:0.0:1784047375.283973:0:8433:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1699 to 0x2c0000401:1825) 00002000:00010000:1.0:1784047375.296943:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.297540:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.297561:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.297566:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.297573:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.297592:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.297603:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.297674:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.298779:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.299896:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.299909:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.299924:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.299929:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.299941:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300021:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300030:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c77479f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300051:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.300053:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.300055:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.300181:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.300194:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300207:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.300212:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.300218:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300231:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300241:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300250:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300270:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.300278:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.300283:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300291:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.300295:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300303:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300320:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300328:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef667a6/0x4426598c0c7747a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300342:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.300344:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.300346:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.300387:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.300393:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300402:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.300406:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.300410:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300420:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300429:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300437:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.300463:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.302571:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.302586:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.302600:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ea00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.302616:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.302628:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.302648:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.302658:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000122c4b89/0x4426598c0c7747ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.302682:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.302684:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.302686:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784047375.303690:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1784047375.304122:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.304132:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304148:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.304163:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.304171:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304184:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304192:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304200:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304260:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.304313:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.304318:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304327:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.304330:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.304335:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304344:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304353:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.304366:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1784047375.304553:0:89310:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00002000:00010000:0.0:1784047375.308694:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.308708:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.308727:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.308732:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.308738:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.310704:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.310721:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.310730:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.313707:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047375.313724:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.313741:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.313757:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.313914:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.313943:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.313961:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007787fa97/0x4426598c0c7747b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.313995:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047375.313999:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314007:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fe00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.314010:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314018:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314030:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314038:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047375.314042:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314056:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.314059:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314067:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314080:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.314089:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.314091:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.314093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.314929:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784047375.314940:0:26184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f15938f4/0x4426598c0c7747bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047375.315304:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.315312:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315326:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.315331:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.315337:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315350:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315360:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315369:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315409:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.315419:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.315424:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315432:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.315436:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315445:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315458:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.315467:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000217e8dab/0x4426598c0c7747c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.315566:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.316017:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.316019:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.316021:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.316083:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.316089:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316099:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.316109:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.316115:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316125:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316135:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316143:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316201:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.316249:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.316254:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316262:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.316266:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.316270:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316279:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316286:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316301:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316317:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047375.316326:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047375.316331:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316339:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.316343:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316352:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316367:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316376:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7747d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316390:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.316394:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316411:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.316415:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316423:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316434:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316442:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000447bc2c0/0x4426598c0c7747d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.316453:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.316455:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.316457:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.317996:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.318007:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318021:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.318026:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.318031:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318043:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318059:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318067:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318087:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.318097:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.318102:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318110:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.318114:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318121:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318136:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318144:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7747de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318162:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.318169:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.318172:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.318224:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.318229:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318237:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.318240:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.318244:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318253:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318260:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318268:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318284:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.318321:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.318326:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318336:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.318339:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.318342:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318357:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318365:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318372:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318384:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047375.318393:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047375.318397:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318404:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.318408:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318416:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318426:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318433:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7747e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318453:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.318457:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318463:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ee00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.318467:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318889:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318901:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318908:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7747ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.318923:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.318925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.318928:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.319045:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.319051:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319059:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.319067:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.319072:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319082:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319090:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319097:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319111:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.319118:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.319122:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319129:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.319132:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319139:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319149:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319165:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78e1c67/0x4426598c0c7747f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319178:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.319180:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.319181:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.319216:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.319221:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319229:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.319232:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.319236:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319245:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319253:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319260:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319271:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.319281:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.319285:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319291:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.319295:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319303:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319312:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319319:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008966d138/0x4426598c0c7747fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319331:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.319333:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.319335:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.319366:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.319371:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319378:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.319381:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.319386:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319403:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319411:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319418:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319428:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.319434:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.319437:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319443:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.319446:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319454:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.319463:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.319652:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047375.319659:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7747c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047375.320087:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.320538:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff329a59/0x4426598c0c774801 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320562:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.320564:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.320565:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.320645:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.320651:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320660:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.320663:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.320668:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320678:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320687:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320695:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320710:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.320743:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.320759:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.320777:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.320780:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.320784:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321627:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321638:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321647:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321663:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047375.321672:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047375.321678:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321686:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.321690:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321698:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321723:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321730:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c774808 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321756:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.321760:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321766:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.321770:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.321778:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322529:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322542:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c77480f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322557:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.322559:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.322566:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.322669:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.322675:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322685:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.322689:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.322694:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322704:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322712:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322719:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.322734:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.322740:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047375.322902:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.324572:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.324592:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.324598:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.324636:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.324656:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.324664:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c774816 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.324685:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.324687:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.324689:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.324924:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.324931:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.324943:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.324947:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047375.325283:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.325291:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.326888:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.326915:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.326927:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.326942:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327017:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.327031:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.327037:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327045:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.327050:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327060:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327077:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327085:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c77481d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327103:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.327106:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.327107:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.327187:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.327198:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327209:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.327213:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.327218:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327228:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327235:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327242:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327257:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.327265:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.327269:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327276:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.327279:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327286:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327303:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327310:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c774824 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327322:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.327324:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.327326:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.327369:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.327374:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327382:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.327385:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.327389:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327397:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327404:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327411:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327433:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.327441:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.327444:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327450:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.327453:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.327460:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.328893:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.328912:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77482b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.328933:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.328935:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.328938:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.329241:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.329247:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329259:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.329275:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.329281:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329293:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329303:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329312:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329332:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.329369:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.329374:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329383:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.329386:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.329390:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329399:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329408:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329421:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.329435:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047375.329910:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047375.329919:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.329929:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.329933:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.329942:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1784047375.330133:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1784047375.330179:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.330185:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330197:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.330200:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.330205:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330217:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330226:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330233:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330255:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047375.330314:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.330319:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330327:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.330329:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.330333:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330354:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330364:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330372:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330385:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047375.330423:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.330428:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330435:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.330439:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.330443:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330452:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.330460:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330561:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330570:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c774832 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330588:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047375.330592:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330598:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.330602:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330629:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330641:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330649:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c774839 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330661:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047375.330665:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330678:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.330682:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330691:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330702:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330710:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c774847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330725:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047375.330729:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330735:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.330739:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330758:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330767:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.330780:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77484e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047375.331038:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.331048:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331059:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.331062:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.331067:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331077:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331087:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331095:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331109:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.331115:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.331128:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.331141:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.331146:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331153:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.331156:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331164:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331174:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331182:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c774840 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331195:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.331197:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.331199:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.331255:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.331261:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331269:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.331272:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.331277:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331297:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331306:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331314:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331325:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.331331:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.331335:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331341:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.331345:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331353:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331363:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331371:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c77485c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331388:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.331390:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.331392:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.331426:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.331431:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331439:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.331442:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.331447:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331456:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.331464:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.331879:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.331881:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.331883:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.331890:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.332127:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332155:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047375.332220:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.332225:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332233:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.332235:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.332239:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332248:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332255:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332262:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332281:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047375.332319:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.332324:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332338:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.332341:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.332345:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332354:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332361:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332367:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332381:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047375.332418:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.332423:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332430:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.332433:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.332436:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332444:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.332462:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.332904:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.332920:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047375.332925:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.332933:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.332942:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333061:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047375.333067:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333076:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.333079:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333088:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333105:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333113:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c77486a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333129:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047375.333133:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333146:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.333150:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333157:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333168:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333175:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c774871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.333187:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.333189:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.333191:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.333223:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333235:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333242:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c774855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333253:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.333255:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.333256:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.333263:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.333280:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.333343:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.333348:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333356:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.333359:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.333364:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333373:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333393:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333399:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333411:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784047375.333449:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.333454:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.333462:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.333464:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.333547:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333564:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784047375.333573:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784047375.333576:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333583:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.333586:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333594:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333630:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333638:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c774863 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333653:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047375.333662:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333667:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.333670:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333677:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333687:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333694:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c77487f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333705:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.333709:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333715:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.333718:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333725:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333753:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333761:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c774878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.333774:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.333776:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.333778:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.334145:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.334152:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.334567:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334585:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334594:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334601:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334865:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.334946:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.334963:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334973:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.334977:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.334982:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334991:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.334998:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.335006:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047375.335251:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.335257:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.335266:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.335269:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.335273:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.335283:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.335290:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.335297:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335352:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047375.335358:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335367:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.335372:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335391:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335406:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335415:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c774886 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335437:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047375.335441:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335448:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.335451:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335459:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335551:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335562:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047375.335565:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335576:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.335579:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335587:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335597:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.335694:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.335696:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.335698:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.337084:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784047375.337095:0:26184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c77488d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047375.337214:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.337221:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337240:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.337244:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.337249:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337261:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337271:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337278:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337299:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047375.337310:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.337315:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337322:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.337326:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337334:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337360:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337367:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77489b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337383:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.337385:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.337387:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047375.337428:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.337434:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337442:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.337445:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.337449:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337459:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337466:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337473:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337498:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047375.337537:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.337542:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337550:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.337553:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.337556:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337565:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337574:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337582:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337595:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784047375.337653:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047375.337658:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337666:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:1.0:1784047375.337674:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047375.337679:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337688:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337696:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337703:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337718:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784047375.337725:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047375.337729:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337737:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.337740:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337761:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.337772:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338652:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047375.338661:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338671:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.338676:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338685:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338701:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338717:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c7748a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338737:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047375.338741:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338760:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.338763:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338772:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338784:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338863:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c7748b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.338879:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.338881:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.338883:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.338892:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.338897:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.339039:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c7748a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.339056:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.339058:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.339060:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.341111:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047375.341123:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c774894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.344872:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.351072:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.351084:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351103:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.351108:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.351115:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351130:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351141:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351150:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351175:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047375.351215:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.351220:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351236:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.351239:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.351244:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351253:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351261:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351269:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351289:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047375.351300:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047375.351305:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351313:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.351317:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351325:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351353:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351360:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c7748b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351377:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.351381:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351386:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.351389:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351396:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351404:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351411:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c7748be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351420:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.351422:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.351428:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.351467:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.351472:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351480:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.351483:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.351487:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351496:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351503:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351511:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351525:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.351532:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.351536:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351543:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.351547:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351565:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351577:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351584:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c7748c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351597:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.351599:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.351601:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.351669:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.351675:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351683:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.351687:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.351691:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351701:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351709:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351723:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.351754:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047375.351892:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047375.351898:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.351907:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047375.351911:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.351920:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.351931:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.351939:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c7748cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047375.351965:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.351967:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047375.351969:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.354028:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784047375.354596:0:26184:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1200 00000100:00100000:1.0:1784047375.354731:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:89043:x1870705709254656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72458us (72642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047375.354742:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962 00002000:00010000:0.0:1784047375.355917:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.355929:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.355948:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.356018:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.356026:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356042:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356053:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356062:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356090:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.356106:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.356112:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356128:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.356133:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356141:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356159:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356167:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c7748d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356189:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.356191:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.356193:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.356287:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.356293:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356301:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.356305:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.356309:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356317:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356331:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356338:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356352:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.356360:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.356364:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356370:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.356373:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356380:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356390:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356397:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c7748da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356411:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.356418:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.356420:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.356463:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.356468:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356477:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.356480:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.356484:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356494:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356503:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356511:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356525:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.356532:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.356536:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356543:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.356546:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356565:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356578:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356586:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aac34f3/0x4426598c0c7748e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356601:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.356603:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.356626:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.356670:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.356675:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356683:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.356685:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.356689:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356697:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356705:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356719:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356734:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.356741:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.356758:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356765:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.356768:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356775:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.356785:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047375.356974:0:89043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89043:1870705709254656:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784047375.356991:0:89043:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x4b0:0x0] 00000100:00100000:3.0:1784047375.357066:0:89043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89043:1870705709255040:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784047375.357127:0:89043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047375.357158:0:89043:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838de40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047375.357179:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047375.357195:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709254912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047375.357222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047375.357254:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255040 00000100:00100000:3.0:1784047375.357260:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255040 00010000:00010000:0.0:1784047375.357367:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c83a9b/0x4426598c0c7748e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357387:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.357389:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.357390:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047375.357406:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709254912 00000100:00100000:0.0:1784047375.357416:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709254912 00000100:00100000:0.0:1784047375.357448:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1784047375.357457:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870705709254912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047375.357479:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047375.357523:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870705709254912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047375.357531:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1784047375.357574:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709254912:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1784047375.357670:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.357676:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357686:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.357690:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.357695:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357707:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357716:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357724:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357756:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047375.357815:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.357820:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357829:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.357832:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.357837:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357847:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357855:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357864:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357877:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047375.357884:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047375.357889:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357897:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24bc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.357901:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357921:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357935:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.357943:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7748ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.358057:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047375.358064:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.358072:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047375.358075:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.358083:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.358095:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.358102:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c7748f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047375.358125:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.358127:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.358129:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359148:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359150:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.359242:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.359249:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359262:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.359265:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.359270:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359281:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359290:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359307:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359329:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047375.359369:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.359374:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359383:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.359386:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.359390:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359400:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359408:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359416:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359433:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047375.359441:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047375.359446:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359459:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.359463:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359471:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359485:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359492:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c7748fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359505:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.359509:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359515:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ba00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.359518:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359524:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359534:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359548:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c774904 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359560:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359562:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359564:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.359621:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.359627:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359634:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.359637:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.359641:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359650:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359658:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359664:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359677:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.359684:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.359694:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359700:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.359703:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359710:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359719:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359726:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77490b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.359737:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359738:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.359740:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047375.362049:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964 00000100:00100000:3.0:1784047375.362067:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:89043:x1870705709255040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784047375.362273:0:26183:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00010000:00010000:1.0:1784047375.363397:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047375.365794:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:89043:x1870705709255040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3723us (8656us total) trans 4294968751 rc 0/0 00000100:00100000:3.0:1784047375.365808:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964 00002000:00010000:0.0:1784047375.366032:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.366041:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366058:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.366063:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.366070:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366098:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366110:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366121:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366155:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047375.366197:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.366203:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366212:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.366215:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.366219:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366227:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366235:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366253:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366271:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047375.366281:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047375.366287:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366295:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.366300:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366309:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366327:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366336:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c774912 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366353:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.366357:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366375:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ae00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.366379:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366387:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366398:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366406:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774919 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366419:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.366420:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.366422:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.366463:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.366469:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366477:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.366480:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.366485:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366493:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366508:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366515:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366528:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.366535:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.366539:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366546:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.366549:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366557:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366569:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366576:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774920 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366590:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.366597:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.366599:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.366664:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.366670:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366678:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.366681:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.366686:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366695:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366704:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366712:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366725:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.366732:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.366736:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366754:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.366758:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366778:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366799:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366808:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774927 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366822:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.366823:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.366825:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.366865:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.366871:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366880:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.366884:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.366888:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366897:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366906:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366920:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366939:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047375.366977:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.366982:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.366991:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.366994:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.366998:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367008:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367016:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367024:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367036:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047375.367042:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047375.367046:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367059:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24aa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.367063:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367071:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367082:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367090:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77492e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367105:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.367108:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367116:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.367119:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367127:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367136:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367150:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c774935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367165:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367167:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367169:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.367208:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.367213:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367221:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.367224:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.367227:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367236:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367243:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367250:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367262:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.367268:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.367277:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367284:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.367288:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367296:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367307:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367315:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77493c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367328:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367330:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367332:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.367372:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.367377:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367385:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.367389:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.367393:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367413:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367421:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367430:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367442:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.367449:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.367453:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367460:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.367464:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367471:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367481:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367489:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c774943 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367508:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367510:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367512:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.367552:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.367557:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367565:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.367568:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.367572:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367581:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367589:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367596:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367634:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.367641:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.367645:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367664:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.367667:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367676:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367687:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367695:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c77494a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367708:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367710:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367711:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.367763:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.367769:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367777:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.367780:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.367784:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367791:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367806:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367812:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367824:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.367831:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.367834:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367841:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.367844:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367852:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367862:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367868:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c774951 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367881:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367887:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.367889:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047375.367929:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047375.367935:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367943:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=3473s v=(0 0) 00010000:00010000:0.0:1784047375.367946:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047375.367950:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367959:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367967:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367974:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.367987:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047375.367993:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047375.367996:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.368003:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047375.368007:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.368026:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.368038:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.368045:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c774958 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047375.368058:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.368060:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047375.368062:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784047375.368710:0:8433:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1698 00010000:00010000:3.0:1784047375.368855:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047375.368977:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047375.369785:0:89043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89043:1870705709255040:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784047375.369805:0:89043:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00000100:00100000:0.0:1784047375.398545:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:89045:x1870705709254784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 114599us (116360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047375.398562:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1784047375.405673:0:89045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89045:1870705709254784:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784047375.405693:0:89045:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x6a2:0x0] 00000100:00100000:0.0:1784047375.405786:0:89045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89045:1870705709255296:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784047375.405862:0:89045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047375.405893:0:89045:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047375.405910:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047375.405923:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709255168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047375.406108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047375.406673:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255168 00000100:00100000:1.0:1784047375.406684:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255168 00000100:00100000:1.0:1784047375.406732:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1784047375.406741:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709255168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047375.406775:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047375.406837:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709255168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047375.406845:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1784047375.406887:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709255168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047375.412914:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255296 00000100:00100000:2.0:1784047375.412928:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255296 00000100:00100000:2.0:1784047375.412992:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965 00000100:00100000:2.0:1784047375.413002:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:89045:x1870705709255296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784047375.413048:0:26193:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:2.0:1784047375.414689:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:89045:x1870705709255296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1683us (8821us total) trans 4294968751 rc 0/0 00000100:00100000:2.0:1784047375.414700:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965 00000100:00100000:2.0:1784047375.414777:0:89045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89045:1870705709255296:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784047375.414794:0:89045:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00010000:00010000:1.0:1784047375.641093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784047375.648135:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:3.0:1784047376.426601:0:89363:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047376.426891:0:89363:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784047376.659046:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047377.029559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047377.029751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047377.029795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047377.029886:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429120 00000100:00100000:3.0:1784047377.029900:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429120 00000100:00100000:3.0:1784047377.029982:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:3.0:1784047377.029995:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689429120:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047377.030104:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689429120:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047377.030113:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:3.0:1784047377.047574:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429248 00000100:00100000:3.0:1784047377.047596:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429248 00000100:00100000:3.0:1784047377.047778:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429376 00000100:00100000:3.0:1784047377.047783:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429376 00000100:00100000:3.0:1784047377.047825:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1196 00000100:00100000:3.0:1784047377.047838:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:2399:x1870705689429248:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:1.0:1784047377.049440:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047377.049453:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047377.049679:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1197 00000100:00100000:0.0:1784047377.049722:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689429376:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047377.049884:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689429376:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 191us (20088us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047377.049895:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1197 00000100:00100000:3.0:1784047377.050350:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:2399:x1870705689429248:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2514us (20810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047377.050358:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1196 00000020:00000004:1.0:1784047377.508166:0:89414:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784047377.508559:0:89414:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047377.683079:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047378.715718:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047379.486809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047379.487207:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429504 00000100:00100000:2.0:1784047379.487228:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429504 00000100:00080000:1.0:1784047379.487321:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047379.487336:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1215 00000100:00100000:2.0:1784047379.487348:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+9:68221:x1870705689429504:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047379.487373:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047379.487403:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c77495f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae21a expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047379.487565:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774966 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047379.487580:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047379.487655:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047379.487736:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047379.487740:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047379.487787:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047379.488414:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c77495f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae21a expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047379.488513:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774966 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae21a expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047379.488523:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbc89ff300) 00010000:00010000:2.0:1784047379.488526:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047379.488529:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1a00, rc 0) 00000100:00100000:2.0:1784047379.488727:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:68221:x1870705689429504:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1380us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047379.488736:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1215 00000100:00100000:1.0:1784047379.507079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047379.507232:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429632 00000100:00100000:3.0:1784047379.507246:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429632 00000100:00100000:3.0:1784047379.507338:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1216 00000100:00100000:3.0:1784047379.507352:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:68221:x1870705689429632:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047379.508000:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1444990976 avail 1298751488 00000100:00100000:3.0:1784047379.508188:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+10:68221:x1870705689429632:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 836us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047379.508198:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1216 00000100:00100000:0.0:1784047379.515796:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047379.516268:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429760 00000100:00100000:2.0:1784047379.516283:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429760 00000100:00100000:2.0:1784047379.516449:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1217 00000100:00100000:2.0:1784047379.516463:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:68221:x1870705689429760:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047379.516529:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047379.516688:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:68221:x1870705689429760:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 228us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047379.516720:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1217 00000100:00080000:1.0:1784047379.523711:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047379.541014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047379.541193:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689429888 00000100:00100000:2.0:1784047379.541212:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689429888 00000100:00100000:2.0:1784047379.541286:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4966 00000100:00100000:2.0:1784047379.541300:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2398:x1870705689429888:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:2.0:1784047379.541360:0:26186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3477 last 0 00000020:00000080:2.0:1784047379.541411:0:26186:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c77496d 00002000:00100000:2.0:1784047379.541430:0:26186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99cce419e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784047379.541457:0:26186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784047379.541839:0:26186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784047379.541883:0:26186:0:(import.c:65:import_set_state_nolock()) ffff99cce4198800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047379.542025:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689429888:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 725us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047379.542036:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4966 00000100:00100000:3.0:1784047379.553102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047379.553397:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430016 00000100:00100000:0.0:1784047379.553968:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430016 00000100:00100000:0.0:1784047379.554145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2030 00000100:00100000:0.0:1784047379.554160:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:68221:x1870705689430016:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047379.554202:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047379.554300:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:68221:x1870705689430016:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 144us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047379.554309:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2030 00000100:00080000:1.0:1784047379.554506:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047379.564240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047379.567672:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430144 00000100:00100000:2.0:1784047379.567700:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430144 00000100:00100000:2.0:1784047379.567785:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4967 00000100:00100000:2.0:1784047379.567796:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1870705689430144:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:2.0:1784047379.567851:0:13594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3477 last 0 00000020:00000080:2.0:1784047379.567894:0:13594:0:(genops.c:1406:class_connect()) connect: client 2a2569b5-a558-4441-a96a-1d77608df16b, cookie 0x4426598c0c774974 00002000:00100000:2.0:1784047379.567911:0:13594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a2569b5-a558-4441-a96a-1d77608df16b/ffff99cce419c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784047379.567937:0:13594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784047379.568037:0:13594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784047379.568085:0:13594:0:(import.c:65:import_set_state_nolock()) ffff99cce419d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047379.569820:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689430144:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 807us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047379.569843:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4967 00000100:00100000:3.0:1784047379.571509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047379.575219:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430272 00000100:00100000:1.0:1784047379.575244:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430272 00000100:00100000:1.0:1784047379.575463:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2031 00000100:00100000:1.0:1784047379.575482:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:68221:x1870705689430272:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:1.0:1784047379.575551:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047379.576073:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:68221:x1870705689430272:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 229us (4204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047379.576085:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2031 00000100:00080000:2.0:1784047379.577426:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047379.732728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709255424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047379.732840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047379.733194:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047379.733274:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709255552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047379.733316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047379.733420:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255424 00000100:00100000:1.0:1784047379.733431:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255424 00000100:00100000:1.0:1784047379.733515:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255552 00000100:00100000:1.0:1784047379.733519:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255552 00000100:00100000:1.0:1784047379.733550:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:1.0:1784047379.733562:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709255424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047379.733597:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047379.733702:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709255424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047379.733721:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:1.0:1784047379.733742:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1784047379.733749:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709255552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047379.733761:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047379.733793:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709255552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047379.733800:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1784047379.734543:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709255552:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784047379.734580:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047379.734585:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047379.734697:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709255424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047380.243283:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709255680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047380.243384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.243751:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255680 00000100:00100000:3.0:1784047380.243764:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255680 00000100:00100000:3.0:1784047380.243837:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1784047380.243850:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709255680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047380.243911:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047380.243989:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709255680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047380.243998:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:0.0:1784047380.244750:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709255680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047380.246223:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709256064:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047380.246349:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709256576:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047380.246420:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709257088:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047380.246467:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784047380.246473:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709255936:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047380.246512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709256448:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047380.246552:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709256960:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047380.246642:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256576 00000100:00100000:1.0:1784047380.246660:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256576 00000100:00100000:1.0:1784047380.246712:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257088 00000100:00100000:1.0:1784047380.246715:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257088 00000100:00100000:1.0:1784047380.246748:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256960 00000100:00100000:1.0:1784047380.246751:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256960 00000100:00100000:1.0:1784047380.246774:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1784047380.246783:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709256576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246841:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709256576:12345-0@lo:400:kworker.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047380.246849:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1784047380.246868:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1784047380.246874:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709257088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246904:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709257088:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047380.246910:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1784047380.246921:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1784047380.246927:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709256960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.246971:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709256960:12345-0@lo:400:kworker.0 Request processed in 44us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047380.246977:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00080000:1.0:1784047380.247009:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047380.247014:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047380.247051:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709256960:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.247063:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709256576:0@lo:400:kworker.0 00000100:00100000:1.0:1784047380.247072:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709257088:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247170:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709256192:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.247236:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709256704:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.247278:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709257216:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.247320:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784047380.247326:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709255808:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247354:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.247383:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709256320:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.247421:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709256832:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.247441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047380.248901:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256064 00000100:00100000:0.0:1784047380.248921:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256064 00000100:00100000:0.0:1784047380.249009:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255936 00000100:00100000:0.0:1784047380.249012:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255936 00000100:00100000:0.0:1784047380.249028:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256192 00000100:00100000:0.0:1784047380.249031:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256192 00000100:00100000:0.0:1784047380.249050:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257216 00000100:00100000:0.0:1784047380.249053:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257216 00000100:00100000:0.0:1784047380.249065:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256320 00000100:00100000:0.0:1784047380.249067:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256320 00000100:00100000:0.0:1784047380.249080:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256832 00000100:00100000:0.0:1784047380.249083:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256832 00000100:00100000:0.0:1784047380.249102:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1784047380.249112:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709256064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249227:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709256064:12345-0@lo:400:kworker.0 Request processed in 116us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047380.249236:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1784047380.249257:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1784047380.249263:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709255936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249295:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709255936:12345-0@lo:400:kworker.0 Request processed in 32us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047380.249302:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1784047380.249313:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1784047380.249318:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709256192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249353:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709256192:12345-0@lo:400:kworker.0 Request processed in 34us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047380.249360:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1784047380.249394:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1784047380.249409:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709257216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249439:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709257216:12345-0@lo:400:kworker.0 Request processed in 31us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047380.249445:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1784047380.249457:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1784047380.249463:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709256320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249490:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709256320:12345-0@lo:400:kworker.0 Request processed in 27us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047380.249496:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1784047380.249508:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1784047380.249514:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709256832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249542:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709256832:12345-0@lo:400:kworker.0 Request processed in 28us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047380.249548:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1784047380.249643:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709256320:0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249673:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709256832:0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249686:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709256192:0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249700:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709257216:0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249752:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709255936:0@lo:400:kworker.0 00000100:00100000:0.0:1784047380.249765:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709256064:0@lo:400:kworker.0 00000100:00100000:2.0:1784047380.250936:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256704 00000100:00100000:2.0:1784047380.250950:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256704 00000100:00100000:2.0:1784047380.251008:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1784047380.251019:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709256704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047380.251113:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709256704:12345-0@lo:400:kworker.0 Request processed in 95us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047380.251121:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1784047380.251154:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709256448 00000100:00100000:2.0:1784047380.251158:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709256448 00000100:00100000:2.0:1784047380.251187:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:2.0:1784047380.251193:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709256448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047380.251231:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709256448:12345-0@lo:400:kworker.0 Request processed in 38us (4694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047380.251237:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:2.0:1784047380.251257:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709255808 00000100:00100000:2.0:1784047380.251261:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709255808 00000100:00100000:2.0:1784047380.251291:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784047380.251298:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709255808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047380.251330:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709255808:12345-0@lo:400:kworker.0 Request processed in 33us (3975us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047380.251337:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784047380.251410:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709255808:0@lo:400:kworker.0 00000100:00100000:2.0:1784047380.251427:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709256704:0@lo:400:kworker.0 00000100:00080000:3.0:1784047380.252078:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047380.252087:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047380.253840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709256448:0@lo:400:kworker.0 00000100:00100000:3.0:1784047380.757762:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709257344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047380.757859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047380.757934:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257344 00000100:00100000:3.0:1784047380.757944:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257344 00000100:00100000:3.0:1784047380.758010:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1784047380.758021:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709257344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047380.758057:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047380.758107:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709257344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047380.758126:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1784047380.758469:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047380.758481:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709257472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047380.758521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047380.759717:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047380.761459:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047380.761486:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709257600:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1784047380.761872:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:0.0:1784047380.761892:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968751 is committed 00000100:00100000:3.0:1784047380.762017:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709257344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047380.762076:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257472 00000100:00100000:3.0:1784047380.762087:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257472 00000001:00080000:1.0:1784047380.762088:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000100:00100000:3.0:1784047380.762162:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1784047380.762176:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709257472:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047380.762347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1784047380.762493:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00000100:00100000:3.0:1784047380.762877:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709257472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 703us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047380.762888:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1784047380.762944:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257600 00000100:00100000:3.0:1784047380.762950:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257600 00000100:00100000:3.0:1784047380.762988:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1784047380.763001:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709257600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047380.763029:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047380.763072:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709257600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047380.763079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1784047380.763152:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709257600:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1784047380.764254:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:1.0:1784047380.764275:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968751 is committed 00000100:00100000:2.0:1784047380.764361:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709257472:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784047381.779288:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047382.149099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047382.149149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047382.149191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047382.149218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047382.149244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047382.149369:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430528 00000100:00100000:0.0:1784047382.149382:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430528 00000100:00100000:0.0:1784047382.149469:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430656 00000100:00100000:0.0:1784047382.149472:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430656 00000100:00100000:0.0:1784047382.149502:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1204 00000100:00100000:0.0:1784047382.149515:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689430528:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047382.149650:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689430528:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 138us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047382.149668:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1204 00000100:00100000:0.0:1784047382.149690:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1205 00000100:00100000:0.0:1784047382.149697:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689430656:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047382.149724:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689430656:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047382.149731:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1205 00000100:00100000:3.0:1784047382.149994:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430400 00000100:00100000:3.0:1784047382.150014:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430400 00000100:00100000:3.0:1784047382.150051:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:3.0:1784047382.150058:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689430400:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047382.150095:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689430400:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 38us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047382.150102:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00080000:3.0:1784047382.150141:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047382.150146:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047382.154582:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430784 00000100:00100000:1.0:1784047382.154601:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430784 00000100:00100000:1.0:1784047382.154719:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689430912 00000100:00100000:1.0:1784047382.154723:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689430912 00000100:00100000:1.0:1784047382.154757:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2492 00000100:00100000:1.0:1784047382.154773:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689430784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047382.155076:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689430784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 307us (5923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047382.155085:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2492 00000100:00100000:1.0:1784047382.155105:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2493 00000100:00100000:1.0:1784047382.155112:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689430912:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047382.155140:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689430912:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (5894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047382.155166:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2493 00000100:00080000:3.0:1784047382.155339:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047382.155345:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047382.810995:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047383.827922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047384.851011:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047384.851625:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047384.851660:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709257728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047384.851764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047384.851932:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257728 00000100:00100000:2.0:1784047384.852091:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257728 00000100:00100000:2.0:1784047384.852184:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:2.0:1784047384.852197:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709257728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047384.852240:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047384.852311:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709257728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047384.852320:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1784047384.852547:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047384.852561:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709257856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047384.852631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047384.852714:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047384.852765:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709257728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047384.853333:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257856 00000100:00100000:2.0:1784047384.853340:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257856 00000100:00100000:2.0:1784047384.853400:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:2.0:1784047384.853409:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709257856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047384.853433:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047384.853492:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709257856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047384.853500:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00080000:3.0:1784047384.853677:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047384.853747:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709257856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047385.363227:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709257984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047385.363339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.363746:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709258112:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.363796:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.363829:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709258624:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.363857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.363875:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709259136:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.363913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.363944:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784047385.363950:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709258496:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.363974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.363993:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709259008:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.364032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.364062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709258368:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.364089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.364110:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709258880:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.364133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.364153:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784047385.364197:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259136 00000100:00100000:0.0:1784047385.364208:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259136 00000100:00100000:3.0:1784047385.364259:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259008 00000100:00100000:3.0:1784047385.364266:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259008 00000100:00100000:0.0:1784047385.364296:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1784047385.364311:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709259136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.364314:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:3.0:1784047385.364328:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709259008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047385.364435:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709257984 00000100:00100000:1.0:1784047385.364441:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709257984 00000100:00100000:1.0:1784047385.364478:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1784047385.364486:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709257984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047385.364521:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047385.364828:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709259136:12345-0@lo:400:kworker.0 Request processed in 520us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047385.364836:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:3.0:1784047385.364888:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709259008:12345-0@lo:400:kworker.0 Request processed in 561us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.364897:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:3.0:1784047385.364926:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258624 00000100:00100000:3.0:1784047385.364940:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258624 00000100:00100000:3.0:1784047385.364976:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258496 00000100:00100000:3.0:1784047385.364979:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258496 00000100:00100000:3.0:1784047385.364998:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258368 00000100:00100000:3.0:1784047385.365002:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258368 00000100:00100000:3.0:1784047385.365031:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258880 00000100:00100000:3.0:1784047385.365035:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258880 00000100:00100000:3.0:1784047385.365051:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1784047385.365059:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709258624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365102:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709258624:12345-0@lo:400:kworker.0 Request processed in 44us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.365110:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1784047385.365125:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1784047385.365132:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709258496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365163:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709258496:12345-0@lo:400:kworker.0 Request processed in 32us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.365170:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1784047385.365181:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1784047385.365187:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709258368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365230:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709258368:12345-0@lo:400:kworker.0 Request processed in 31us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.365238:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1784047385.365251:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1784047385.365257:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709258880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365289:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709258880:12345-0@lo:400:kworker.0 Request processed in 32us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.365296:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1784047385.365327:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258112 00000100:00100000:3.0:1784047385.365331:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258112 00000100:00100000:3.0:1784047385.365364:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784047385.365386:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709258112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365428:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709258112:12345-0@lo:400:kworker.0 Request processed in 58us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.365434:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1784047385.365467:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047385.365472:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047385.365475:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047385.365477:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047385.365645:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709258496:0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365665:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 2 00000100:00100000:3.0:1784047385.365686:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709259008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365697:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709258112:0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365711:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709258624:0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.365723:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968751 gen 2 00000100:00100000:3.0:1784047385.365738:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709259136:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.370838:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709258240:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.370958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.371027:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709258752:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.371056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.371085:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709259264:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.371107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047385.371159:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709258368:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.371174:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709258880:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.371713:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258752 00000100:00100000:2.0:1784047385.371723:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258752 00000100:00100000:2.0:1784047385.371792:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:2.0:1784047385.371802:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709258752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.371891:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709258752:12345-0@lo:400:kworker.0 Request processed in 90us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047385.371912:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:2.0:1784047385.371945:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709258240 00000100:00100000:2.0:1784047385.371949:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709258240 00000100:00100000:2.0:1784047385.371987:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259264 00000100:00100000:2.0:1784047385.371990:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259264 00000100:00100000:2.0:1784047385.372008:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1784047385.372136:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709258240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.372177:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709258240:12345-0@lo:400:kworker.0 Request processed in 163us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047385.372184:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1784047385.372198:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1784047385.372206:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709259264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.372314:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709259264:12345-0@lo:400:kworker.0 Request processed in 109us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047385.372321:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00080000:2.0:1784047385.372351:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047385.372486:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709258240:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.372502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709258752:0@lo:400:kworker.0 00000100:00100000:2.0:1784047385.372514:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709259264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047385.373140:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709257984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047385.373189:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709257984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8526us (9673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047385.373201:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00010000:00010000:1.0:1784047385.875306:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047385.876045:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047385.876083:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709259392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047385.876802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047385.876919:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709259520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047385.877218:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259392 00000100:00100000:2.0:1784047385.877230:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259392 00000100:00100000:3.0:1784047385.877377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047385.877471:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047385.877479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709259648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047385.877521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047385.877570:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259648 00000100:00100000:3.0:1784047385.877574:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259648 00000100:00100000:3.0:1784047385.877633:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1784047385.877644:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709259648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047385.877694:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00000100:00100000:3.0:1784047385.877749:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709259648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047385.877756:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1784047385.877819:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709259648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047385.878159:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259520 00000100:00100000:2.0:1784047385.878173:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259520 00000100:00100000:2.0:1784047385.878220:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1784047385.878230:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709259392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047385.878246:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047385.878295:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709259392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047385.878302:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1784047385.878344:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1784047385.878350:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709259520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047385.878360:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047385.878391:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709259520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047385.878397:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1784047385.878428:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709259520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047385.878702:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709259392:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1784047386.117485:0:89607:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1784047386.900963:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047387.271318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047387.271354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047387.271389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047387.271410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047387.271431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047387.271455:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431552 00000100:00100000:0.0:1784047387.271464:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431552 00000100:00100000:0.0:1784047387.271514:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431424 00000100:00100000:0.0:1784047387.271527:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431424 00000100:00100000:0.0:1784047387.271553:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2496 00000100:00100000:0.0:1784047387.271564:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689431552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047387.271677:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689431552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047387.271685:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2496 00000100:00100000:0.0:1784047387.271702:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2497 00000100:00100000:0.0:1784047387.271708:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689431424:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047387.271733:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689431424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047387.271739:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2497 00000100:00100000:1.0:1784047387.271891:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431296 00000100:00100000:1.0:1784047387.271896:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431296 00000100:00100000:1.0:1784047387.271937:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431168 00000100:00100000:1.0:1784047387.271940:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431168 00000100:00100000:1.0:1784047387.271976:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1212 00000100:00100000:1.0:1784047387.271984:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689431296:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047387.272014:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689431296:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047387.272021:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1212 00000100:00100000:1.0:1784047387.272034:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1213 00000100:00100000:1.0:1784047387.272041:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689431168:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047387.272064:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689431168:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047387.272071:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1213 00000100:00100000:3.0:1784047387.272476:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431040 00000100:00100000:3.0:1784047387.272482:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431040 00000100:00100000:3.0:1784047387.272512:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:3.0:1784047387.272529:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689431040:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047387.272559:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689431040:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 41us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047387.272566:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00080000:2.0:1784047387.272936:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047387.272943:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047387.272947:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047387.272949:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1784047387.509082:0:89655:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1784047387.924669:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047388.946855:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047389.221791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047389.225776:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431680 00000100:00100000:0.0:1784047389.225793:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431680 00000100:00100000:0.0:1784047389.225966:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1218 00000100:00100000:0.0:1784047389.225979:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:68688:x1870705689431680:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047389.226030:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047389.226293:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:68688:x1870705689431680:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 316us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047389.226301:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1218 00000100:00100000:3.0:1784047389.229052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00080000:2.0:1784047389.229794:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047389.229863:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431808 00000100:00100000:1.0:1784047389.229873:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431808 00000100:00100000:1.0:1784047389.230005:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1219 00000100:00100000:1.0:1784047389.230026:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:68688:x1870705689431808:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047389.230068:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047389.230164:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:68688:x1870705689431808:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 149us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047389.230173:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1219 00000100:00080000:2.0:1784047389.230942:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047389.236462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047389.236857:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689431936 00000100:00100000:2.0:1784047389.236867:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689431936 00000100:00100000:2.0:1784047389.236949:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2040 00000100:00100000:2.0:1784047389.236960:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:68688:x1870705689431936:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047389.236995:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047389.237080:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:68688:x1870705689431936:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 121us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047389.237100:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2040 00000100:00080000:0.0:1784047389.237214:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047389.240881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047389.241908:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432064 00000100:00100000:2.0:1784047389.241920:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432064 00000100:00100000:2.0:1784047389.242006:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2041 00000100:00100000:2.0:1784047389.242018:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:68688:x1870705689432064:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047389.242056:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784047389.242224:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047389.242422:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:68688:x1870705689432064:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 405us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047389.242430:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2041 00000100:00100000:1.0:1784047389.279364:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047389.279496:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432320 00000100:00100000:2.0:1784047389.279508:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432320 00000100:00100000:2.0:1784047389.279586:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1220 00000100:00100000:2.0:1784047389.279598:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:68704:x1870705689432320:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:2.0:1784047389.279667:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047389.279699:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c77497b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae221 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.279989:0:68026:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 9 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280008:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280028:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280041:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280157:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280166:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280173:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280179:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047389.280183:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280189:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280202:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99cd001e7300) 00010000:00010000:2.0:1784047389.280205:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047389.280210:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280216:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774982 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280275:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c77497b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae221 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280285:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbc89ff300) 00010000:00010000:2.0:1784047389.280288:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047389.280291:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c77497b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae221 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047389.280307:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0200, rc 0) 00000100:00100000:2.0:1784047389.280377:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+9:68704:x1870705689432320:12345-192.168.204.40@tcp:101:cat.0 Request processed in 781us (1023us total) trans 111669149698 rc 301/301 00000100:00100000:2.0:1784047389.280386:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1220 00000100:00100000:3.0:1784047389.285316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047389.285426:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432448 00000100:00100000:1.0:1784047389.285438:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432448 00000100:00100000:1.0:1784047389.285512:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1221 00000100:00100000:1.0:1784047389.285533:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:68704:x1870705689432448:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:1.0:1784047389.285561:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047389.285583:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae228 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.285858:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.285874:0:66221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.285884:0:66221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.285919:0:66221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 89057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.285933:0:66221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 10 pid: 89057 timeout: 3587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047389.285964:0:66221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66221:1870705709259776:192.168.204.40@tcp:104: 00000100:00100000:1.0:1784047389.286055:0:66221:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047389.291419:0:66221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66221:1870705709259776:192.168.204.40@tcp:104: 00010000:00010000:1.0:1784047389.291451:0:66221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047389.298975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047389.299532:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432576 00000100:00100000:1.0:1784047389.299546:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432576 00010000:00010000:1.0:1784047389.299585:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 89057 timeout: 3587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047389.299655:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2539 00000100:00100000:1.0:1784047389.299666:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:2401:x1870705689432576:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784047389.299682:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:1.0:1784047389.299850:0:6503:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:1.0:1784047389.299854:0:6503:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1784047335 00000004:00010000:1.0:1784047389.299856:0:6503:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1784047326 00000004:00010000:1.0:1784047389.299858:0:6503:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1784047335 00010000:00010000:1.0:1784047389.299863:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 89057 timeout: 3587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.299876:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 89057 timeout: 3587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.299900:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774798 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1e9 expref: 11 pid: 89057 timeout: 3587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.299933:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99cd001e7300) 00010000:00010000:1.0:1784047389.299938:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.299946:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.299953:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.299989:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047389.300041:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:2401:x1870705689432576:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 377us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047389.300050:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2539 00010000:00010000:0.0:1784047389.300655:0:66221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047389.300665:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047389.300730:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047389.300755:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047389.300788:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae228 expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047389.300805:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae228 expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047389.300814:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99cd001e7300) 00010000:00010000:0.0:1784047389.300818:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047389.300829:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28200, rc 0) 00000100:00100000:0.0:1784047389.300880:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:68704:x1870705689432448:12345-192.168.204.40@tcp:101:cat.0 Request processed in 15358us (15573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047389.300888:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1221 00000100:00100000:0.0:1784047389.305073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047389.305154:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432704 00000100:00100000:1.0:1784047389.305167:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432704 00000100:00100000:1.0:1784047389.305221:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1222 00000100:00100000:1.0:1784047389.305231:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+9:68704:x1870705689432704:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:1.0:1784047389.305250:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047389.305270:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c77499e lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae22f expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.305329:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c77499e lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae22f expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.305344:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c77499e lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae22f expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047389.305400:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99cd001e7300) 00010000:00010000:1.0:1784047389.305404:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047389.305409:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29800, rc 0) 00000100:00100000:1.0:1784047389.305471:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:68704:x1870705689432704:12345-192.168.204.40@tcp:101:cat.0 Request processed in 241us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047389.305477:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1222 00000100:00100000:3.0:1784047389.308771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047389.308997:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432832 00000100:00100000:0.0:1784047389.309007:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432832 00000100:00100000:0.0:1784047389.309058:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1223 00000100:00100000:0.0:1784047389.309067:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:2402:x1870705689432832:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:0.0:1784047389.309088:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047389.309107:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7749a5 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae236 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047389.309143:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7749a5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae236 expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047389.309169:0:66220:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:0.0:1784047389.309172:0:66220:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1784047335 -> 1784047335 00000004:00010000:0.0:1784047389.309174:0:66220:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1784047326 -> 1784047326 00000004:00010000:0.0:1784047389.309176:0:66220:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1784047335 -> 1784047335 00000004:00010000:0.0:1784047389.309178:0:66220:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:0.0:1784047389.309182:0:66220:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:0.0:1784047389.309190:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7749a5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae236 expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047389.309202:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff99cd001e7300) 00010000:00010000:0.0:1784047389.309205:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784047389.309223:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a400, rc 0) 00000100:00100000:0.0:1784047389.309285:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+11:2402:x1870705689432832:12345-192.168.204.40@tcp:101:cat.0 Request processed in 218us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047389.309292:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1223 00000100:00100000:0.0:1784047389.321783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047389.321892:0:66234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689432960 00000100:00100000:3.0:1784047389.321904:0:66234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689432960 00002000:00100000:3.0:1784047389.321957:0:66234:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99ccef517100 x1870705689432960/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:520/0 lens 488/0 e 0 to 0 dl 1784047400 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047389.321968:0:66234:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99ccef517100 with x1870705689432960 00000100:00100000:3.0:1784047389.322038:0:66234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:3.0:1784047389.322048:0:66234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:2399:x1870705689432960:12345-192.168.204.40@tcp:3:cat.0 00000100:00100000:3.0:1784047389.322249:0:66234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:2399:x1870705689432960:12345-192.168.204.40@tcp:3:cat.0 Request processed in 202us (477us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784047389.322256:0:66234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00002000:00100000:3.0:1784047389.322263:0:66234:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff99ccef517100 x1870705689432960/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:520/0 lens 488/4536 e 0 to 0 dl 1784047400 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047389.322270:0:66234:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff99ccef517100 with x1870705689432960 00000100:00100000:3.0:1784047389.330099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047389.330408:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433216 00000100:00100000:0.0:1784047389.330419:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433216 00000100:00100000:0.0:1784047389.330496:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 224 00000100:00100000:0.0:1784047389.330507:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:68704:x1870705689433216:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:0.0:1784047389.330878:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:68704:x1870705689433216:12345-192.168.204.40@tcp:35:cat.0 Request processed in 371us (788us total) trans 111669149699 rc 0/0 00000100:00100000:0.0:1784047389.330887:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 224 00010000:00010000:1.0:1784047389.970966:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047389.971495:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047389.971519:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709259904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047389.971589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047389.971810:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709259904 00000100:00100000:0.0:1784047389.971819:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709259904 00000100:00100000:0.0:1784047389.971892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1784047389.971902:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709259904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047389.971927:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047389.971977:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709259904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047389.971985:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00080000:1.0:1784047389.972073:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047389.972131:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709259904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047389.972439:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709260032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047389.972484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047389.972986:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260032 00000100:00100000:0.0:1784047389.973063:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260032 00000100:00100000:0.0:1784047389.973116:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:0.0:1784047389.973124:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709260032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047389.973139:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047389.973188:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709260032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047389.973208:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1784047389.973284:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709260032:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784047389.973366:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047390.483136:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047390.483169:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709260160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047390.483265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.483766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709260416:0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.483783:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709260672:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.483818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.483978:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709260928:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.484004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.484022:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709261440:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.484047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.484072:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784047390.484077:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709260544:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.484099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.484115:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709261056:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.484134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.484146:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709261568:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.484169:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.484269:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260160 00000100:00100000:2.0:1784047390.484279:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260160 00000100:00100000:1.0:1784047390.484281:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709260288:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.484336:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047390.484343:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1784047390.484358:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709260160:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047390.484375:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709260800:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.484402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1784047390.484420:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047390.484548:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709260160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047390.484558:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1784047390.484580:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260928 00000100:00100000:2.0:1784047390.484583:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260928 00000100:00100000:2.0:1784047390.484629:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1784047390.484636:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709260928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.484675:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709260928:12345-0@lo:400:kworker.0 Request processed in 40us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047390.484683:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1784047390.484746:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709260928:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.491267:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709261312:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.491520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047390.491590:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709260160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047390.491689:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261440 00000100:00100000:1.0:1784047390.491706:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261440 00000100:00100000:1.0:1784047390.491775:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261312 00000100:00100000:1.0:1784047390.491779:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261312 00000100:00100000:1.0:1784047390.491809:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1784047390.491820:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709261440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.491892:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709261440:12345-0@lo:400:kworker.0 Request processed in 74us (7842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047390.491900:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1784047390.491931:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1784047390.491938:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709261312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.493596:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709261312:12345-0@lo:400:kworker.0 Request processed in 1644us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047390.493628:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:3.0:1784047390.494258:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260416 00000100:00100000:3.0:1784047390.494271:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260416 00000100:00100000:3.0:1784047390.494679:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260544 00000100:00100000:3.0:1784047390.494685:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260544 00000100:00100000:3.0:1784047390.494738:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261056 00000100:00100000:3.0:1784047390.494742:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261056 00000100:00100000:3.0:1784047390.494761:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261568 00000100:00100000:3.0:1784047390.494764:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261568 00000100:00100000:3.0:1784047390.494794:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260800 00000100:00100000:3.0:1784047390.494798:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260800 00000100:00100000:3.0:1784047390.494821:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1784047390.494832:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709260544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.494946:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709260544:12345-0@lo:400:kworker.0 Request processed in 116us (10845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.494954:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1784047390.494993:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1784047390.495002:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709261056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.495039:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709261056:12345-0@lo:400:kworker.0 Request processed in 40us (10903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.495047:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1784047390.495063:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1784047390.495069:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709261568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.495099:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709261568:12345-0@lo:400:kworker.0 Request processed in 31us (10930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.495106:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1784047390.495117:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1784047390.495123:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709260800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.495155:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709260800:12345-0@lo:400:kworker.0 Request processed in 32us (10752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.495160:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1784047390.495240:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1784047390.495246:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709260416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.495280:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709260416:12345-0@lo:400:kworker.0 Request processed in 34us (11466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.495292:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00080000:3.0:1784047390.496805:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047390.496814:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047390.496819:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047390.496822:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047390.496848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047390.496901:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709261184:0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.497374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047390.497439:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260672 00000100:00100000:3.0:1784047390.497448:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260672 00000100:00100000:3.0:1784047390.497522:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1784047390.497530:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709260672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.497593:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709260672:12345-0@lo:400:kworker.0 Request processed in 63us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.497601:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1784047390.497654:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709260288 00000100:00100000:3.0:1784047390.497659:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709260288 00000100:00100000:3.0:1784047390.497763:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784047390.497770:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709260288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.497805:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709260288:12345-0@lo:400:kworker.0 Request processed in 35us (13469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047390.497812:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1784047390.497847:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047390.497885:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709260672:0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.503240:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261184 00000100:00100000:2.0:1784047390.503261:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261184 00000100:00100000:2.0:1784047390.503514:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:2.0:1784047390.503529:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709261184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047390.506274:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709261184:12345-0@lo:400:kworker.0 Request processed in 2730us (8881us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047390.506302:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1784047390.506984:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709260544:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709261056:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507084:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709261568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507098:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709260416:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507111:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709261440:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507315:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709260288:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507330:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709260800:0@lo:400:kworker.0 00000100:00100000:1.0:1784047390.507343:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709261312:0@lo:400:kworker.0 00000100:00100000:0.0:1784047390.508278:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709261184:0@lo:400:kworker.0 00000100:00100000:3.0:1784047390.994898:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709261696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047390.994995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047390.995053:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047390.995057:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709261824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047390.995078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047390.996639:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047390.996691:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261696 00000100:00100000:1.0:1784047390.996727:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261696 00000100:00100000:1.0:1784047390.996832:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1784047390.996847:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709261696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047390.997014:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047390.997125:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709261696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 280us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047390.997135:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1784047390.997171:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261824 00000100:00100000:1.0:1784047390.997177:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261824 00000100:00100000:3.0:1784047390.997181:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709261696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047390.997227:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:1.0:1784047390.997236:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709261824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047390.997343:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00000100:00100000:1.0:1784047390.997395:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709261824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047390.997403:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:3.0:1784047390.997475:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709261824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047390.998901:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047391.002064:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709261952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047391.002149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047391.002286:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709261952 00000100:00100000:0.0:1784047391.002301:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709261952 00000100:00100000:0.0:1784047391.002385:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:0.0:1784047391.002398:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709261952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047391.002460:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047391.002570:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709261952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047391.002579:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1784047391.002984:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709261952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784047392.019081:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047392.392123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047392.392163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047392.392195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047392.392217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047392.392243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047392.392521:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433728 00000100:00100000:1.0:1784047392.392533:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433728 00000100:00100000:1.0:1784047392.392602:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433856 00000100:00100000:1.0:1784047392.392641:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433856 00000100:00100000:1.0:1784047392.392669:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2500 00000100:00100000:1.0:1784047392.392680:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689433728:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047392.392761:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689433728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 83us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047392.392780:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2500 00000100:00100000:1.0:1784047392.392798:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2501 00000100:00100000:1.0:1784047392.392805:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689433856:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047392.392833:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689433856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047392.392840:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2501 00000100:00100000:1.0:1784047392.392859:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433344 00000100:00100000:1.0:1784047392.392862:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433344 00000100:00100000:1.0:1784047392.392890:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1784047392.392897:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689433344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047392.392924:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689433344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047392.392931:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1784047392.392964:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433472 00000100:00100000:1.0:1784047392.392967:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433472 00000100:00100000:1.0:1784047392.392996:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433600 00000100:00100000:1.0:1784047392.392999:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433600 00000100:00100000:1.0:1784047392.393022:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1220 00000100:00100000:1.0:1784047392.393029:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:2401:x1870705689433472:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047392.393063:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:2401:x1870705689433472:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047392.393070:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1220 00000100:00100000:1.0:1784047392.393082:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1221 00000100:00100000:1.0:1784047392.393089:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689433600:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047392.393123:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689433600:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047392.393130:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1221 00000100:00080000:1.0:1784047392.393151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047392.393155:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047392.393157:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047392.393160:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784047393.045786:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047394.066905:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784047394.593026:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:1.0:1784047395.090929:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047395.091120:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709262080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047395.091190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047395.091525:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262080 00000100:00100000:3.0:1784047395.091534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262080 00000100:00100000:3.0:1784047395.091622:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:3.0:1784047395.091634:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709262080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047395.091664:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047395.091711:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709262080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047395.091718:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1784047395.091891:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709262080:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047395.091953:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047395.093837:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047395.093859:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709262208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047395.093922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047395.094028:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262208 00000100:00100000:2.0:1784047395.094036:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262208 00000100:00100000:2.0:1784047395.094116:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1784047395.094126:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709262208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047395.094158:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047395.094207:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709262208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047395.094214:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00080000:1.0:1784047395.094766:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047395.094812:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709262208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047395.603999:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709262336:0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.604069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047395.604386:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709262720:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.604421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047395.604460:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709263232:0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.604469:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709262848:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.604492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047395.604509:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709262464:0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.604534:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709262592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047395.604556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047395.604577:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709263104:0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.604632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047395.604656:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709263616:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.604666:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709263744:0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.604683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047395.604700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047395.604733:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262592 00000100:00100000:1.0:1784047395.604740:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262592 00000100:00100000:1.0:1784047395.604777:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263104 00000100:00100000:1.0:1784047395.604780:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263104 00000100:00100000:1.0:1784047395.604796:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1784047395.604802:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709262592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047395.604829:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047395.604956:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709262592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047395.604964:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1784047395.604983:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:1.0:1784047395.604989:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709263104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.605019:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709263104:12345-0@lo:400:kworker.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047395.605025:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:1.0:1784047395.605079:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709262592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047395.605090:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709263104:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.605945:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263616 00000100:00100000:3.0:1784047395.605953:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263616 00000100:00100000:3.0:1784047395.605996:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:3.0:1784047395.606004:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709263616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.606053:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709263616:12345-0@lo:400:kworker.0 Request processed in 50us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047395.606068:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:0.0:1784047395.606105:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262720 00000100:00100000:0.0:1784047395.606109:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262720 00000100:00100000:1.0:1784047395.606164:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263232 00000100:00100000:1.0:1784047395.606168:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263232 00000100:00100000:1.0:1784047395.606244:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263744 00000100:00100000:1.0:1784047395.606248:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263744 00000100:00100000:0.0:1784047395.606321:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1784047395.606331:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709263232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.606385:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709263232:12345-0@lo:400:kworker.0 Request processed in 56us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047395.606391:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1784047395.606406:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1784047395.606412:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709263744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.606440:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709263744:12345-0@lo:400:kworker.0 Request processed in 28us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047395.606446:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1784047395.606480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709263232:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.606490:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709263744:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608045:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262336 00000100:00100000:0.0:1784047395.608058:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262336 00000100:00100000:0.0:1784047395.608123:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784047395.608132:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709262336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608201:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709262336:12345-0@lo:400:kworker.0 Request processed in 70us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047395.608208:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784047395.608242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047395.608284:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709262976:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047395.608334:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709263488:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047395.608407:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262464 00000100:00100000:0.0:1784047395.608411:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262464 00000100:00100000:0.0:1784047395.608441:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262976 00000100:00100000:0.0:1784047395.608444:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262976 00000100:00100000:0.0:1784047395.608459:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1784047395.608466:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709262464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608513:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709262464:12345-0@lo:400:kworker.0 Request processed in 36us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047395.608519:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1784047395.608532:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1784047395.608539:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709262976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608569:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709262976:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047395.608575:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1784047395.608624:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263488 00000100:00100000:0.0:1784047395.608628:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263488 00000100:00100000:0.0:1784047395.608657:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1784047395.608663:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709263488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608694:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709263488:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047395.608700:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1784047395.608737:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709262464:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608748:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709262976:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.608756:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709263488:0@lo:400:kworker.0 00000100:00080000:3.0:1784047395.609073:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047395.609079:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047395.609081:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047395.609083:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047395.609103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047395.609138:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709263360:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.609168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047395.609206:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709262336:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.609237:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709263616:0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.609320:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709262848 00000100:00100000:3.0:1784047395.609324:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709262848 00000100:00100000:3.0:1784047395.609341:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1784047395.609347:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709262720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.609395:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709262720:12345-0@lo:400:kworker.0 Request processed in 48us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047395.609402:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1784047395.609415:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1784047395.609421:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709262848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047395.609452:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709262848:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047395.609458:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00080000:3.0:1784047395.609472:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047395.609475:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047395.609490:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709262848:0@lo:400:kworker.0 00000100:00100000:0.0:1784047395.609661:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709262720:0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.609739:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263360 00000100:00100000:1.0:1784047395.609744:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263360 00000100:00100000:1.0:1784047395.609781:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:1.0:1784047395.609788:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709263360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047395.609828:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709263360:12345-0@lo:400:kworker.0 Request processed in 41us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047395.609843:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:1.0:1784047395.609870:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709263360:0@lo:400:kworker.0 00000100:00100000:0.0:1784047396.114807:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047396.114834:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709263872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047396.114909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047396.114996:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709263872 00000100:00100000:0.0:1784047396.115003:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709263872 00000100:00100000:0.0:1784047396.115051:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:0.0:1784047396.115060:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709263872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047396.115086:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047396.115130:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709263872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047396.115138:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00010000:00010000:0.0:1784047396.115161:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047396.115201:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709263872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047396.115227:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709264000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047396.115234:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709264128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047396.115274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047396.115285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047396.115325:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264000 00000100:00100000:0.0:1784047396.115330:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264000 00000100:00100000:0.0:1784047396.115371:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1784047396.115378:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709264000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047396.115405:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047396.115438:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709264000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047396.115445:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1784047396.115479:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709264000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047396.115556:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264128 00000100:00100000:2.0:1784047396.115560:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264128 00000100:00100000:2.0:1784047396.115592:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1784047396.115599:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709264128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047396.115640:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047396.115674:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709264128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047396.115680:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:3.0:1784047396.116180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709264128:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784047396.259025:0:89850:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:3.0:1784047397.138994:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047397.520019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047397.520063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047397.520095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047397.520117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047397.520143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047397.520173:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689433984 00000100:00100000:1.0:1784047397.520193:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689433984 00000100:00100000:1.0:1784047397.520244:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1784047397.520255:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689433984:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047397.520350:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689433984:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047397.520359:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1784047397.520395:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689434496 00000100:00100000:1.0:1784047397.520399:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689434496 00000100:00100000:1.0:1784047397.520433:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689434368 00000100:00100000:1.0:1784047397.520437:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689434368 00000100:00100000:1.0:1784047397.520458:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2504 00000100:00100000:1.0:1784047397.520464:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689434496:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047397.520493:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2400:x1870705689434496:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047397.520500:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2504 00000100:00100000:1.0:1784047397.520512:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2505 00000100:00100000:1.0:1784047397.520518:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689434368:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047397.520555:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a2569b5-a558-4441-a96a-1d77608df16b+5:2399:x1870705689434368:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047397.520562:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2505 00000100:00100000:1.0:1784047397.520749:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689434240 00000100:00100000:1.0:1784047397.520753:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689434240 00000100:00100000:1.0:1784047397.520782:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689434112 00000100:00100000:1.0:1784047397.520785:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689434112 00000100:00100000:1.0:1784047397.520808:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1228 00000100:00100000:1.0:1784047397.520814:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689434240:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047397.520850:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689434240:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 36us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047397.520858:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1228 00000100:00100000:1.0:1784047397.520871:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1229 00000100:00100000:1.0:1784047397.520877:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:2399:x1870705689434112:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047397.520902:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:2399:x1870705689434112:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047397.520909:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1229 00000100:00080000:2.0:1784047397.523497:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047397.523506:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047397.523510:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047397.523513:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1784047397.881550:0:89898:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 12:43:15 (1784047395) 00000100:00100000:1.0:1784047398.017105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047398.017370:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689434624 00000100:00100000:2.0:1784047398.017381:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689434624 00000100:00100000:2.0:1784047398.017446:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1224 00000100:00100000:2.0:1784047398.017457:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:69436:x1870705689434624:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047398.017492:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047398.017530:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c7749ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae23d expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017638:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017654:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017669:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017699:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017712:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017720:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017771:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017779:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017785:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017792:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017798:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047398.017808:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017816:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017830:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbc89ff300) 00010000:00010000:2.0:1784047398.017833:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047398.017838:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017845:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017857:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017863:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017869:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017874:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047398.017878:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017884:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017893:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccfebe4c00) 00010000:00010000:2.0:1784047398.017895:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047398.017903:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.017910:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.020858:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c7749ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae23d expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.020880:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbc89ff300) 00010000:00010000:2.0:1784047398.020884:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047398.020888:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c7749ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae23d expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.020902:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1800, rc 0) 00000100:00100000:2.0:1784047398.021052:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:69436:x1870705689434624:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 3595us (3953us total) trans 0 rc 301/301 00000100:00100000:2.0:1784047398.021061:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1224 00000100:00100000:1.0:1784047398.032857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047398.032984:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689434880 00000100:00100000:0.0:1784047398.032995:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689434880 00000100:00100000:0.0:1784047398.033062:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1225 00000100:00100000:0.0:1784047398.033074:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:69436:x1870705689434880:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047398.033100:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047398.033104:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784047398.033136:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774966 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae21a expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033156:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cbc89ff300) 00010000:00010000:0.0:1784047398.033166:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047398.033182:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c7749c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae244 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033302:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033337:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033349:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033364:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033371:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033377:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033855:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033866:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033872:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047398.033881:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1784047398.033905:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033911:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033917:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033931:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033937:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047398.033942:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033949:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033958:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc2b81d00) 00010000:00010000:0.0:1784047398.033961:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047398.033965:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033972:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c7749c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047398.033983:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f90bb1f reply state 0000000008df2c11 transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033994:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.033999:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccc2b81a00) 00010000:00010000:0.0:1784047398.034001:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047398.034005:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784047398.034030:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c7749c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 12 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.034047:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047398.034060:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:0.0:1784047398.034062:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047398.034064:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a600, rc 0) 00000100:00100000:0.0:1784047398.034145:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:69436:x1870705689434880:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1072us (1294us total) trans 111669149700 rc 0/0 00000100:00100000:0.0:1784047398.034152:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1225 00000100:00100000:3.0:1784047398.041863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047398.042222:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689435136 00000100:00100000:2.0:1784047398.042237:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689435136 00000100:00100000:2.0:1784047398.042324:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1226 00000100:00100000:2.0:1784047398.042336:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:69436:x1870705689435136:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047398.042363:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047398.042388:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae24b expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.042545:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.042576:0:66221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 13 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.042586:0:66221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.042647:0:66221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 13 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.042662:0:66221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 13 pid: 68026 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047398.042678:0:66221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66221:1870705709264256:192.168.204.40@tcp:104: 00000100:00100000:2.0:1784047398.044891:0:66221:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047398.054105:0:66221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66221:1870705709264256:192.168.204.40@tcp:104: 00010000:00010000:3.0:1784047398.054141:0:66221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047398.056032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047398.057332:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689435264 00000100:00100000:2.0:1784047398.057345:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689435264 00010000:00010000:2.0:1784047398.057392:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 14 pid: 68026 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047398.057430:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2540 00000100:00100000:2.0:1784047398.057441:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+14:2401:x1870705689435264:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784047398.057459:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047398.057467:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 14 pid: 68026 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057495:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 14 pid: 68026 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057534:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c7749d6 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae244 expref: 14 pid: 68026 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057551:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:2.0:1784047398.057557:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057566:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057575:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057628:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047398.057695:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+13:2401:x1870705689435264:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 256us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047398.057704:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2540 00010000:00010000:2.0:1784047398.057833:0:66221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.057841:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047398.057860:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:2.0:1784047398.058034:0:66221:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6a3:0x0], count =127 00000004:00080000:2.0:1784047398.058042:0:66221:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6a3:0x0]+127 in llog 00000004:00080000:2.0:1784047398.058084:0:66221:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00010000:00010000:2.0:1784047398.058197:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058217:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058224:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058231:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047398.058236:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058244:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058255:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:2.0:1784047398.058258:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047398.058264:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058270:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c7749eb lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058343:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae24b expref: 13 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058353:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4c00) 00010000:00010000:2.0:1784047398.058356:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047398.058359:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1c00/0x4426598c0c7749e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae24b expref: 13 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047398.058370:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1c00, rc 0) 00000100:00100000:2.0:1784047398.058417:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:69436:x1870705689435136:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 16084us (16564us total) trans 111669149701 rc 301/301 00000100:00100000:2.0:1784047398.058425:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1226 00000100:00100000:1.0:1784047398.063719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047398.068707:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689435520 00000100:00100000:2.0:1784047398.068728:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689435520 00000100:00100000:2.0:1784047398.068833:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 225 00000100:00100000:2.0:1784047398.068844:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+12:69436:x1870705689435520:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1784047398.069199:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+13:69436:x1870705689435520:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 355us (5493us total) trans 111669149702 rc 0/0 00000100:00100000:2.0:1784047398.069210:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 225 00000100:00100000:3.0:1784047398.072450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047398.077253:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689435776 00000100:00100000:0.0:1784047398.077282:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689435776 00000100:00100000:0.0:1784047398.077486:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 226 00000100:00100000:0.0:1784047398.077502:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+13:69436:x1870705689435776:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1784047398.078846:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+14:69436:x1870705689435776:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 1340us (6407us total) trans 111669149703 rc 0/0 00000100:00100000:0.0:1784047398.078861:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 226 00010000:00010000:1.0:1784047398.174781:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784047399.027322:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:1.0:1784047399.027416:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.027432:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.027456:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.027463:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047399.027468:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.027477:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.027546:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccc2b81a00) 00010000:00010000:1.0:1784047399.027550:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047399.027557:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.027565:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7749cf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047399.079408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047399.079926:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689435904 00000100:00100000:3.0:1784047399.079938:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689435904 00000100:00100000:3.0:1784047399.080013:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1227 00000100:00100000:3.0:1784047399.080023:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+9:69445:x1870705689435904:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047399.080047:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047399.080071:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c7749f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae252 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784047399.080095:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784047399.080133:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.080148:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.080163:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047399.080220:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047399.080230:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047399.080496:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.080532:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c7749f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae252 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.080548:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae252 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.080556:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842f00) 00010000:00010000:3.0:1784047399.080559:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047399.080562:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419200, rc 0) 00000100:00100000:3.0:1784047399.080672:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:69445:x1870705689435904:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 649us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047399.080680:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1227 00000100:00100000:1.0:1784047399.100250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047399.101202:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436032 00000100:00100000:0.0:1784047399.101215:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436032 00000100:00100000:0.0:1784047399.101284:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1228 00000100:00100000:0.0:1784047399.101306:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:69445:x1870705689436032:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047399.101349:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047399.101433:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:69445:x1870705689436032:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 140us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047399.101441:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1228 00000100:00100000:2.0:1784047399.111322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047399.115308:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436160 00000100:00100000:0.0:1784047399.115327:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436160 00000100:00100000:0.0:1784047399.115443:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1229 00000100:00100000:0.0:1784047399.115455:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:69445:x1870705689436160:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047399.115496:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047399.115773:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:69445:x1870705689436160:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 319us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047399.115782:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1229 00000100:00080000:2.0:1784047399.115927:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047399.122849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047399.123247:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436288 00000100:00100000:3.0:1784047399.123260:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436288 00000100:00080000:2.0:1784047399.123642:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047399.123649:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2050 00000100:00100000:3.0:1784047399.123663:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:69445:x1870705689436288:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1784047399.123693:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047399.123768:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:69445:x1870705689436288:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 108us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047399.123777:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2050 00000100:00100000:2.0:1784047399.138105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047399.142034:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436416 00000100:00100000:0.0:1784047399.142050:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436416 00000100:00080000:3.0:1784047399.142105:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047399.143391:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2051 00000100:00100000:0.0:1784047399.143409:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:69445:x1870705689436416:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047399.143450:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047399.143541:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+5:69445:x1870705689436416:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 138us (5448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047399.143550:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2051 00010000:00010000:3.0:1784047399.195222:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047399.208355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047399.208404:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436672 00000100:00100000:3.0:1784047399.208423:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436672 00000100:00100000:3.0:1784047399.208500:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1230 00000100:00100000:3.0:1784047399.208511:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:69452:x1870705689436672:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00010000:3.0:1784047399.208728:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047399.208756:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae252 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.208773:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842f00) 00010000:00010000:3.0:1784047399.208859:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047399.208927:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.208941:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.208951:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.208964:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.208971:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.208977:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210269:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210280:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210399:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210407:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210413:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047399.210418:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210426:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210439:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842b00) 00010000:00010000:3.0:1784047399.210442:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047399.210446:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210453:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047399.210469:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018232ba1 reply state 00000000326fc232 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210480:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.210486:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccec842c00) 00010000:00010000:3.0:1784047399.210488:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047399.210491:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047399.210585:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:69452:x1870705689436672:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 2073us (2240us total) trans 111669149704 rc 0/0 00000100:00100000:3.0:1784047399.210603:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1230 00000100:00100000:2.0:1784047399.248532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047399.248695:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436800 00000100:00100000:1.0:1784047399.248706:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436800 00000100:00100000:1.0:1784047399.248761:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1231 00000100:00100000:1.0:1784047399.248772:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+11:69455:x1870705689436800:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047399.248798:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047399.248821:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774a15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae259 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.248889:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774a1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.248920:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.248934:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047399.248983:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047399.248987:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047399.249008:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.249033:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774a15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae259 expref: 13 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.249049:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774a1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae259 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047399.249059:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd1a43d00) 00010000:00010000:1.0:1784047399.249062:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047399.249065:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29600, rc 0) 00000100:00100000:1.0:1784047399.249124:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+12:69455:x1870705689436800:12345-192.168.204.40@tcp:101:rm.0 Request processed in 352us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047399.249132:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1231 00000100:00100000:2.0:1784047399.252175:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047399.252454:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436928 00000100:00100000:3.0:1784047399.252464:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436928 00000100:00100000:3.0:1784047399.252557:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1232 00000100:00100000:3.0:1784047399.252568:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:69455:x1870705689436928:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:3.0:1784047399.252588:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047399.252624:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae260 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252695:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252708:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252720:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252731:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252737:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252744:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252814:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252831:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252837:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047399.252876:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:3.0:1784047399.252879:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047399.252898:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252909:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252918:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252924:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252930:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252937:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252943:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047399.252947:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252953:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252972:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd1a43d00) 00010000:00010000:3.0:1784047399.252975:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047399.252979:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.252990:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253002:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253008:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253014:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253018:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047399.253021:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253027:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253033:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccec842c00) 00010000:00010000:3.0:1784047399.253035:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047399.253037:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253042:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774a31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253072:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae260 expref: 14 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253085:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae260 expref: 13 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.253091:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99ccec842b00) 00010000:00010000:3.0:1784047399.253093:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047399.253095:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418000, rc 0) 00000100:00100000:3.0:1784047399.253163:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+13:69455:x1870705689436928:12345-192.168.204.40@tcp:101:rm.0 Request processed in 597us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047399.253172:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1232 00000100:00100000:1.0:1784047399.260017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047399.260382:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437184 00000100:00100000:2.0:1784047399.260395:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437184 00000100:00100000:2.0:1784047399.260462:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1233 00000100:00100000:2.0:1784047399.260474:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+13:69455:x1870705689437184:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:2.0:1784047399.260534:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784047399.260564:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774a38 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae260 expref: 13 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260595:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99ccec842b00) 00010000:00010000:2.0:1784047399.260633:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774a1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae259 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260642:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd1a43d00) 00010000:00010000:2.0:1784047399.260648:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047399.260672:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260684:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260694:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260705:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260713:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260719:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260805:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260814:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.260831:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261018:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261027:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261035:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261042:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261049:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261055:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261075:0:66219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047399.261096:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261101:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261108:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261114:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047399.261123:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261131:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261140:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:2.0:1784047399.261143:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784047399.261146:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261152:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a4d lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261171:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261177:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261182:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261188:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261193:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047399.261196:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261202:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261221:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4c00) 00010000:00010000:2.0:1784047399.261223:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047399.261226:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261232:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047399.261244:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a3a6928 reply state 0000000051cc1479 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261255:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047399.261261:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccec842c00) 00010000:00010000:2.0:1784047399.261263:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047399.261266:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784047399.261347:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047399.261356:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.261363:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047399.261367:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.261373:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.261384:0:16468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:3.0:1784047399.261387:0:16468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784047399.261390:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.261395:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0200/0x4426598c0c774a54 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047399.261418:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047399.261420:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047399.261422:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047399.261453:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+13:69455:x1870705689437184:12345-192.168.204.40@tcp:36:rm.0 Request processed in 979us (1444us total) trans 111669149705 rc 0/0 00000100:00100000:2.0:1784047399.261462:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1233 00010000:00010000:0.0:1784047400.216270:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047400.216531:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047400.216562:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709264384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047400.216673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.218305:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047400.218329:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709264512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047400.218392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.218447:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264384 00000100:00100000:1.0:1784047400.218466:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264384 00000100:00100000:1.0:1784047400.218541:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264512 00000100:00100000:1.0:1784047400.218545:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264512 00000100:00100000:1.0:1784047400.218570:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1784047400.218581:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709264384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047400.218629:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047400.218651:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1784047400.218660:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709264512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047400.218673:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047400.218681:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709264384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047400.218688:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1784047400.218710:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709264512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047400.218715:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00080000:3.0:1784047400.218731:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047400.218735:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047400.218746:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709264384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047400.218783:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709264512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047400.724381:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709264768:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.724509:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709264640:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.724539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.724560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047400.724590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709265280:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.724631:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709265152:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.724919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.724919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725104:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709265664:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725182:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709264896:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725301:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709265408:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725385:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709265920:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725449:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784047400.725455:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709265024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709265536:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047400.725544:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709266048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047400.725564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047400.725590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709265792:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725636:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264768 00000100:00100000:1.0:1784047400.725646:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264768 00000100:00100000:3.0:1784047400.725651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047400.725689:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265664 00000100:00100000:2.0:1784047400.725695:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265664 00000100:00100000:1.0:1784047400.725712:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265152 00000100:00100000:1.0:1784047400.725717:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265152 00000100:00100000:2.0:1784047400.725740:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265792 00000100:00100000:2.0:1784047400.725745:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265792 00000100:00100000:3.0:1784047400.725750:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264896 00000100:00100000:3.0:1784047400.725757:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264896 00000100:00100000:2.0:1784047400.725776:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:3.0:1784047400.725785:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265408 00000100:00100000:3.0:1784047400.725790:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265408 00000100:00100000:2.0:1784047400.725790:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709265664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.725807:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265920 00000100:00100000:3.0:1784047400.725812:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265024 00000100:00100000:1.0:1784047400.725813:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265920 00000100:00100000:3.0:1784047400.725819:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265024 00000100:00100000:1.0:1784047400.725840:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1784047400.725851:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709264768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.725862:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1784047400.725868:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709265664:12345-0@lo:400:kworker.0 Request processed in 81us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047400.725876:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709264896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047400.725880:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00010000:00000080:1.0:1784047400.725885:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c20380 x1870705709264768/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:531/0 lens 224/224 e 0 to 0 dl 1784047411 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047400.725913:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:2.0:1784047400.725923:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709265792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.725933:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709264896:12345-0@lo:400:kworker.0 Request processed in 60us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047400.725943:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1784047400.725967:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709265792:12345-0@lo:400:kworker.0 Request processed in 45us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047400.725968:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1784047400.725982:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:3.0:1784047400.725983:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709265152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.726002:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709264768:12345-0@lo:400:kworker.0 Request processed in 90us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047400.726012:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1784047400.726020:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709265152:12345-0@lo:400:kworker.0 Request processed in 42us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047400.726088:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709264640 00000100:00100000:0.0:1784047400.726095:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709264640 00000100:00100000:0.0:1784047400.726133:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784047400.726142:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709264640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047400.726181:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709264640:12345-0@lo:400:kworker.0 Request processed in 41us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047400.726188:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784047400.726220:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265280 00000100:00100000:0.0:1784047400.726224:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265280 00000100:00100000:0.0:1784047400.726248:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709265536 00000100:00100000:0.0:1784047400.726250:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709265536 00000100:00100000:1.0:1784047400.726282:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1784047400.726290:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709265408:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047400.726302:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbcaa14380 x1870705709265408/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:531/0 lens 224/224 e 0 to 0 dl 1784047411 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047400.726320:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266048 00000100:00100000:0.0:1784047400.726332:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266048 00000100:00100000:0.0:1784047400.726352:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1784047400.726360:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709265280:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047400.726376:0:83733:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c23480 x1870705709265280/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:531/0 lens 224/224 e 0 to 0 dl 1784047411 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047400.726399:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709265408:12345-0@lo:400:kworker.0 Request processed in 108us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047400.726407:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1784047400.726417:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709265280:12345-0@lo:400:kworker.0 Request processed in 57us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047400.726424:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1784047400.726427:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:1.0:1784047400.726441:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709265920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047400.726447:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00010000:00000080:1.0:1784047400.726459:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbcaa16d80 x1870705709265920/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:531/0 lens 224/224 e 0 to 0 dl 1784047411 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047400.726460:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.726500:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709265920:12345-0@lo:400:kworker.0 Request processed in 61us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047400.726507:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1784047400.726513:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709265536:12345-0@lo:400:kworker.0 Request processed in 54us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047400.726521:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1784047400.726527:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1784047400.726537:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709265024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047400.726542:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00010000:00000080:1.0:1784047400.726551:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc79f1c00 x1870705709265024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:531/0 lens 224/224 e 0 to 0 dl 1784047411 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047400.726554:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709266048:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047400.726592:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709265024:12345-0@lo:400:kworker.0 Request processed in 57us (1103us total) trans 0 rc 0/0 00000004:00000024:0.0:1784047400.726594:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047400.726603:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1784047400.726670:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709266048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047400.726678:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1784047400.726687:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709264640:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.726705:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709265152:0@lo:400:kworker.0 00000100:00100000:1.0:1784047400.726717:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709265664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.726800:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00080000:3.0:1784047400.726838:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047400.726846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047400.726848:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047400.726850:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047400.726895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709264768:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.726910:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709265280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.726922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709265792:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.727007:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709265024:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.727018:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709265536:0@lo:400:kworker.0 00000100:00100000:3.0:1784047400.729924:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709266048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047400.731898:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709264896:0@lo:400:kworker.0 00000100:00100000:2.0:1784047400.731922:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709265408:0@lo:400:kworker.0 00000100:00100000:2.0:1784047400.731938:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709265920:0@lo:400:kworker.0 00000100:00100000:0.0:1784047401.238979:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047401.239027:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709266176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047401.239127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047401.239175:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047401.239346:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047401.239357:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709266304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047401.239394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047401.239433:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266176 00000100:00100000:1.0:1784047401.239443:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266176 00000100:00100000:1.0:1784047401.239511:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266304 00000100:00100000:1.0:1784047401.239514:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266304 00000100:00100000:1.0:1784047401.239539:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:1.0:1784047401.239550:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709266176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047401.239600:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047401.239671:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709266176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047401.239679:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:1.0:1784047401.239700:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1784047401.239707:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709266304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047401.239725:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047401.239758:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709266304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047401.239765:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1784047401.239825:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709266304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047401.240505:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709266176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047401.243524:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709266432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047401.243641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047401.244178:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266432 00000100:00100000:2.0:1784047401.244189:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266432 00000100:00100000:2.0:1784047401.244247:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1784047401.244267:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709266432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047401.244517:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00010000:00000080:2.0:1784047401.244545:0:83733:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc482d880 x1870705709266432/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:532/0 lens 224/368 e 0 to 0 dl 1784047412 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047401.244681:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709266432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 416us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047401.244689:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:1.0:1784047401.246157:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709266432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784047402.288671:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047402.631639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047402.631708:0:89031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437312 00000100:00100000:0.0:1784047402.631726:0:89031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437312 00000100:00100000:0.0:1784047402.631839:0:89031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1784047402.631851:0:89031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689437312:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047402.631923:0:89031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689437312:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047402.631930:0:89031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:1.0:1784047402.636629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047402.636754:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437440 00000100:00100000:1.0:1784047402.636764:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437440 00000100:00100000:1.0:1784047402.636844:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1236 00000100:00100000:1.0:1784047402.636855:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+13:2402:x1870705689437440:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:1.0:1784047402.636888:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc482c380 x1870705689437440/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:533/0 lens 224/224 e 0 to 0 dl 1784047413 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047402.637305:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+13:2402:x1870705689437440:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 450us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047402.637328:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1236 00000100:00080000:1.0:1784047402.637356:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047402.643637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047402.648278:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437568 00000100:00100000:1.0:1784047402.648295:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437568 00000100:00100000:1.0:1784047402.648391:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1237 00000100:00100000:1.0:1784047402.648404:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689437568:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047402.648498:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689437568:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 97us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047402.648507:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1237 00000100:00080000:0.0:1784047402.651930:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047402.655693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047402.655739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047402.655787:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437696 00000100:00100000:1.0:1784047402.655788:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437824 00000100:00100000:2.0:1784047402.655804:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437696 00000100:00100000:2.0:1784047402.655941:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2508 00000100:00100000:2.0:1784047402.655956:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689437696:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047402.656066:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+5:2402:x1870705689437696:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 114us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047402.656088:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2508 00000100:00080000:2.0:1784047402.656119:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047402.658167:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437824 00000100:00100000:1.0:1784047402.658265:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2509 00000100:00100000:1.0:1784047402.658278:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689437824:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047402.658362:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+5:2401:x1870705689437824:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 87us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047402.658371:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2509 00000100:00080000:2.0:1784047402.658446:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784047403.283293:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047404.309318:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047405.330904:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047405.330928:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709266560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047405.331000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.331051:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266560 00000100:00100000:1.0:1784047405.331059:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266560 00000100:00100000:1.0:1784047405.331115:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1784047405.331141:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709266560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047405.331196:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047405.331242:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709266560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.331250:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1784047405.331298:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709266560:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784047405.331446:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047405.334096:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1784047405.334210:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047405.334469:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709266688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047405.334535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047405.334794:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266688 00000100:00100000:0.0:1784047405.334802:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266688 00000100:00100000:0.0:1784047405.334908:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1784047405.334918:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709266688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047405.334945:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047405.334991:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709266688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047405.334999:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00080000:2.0:1784047405.335042:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047405.335077:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709266688:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1784047405.337568:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149705 is committed 00010000:00010000:1.0:1784047405.338473:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338487:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338494:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338501:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047405.338505:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338514:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338531:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccec842c00) 00010000:00010000:1.0:1784047405.338533:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047405.338538:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338543:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419600/0x4426598c0c774a0e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338560:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338578:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338584:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338588:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047405.338591:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338596:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338627:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccec842c00) 00010000:00010000:1.0:1784047405.338631:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047405.338634:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047405.338640:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a46 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047405.842915:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047405.842939:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709266816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047405.843017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047405.843095:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266816 00000100:00100000:3.0:1784047405.843102:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266816 00000100:00100000:3.0:1784047405.843148:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1784047405.843157:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709266816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047405.843206:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047405.843983:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709266944:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.844023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.844050:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709267456:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.844071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.844098:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709267968:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.844114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.844130:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784047405.844142:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709267072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.844161:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.844187:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709267584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.845548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.845592:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709268096:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.846399:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709266816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3237us (3376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047405.846412:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1784047405.846447:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267584 00000100:00100000:3.0:1784047405.846455:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267584 00000100:00100000:3.0:1784047405.846505:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1784047405.846515:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709267584:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047405.846541:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce495a680 x1870705709267584/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:536/0 lens 224/224 e 0 to 0 dl 1784047416 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047405.846573:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709267584:12345-0@lo:400:kworker.0 Request processed in 60us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047405.846580:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1784047405.846644:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267456 00000100:00100000:3.0:1784047405.846649:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267456 00000100:00100000:1.0:1784047405.847316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.847372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709267584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.847417:0:89032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709266944 00000100:00100000:1.0:1784047405.847421:0:89032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709266944 00000100:00100000:1.0:1784047405.847460:0:89032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784047405.847469:0:89032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709266944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.847514:0:89032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709266944:12345-0@lo:400:kworker.0 Request processed in 46us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.847521:0:89032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784047405.847551:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267968 00000100:00100000:1.0:1784047405.847556:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267968 00000100:00100000:1.0:1784047405.847580:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267072 00000100:00100000:1.0:1784047405.847584:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267072 00000100:00100000:1.0:1784047405.847623:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1784047405.847630:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709267968:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047405.847643:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9ede300 x1870705709267968/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:536/0 lens 224/224 e 0 to 0 dl 1784047416 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047405.848282:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1784047405.848292:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709267072:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047405.848307:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9edc380 x1870705709267072/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:536/0 lens 224/224 e 0 to 0 dl 1784047416 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047405.848349:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709267072:12345-0@lo:400:kworker.0 Request processed in 59us (4186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047405.848355:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1784047405.848381:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1784047405.848402:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709267456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.848435:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709267456:12345-0@lo:400:kworker.0 Request processed in 34us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047405.848441:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1784047405.848481:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709267200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.848512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047405.848546:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709267712:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.848571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047405.848594:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709268224:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.848648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047405.848809:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709267968:12345-0@lo:400:kworker.0 Request processed in 1179us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.848817:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1784047405.848831:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267200 00000100:00100000:1.0:1784047405.848842:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267200 00000100:00100000:1.0:1784047405.848865:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1784047405.848872:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709267200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.848904:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709267200:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.848910:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1784047405.849908:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268096 00000100:00100000:1.0:1784047405.849916:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268096 00000100:00100000:1.0:1784047405.849960:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267712 00000100:00100000:1.0:1784047405.849963:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267712 00000100:00100000:1.0:1784047405.849980:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268224 00000100:00100000:1.0:1784047405.849982:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268224 00000100:00100000:1.0:1784047405.850003:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:1.0:1784047405.850010:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709268096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.850063:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709268096:12345-0@lo:400:kworker.0 Request processed in 54us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.850070:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:1.0:1784047405.850084:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:1.0:1784047405.850090:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709267712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.850117:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709267712:12345-0@lo:400:kworker.0 Request processed in 27us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.850121:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00100000:1.0:1784047405.850131:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:1.0:1784047405.850138:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709268224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.850175:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709268224:12345-0@lo:400:kworker.0 Request processed in 26us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.850181:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:3.0:1784047405.850497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709268224:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.850519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709266816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047405.850550:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709267200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.850559:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709267712:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.850571:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784047405.850579:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709267328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.850634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047405.850658:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709267840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.851326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047405.851355:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709268352:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.851463:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267328 00000100:00100000:1.0:1784047405.851469:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267328 00000100:00100000:1.0:1784047405.851506:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1784047405.851513:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709267328:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047405.851531:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf2eab800 x1870705709267328/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:536/0 lens 224/224 e 0 to 0 dl 1784047416 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047405.851562:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709267328:12345-0@lo:400:kworker.0 Request processed in 50us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.851569:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:1.0:1784047405.851586:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047405.851590:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047405.851593:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047405.851595:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047405.851638:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709267840 00000100:00100000:1.0:1784047405.851642:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709267840 00000100:00100000:3.0:1784047405.851809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047405.851847:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709267328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.851896:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268352 00000100:00100000:3.0:1784047405.851899:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268352 00000100:00100000:1.0:1784047405.851941:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:1.0:1784047405.851949:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709267840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047405.854041:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1784047405.854065:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709268352:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047405.854094:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce7ed6680 x1870705709268352/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:536/0 lens 224/224 e 0 to 0 dl 1784047416 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047405.854828:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709267840:12345-0@lo:400:kworker.0 Request processed in 2875us (3497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047405.854839:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:3.0:1784047405.855339:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709268352:12345-0@lo:400:kworker.0 Request processed in 1284us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047405.855347:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1784047405.855898:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709267840:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.855914:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709268352:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.855952:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709267072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.855963:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709268096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.855973:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709266944:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.856001:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709267456:0@lo:400:kworker.0 00000100:00100000:1.0:1784047405.856011:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709267968:0@lo:400:kworker.0 00000100:00100000:0.0:1784047406.355694:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047406.355719:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709268480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047406.355802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047406.355845:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047406.355862:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268480 00000100:00100000:0.0:1784047406.355871:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268480 00000100:00100000:0.0:1784047406.355933:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1784047406.355943:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709268480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047406.355971:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047406.356015:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709268480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047406.356033:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1784047406.356094:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709268480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047406.356461:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce411ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709268608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047406.356495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047406.356526:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268608 00000100:00100000:1.0:1784047406.356530:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268608 00000100:00100000:1.0:1784047406.356558:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1784047406.356565:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709268608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047406.356578:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047406.356630:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709268608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047406.356637:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1784047406.356670:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce411ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709268608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047406.356817:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047406.356826:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709268736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047406.356863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047406.356893:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268736 00000100:00100000:3.0:1784047406.356897:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268736 00000100:00100000:3.0:1784047406.356926:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1784047406.356932:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709268736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047406.356958:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1298751488 00010000:00000080:3.0:1784047406.356973:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00fc0e00 x1870705709268736/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:537/0 lens 224/368 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047406.357007:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709268736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047406.357013:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1784047406.357050:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709268736:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1784047406.505265:0:90294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784047406.561377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047406.563651:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437952 00000100:00100000:1.0:1784047406.563666:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437952 00000100:00100000:1.0:1784047406.563746:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1234 00000100:00100000:1.0:1784047406.563757:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+9:69522:x1870705689437952:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047406.563780:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047406.563803:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c774a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae267 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.563871:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28800/0x4426598c0c774a62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.563897:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28800/0x4426598c0c774a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.563909:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28800/0x4426598c0c774a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047406.563957:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047406.563961:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047406.563980:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28800/0x4426598c0c774a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.564002:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c774a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae267 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.564020:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28800/0x4426598c0c774a62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae267 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.564030:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce7ec2f00) 00010000:00010000:1.0:1784047406.564033:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047406.564036:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28800, rc 0) 00010000:00000080:1.0:1784047406.564043:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00fc3480 x1870705689437952/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 576/688 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047406.564112:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:69522:x1870705689437952:12345-192.168.204.40@tcp:101:dd.0 Request processed in 356us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047406.564119:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1234 00000100:00080000:1.0:1784047406.564142:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047406.571276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047406.571389:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438208 00000100:00100000:2.0:1784047406.571399:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438208 00000100:00100000:2.0:1784047406.571464:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1235 00000100:00100000:2.0:1784047406.571474:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:69522:x1870705689438208:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047406.571496:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047406.571499:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784047406.571532:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28800/0x4426598c0c774a62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae267 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571554:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce7ec2f00) 00010000:00010000:2.0:1784047406.571567:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047406.571584:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a69 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae26e expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571842:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571874:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571884:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571899:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571905:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571911:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571975:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c774a7e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571983:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c774a7e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.571989:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c774a7e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047406.571999:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1784047406.572177:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572186:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572192:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572207:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572214:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.572219:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572226:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572235:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4600) 00010000:00010000:2.0:1784047406.572238:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.572242:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572249:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572261:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572268:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572273:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572279:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.572282:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572300:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572308:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccfebe4200) 00010000:00010000:2.0:1784047406.572310:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.572313:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572318:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774a77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572427:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1800/0x4426598c0c774a69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae26e expref: 12 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572446:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c774a7e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae26e expref: 11 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.572453:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:2.0:1784047406.572455:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047406.572457:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0800, rc 0) 00010000:00000080:2.0:1784047406.572466:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef50bb80 x1870705689438208/t111669149706(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 776/848 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047406.572596:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:69522:x1870705689438208:12345-192.168.204.40@tcp:101:dd.0 Request processed in 1123us (1333us total) trans 111669149706 rc 0/0 00000100:00100000:2.0:1784047406.572625:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1235 00000100:00100000:3.0:1784047406.580039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047406.588461:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438336 00000100:00100000:0.0:1784047406.588480:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438336 00000100:00100000:1.0:1784047406.588808:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1236 00000100:00100000:1.0:1784047406.588819:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+11:69522:x1870705689438336:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047406.588856:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047406.588880:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c774a8c lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae275 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.588917:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774a93 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.588931:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774a93 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.588942:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774a93 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.589053:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c774a8c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae275 expref: 13 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.589071:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774a93 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae275 expref: 12 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.589080:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:1.0:1784047406.589083:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784047406.589087:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29000, rc 0) 00010000:00000080:1.0:1784047406.589094:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00fc0380 x1870705689438336/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 568/1344 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047406.589172:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+12:69522:x1870705689438336:12345-192.168.204.40@tcp:101:dd.0 Request processed in 354us (9143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047406.589179:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1236 00000100:00100000:3.0:1784047406.594495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047406.594677:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438592 00000100:00100000:1.0:1784047406.594693:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438592 00000100:00100000:1.0:1784047406.594752:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1237 00000100:00100000:1.0:1784047406.594763:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+12:69522:x1870705689438592:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1784047406.594825:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047406.594855:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0800/0x4426598c0c774a7e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae26e expref: 12 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.594879:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:1.0:1784047406.594885:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047406.595084:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.595099:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.595108:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047406.595168:0:66221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:1.0:1784047406.595193:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8500a7e reply state 000000006e946073 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.595204:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.595210:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:1.0:1784047406.595212:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047406.595215:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1784047406.595251:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00fc0700 x1870705689438592/t111669149708(0) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 488/456 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047406.595471:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+14:69522:x1870705689438592:12345-192.168.204.40@tcp:36:dd.0 Request processed in 709us (985us total) trans 111669149708 rc 0/0 00000100:00100000:1.0:1784047406.595480:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1237 00000020:00080000:1.0:1784047406.595486:0:66221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047406.597854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.597944:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438720 00000100:00100000:3.0:1784047406.597955:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438720 00000100:00100000:3.0:1784047406.598020:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1238 00000100:00100000:3.0:1784047406.598032:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+14:69522:x1870705689438720:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047406.598060:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047406.598084:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774aa1 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae27c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.598159:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774aa1 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae27c expref: 15 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.598178:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774aa1 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae27c expref: 15 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.598202:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:3.0:1784047406.598205:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047406.598209:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418800, rc 0) 00010000:00000080:3.0:1784047406.598218:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef506680 x1870705689438720/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 376/584 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047406.598523:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+15:69522:x1870705689438720:12345-192.168.204.40@tcp:101:dd.0 Request processed in 492us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047406.598531:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1238 00000100:00100000:1.0:1784047406.615722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.617898:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438976 00000100:00100000:3.0:1784047406.617916:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438976 00000100:00100000:3.0:1784047406.618030:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1239 00000100:00100000:3.0:1784047406.618043:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+15:69522:x1870705689438976:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047406.618077:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047406.618080:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784047406.618111:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774aa1 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae27c expref: 15 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618130:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:3.0:1784047406.618136:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047406.618457:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774aa8 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae283 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618532:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774aaf lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618548:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774aaf lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618558:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774aaf lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047406.618706:0:67153:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x4b1:0x0], count =625 00000004:00080000:3.0:1784047406.618713:0:67153:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x4b1:0x0]+625 in llog 00000004:00080000:3.0:1784047406.618741:0:67153:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x722:0x0], index 0: 0 00000004:00080000:3.0:1784047406.618748:0:67153:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x723:0x0], index 1: 0 00010000:00010000:3.0:1784047406.618848:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774aaf lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 17 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618856:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:3.0:1784047406.618859:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784047406.618870:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419800/0x4426598c0c774aa8 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 17 pid: 67153 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618895:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774aaf lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 16 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.618926:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:3.0:1784047406.618929:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784047406.618932:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419200, rc 0) 00010000:00000080:3.0:1784047406.618940:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce411ad80 x1870705689438976/t111669149709(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 376/608 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047406.619011:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce411ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+16:69522:x1870705689438976:12345-192.168.204.40@tcp:101:dd.0 Request processed in 971us (3299us total) trans 111669149709 rc 0/0 00000100:00100000:3.0:1784047406.619019:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1239 00000100:00100000:0.0:1784047406.624909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.627640:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689439104 00000100:00100000:3.0:1784047406.627656:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689439104 00000100:00100000:3.0:1784047406.627743:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4968 00000100:00100000:3.0:1784047406.627755:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a2569b5-a558-4441-a96a-1d77608df16b+5:69522:x1870705689439104:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047406.627774:0:26190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047406.627797:0:26190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c774ab6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae28a expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047406.627825:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047406.627849:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=3504s v=(0 0) 00010000:00010000:3.0:1784047406.627854:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047406.627863:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c774ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae28a expref: 6 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.627896:0:26190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c774ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae28a expref: 6 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.627910:0:26190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419c00, rc 0) 00000100:00100000:3.0:1784047406.627974:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a2569b5-a558-4441-a96a-1d77608df16b+6:69522:x1870705689439104:12345-192.168.204.40@tcp:101:dd.0 Request processed in 222us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047406.627981:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4968 00000100:00080000:0.0:1784047406.628191:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047406.637537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047406.637586:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689439232 00000100:00100000:0.0:1784047406.637595:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689439232 00000100:00100000:0.0:1784047406.637671:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4969 00000100:00100000:0.0:1784047406.637683:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+5:69522:x1870705689439232:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047406.637702:0:26181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047406.637727:0:26181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c774abd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae291 expref: -99 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047406.637756:0:26181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047406.637782:0:26181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=3504s v=(0 0) 00010000:00010000:0.0:1784047406.637787:0:26181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047406.637797:0:26181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c774abd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae291 expref: 6 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047406.637815:0:26181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c774abd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae291 expref: 6 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047406.637844:0:26181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b200, rc 0) 00000100:00100000:0.0:1784047406.637907:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+6:69522:x1870705689439232:12345-192.168.204.40@tcp:101:dd.0 Request processed in 226us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047406.637914:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4969 00000100:00080000:0.0:1784047406.637941:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047406.643899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.647457:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689439360 00000100:00100000:3.0:1784047406.647473:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689439360 00000100:00100000:3.0:1784047406.647720:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4970 00000100:00100000:3.0:1784047406.647733:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:69522:x1870705689439360:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047406.647753:0:13594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047406.647777:0:13594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baf73ba4/0x4426598c0c774ac4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae298 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047406.647807:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047406.647834:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=3504s v=(0 0) 00010000:00010000:3.0:1784047406.647839:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047406.647847:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baf73ba4/0x4426598c0c774ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae298 expref: 7 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.647867:0:13594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baf73ba4/0x4426598c0c774ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae298 expref: 7 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.647897:0:13594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419800, rc 0) 00000100:00100000:3.0:1784047406.648001:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:69522:x1870705689439360:12345-192.168.204.40@tcp:101:dd.0 Request processed in 270us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047406.648009:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4970 00000100:00100000:0.0:1784047406.660979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047406.661010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.661088:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689439488 00000100:00100000:3.0:1784047406.661098:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689439488 00002000:00010000:3.0:1784047406.661136:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1826 (1048576->18446744073709551615) 00002000:00100000:3.0:1784047406.661141:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef506300 with x1870705689439488 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1784047406.661164:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef506300. 00000100:00100000:3.0:1784047406.661193:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689439616 00000100:00100000:3.0:1784047406.661197:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689439616 00002000:00010000:3.0:1784047406.661210:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1827 (0->18446744073709551615) 00002000:00100000:3.0:1784047406.661213:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef504380 with x1870705689439616 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047406.661219:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccef504380. 00000100:00100000:3.0:1784047406.661240:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 598 00000100:00100000:3.0:1784047406.661250:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689439488:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:3.0:1784047406.661494:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1784047406.661498:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb mtime from disk: 0 -> 1784047405 00002000:00010000:3.0:1784047406.661500:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784047406.661503:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb ctime from disk: 0 -> 1784047405 00002000:00010000:3.0:1784047406.661505:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1784047406.661575:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689439488:12345-192.168.204.40@tcp:10:dd.0 Request processed in 326us (605us total) trans 4294968752 rc 0/0 00000100:00100000:3.0:1784047406.661583:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 598 00002000:00010000:3.0:1784047406.661597:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1826 (1048576->18446744073709551615) 00002000:00100000:3.0:1784047406.661600:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef506300 with x1870705689439488 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1784047406.661627:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef506300. 00000100:00100000:3.0:1784047406.661647:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 599 00000100:00100000:3.0:1784047406.661654:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689439616:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:3.0:1784047406.661750:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x723:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784047406.661753:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x723:0x0] updating lvb mtime from disk: 0 -> 1784047405 00002000:00010000:3.0:1784047406.661755:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x723:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784047406.661757:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x723:0x0] updating lvb ctime from disk: 0 -> 1784047405 00002000:00010000:3.0:1784047406.661759:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x723:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1784047406.661780:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:2401:x1870705689439616:12345-192.168.204.40@tcp:10:dd.0 Request processed in 126us (769us total) trans 4294968752 rc 0/0 00000100:00100000:3.0:1784047406.661787:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 599 00002000:00010000:3.0:1784047406.661790:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1827 (0->18446744073709551615) 00002000:00100000:3.0:1784047406.661793:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef504380 with x1870705689439616 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047406.661797:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccef504380. 00000100:00100000:1.0:1784047406.736580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047406.737736:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689439872 00000100:00100000:0.0:1784047406.737757:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689439872 00000100:00100000:1.0:1784047406.738061:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 227 00000100:00100000:1.0:1784047406.738075:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+16:69522:x1870705689439872:12345-192.168.204.40@tcp:35:dd.0 00010000:00000080:1.0:1784047406.738523:0:66223:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a26d80 x1870705689439872/t111669149710(0) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 392/456 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047406.738657:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a2569b5-a558-4441-a96a-1d77608df16b+17:69522:x1870705689439872:12345-192.168.204.40@tcp:35:dd.0 Request processed in 585us (2093us total) trans 111669149710 rc 0/0 00000100:00100000:1.0:1784047406.738667:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 227 00000100:00100000:1.0:1784047406.762754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.765321:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689440000 00000100:00100000:3.0:1784047406.765338:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689440000 00000100:00100000:3.0:1784047406.765471:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1240 00000100:00100000:3.0:1784047406.765486:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+17:69523:x1870705689440000:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047406.765522:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047406.765553:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae29f expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.765658:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774ad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.765698:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.765715:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047406.765786:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047406.765791:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047406.765817:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.765847:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae29f expref: 19 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.765869:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae29f expref: 18 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.765879:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842600) 00010000:00010000:3.0:1784047406.765883:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047406.765888:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419e00, rc 0) 00010000:00000080:3.0:1784047406.765899:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9edca80 x1870705689440000/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 576/688 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047406.766008:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+18:69523:x1870705689440000:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 526us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047406.766017:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1240 00000100:00100000:0.0:1784047406.770486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047406.770580:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689440256 00000100:00100000:1.0:1784047406.770594:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689440256 00000100:00100000:1.0:1784047406.770715:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1241 00000100:00100000:1.0:1784047406.770729:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+18:69523:x1870705689440256:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047406.770760:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047406.770791:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774ad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2a6 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.770907:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.770946:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.770962:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.770981:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.770988:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.770995:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771117:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771125:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771133:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771141:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771158:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047406.771163:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771172:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771195:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842600) 00010000:00010000:1.0:1784047406.771198:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047406.771204:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771210:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774ae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771229:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771237:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771243:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771249:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047406.771251:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771257:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771263:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99cce7ec2700) 00010000:00010000:1.0:1784047406.771265:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047406.771268:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771274:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774ae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771336:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774ad9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2a6 expref: 19 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771348:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842600) 00010000:00010000:1.0:1784047406.771351:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784047406.771354:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774ad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2a6 expref: 19 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.771364:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28400, rc 0) 00010000:00000080:1.0:1784047406.771375:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef507800 x1870705689440256/t0(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 800/608 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047406.771473:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+18:69523:x1870705689440256:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 746us (1001us total) trans 0 rc 301/301 00000100:00100000:1.0:1784047406.771482:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1241 00000100:00100000:0.0:1784047406.775311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.775419:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689440384 00000100:00100000:3.0:1784047406.775434:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689440384 00000100:00100000:3.0:1784047406.775510:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1242 00000100:00100000:3.0:1784047406.775541:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+18:69523:x1870705689440384:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:2.0:1784047406.775920:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.775955:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.775971:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.775992:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776001:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776008:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776122:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776133:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776140:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047406.776207:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1784047406.776213:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047406.776233:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776251:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776275:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776282:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776289:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776296:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.776301:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776309:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776324:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842600) 00010000:00010000:2.0:1784047406.776327:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.776332:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776339:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0a00/0x4426598c0c774aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776357:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776364:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776369:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776381:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.776385:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776391:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776400:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccfebe4600) 00010000:00010000:2.0:1784047406.776403:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.776405:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776412:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a1a00/0x4426598c0c774af5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776426:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776432:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776438:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776443:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.776446:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776453:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776471:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:2.0:1784047406.776474:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.776477:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.776483:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec3a0400/0x4426598c0c774afc lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1784047406.776510:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef507480 x1870705689440384/t0(0) o34->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 472/728 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047406.776790:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+18:69523:x1870705689440384:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 1251us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047406.776802:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1242 00000100:00100000:2.0:1784047406.821276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.821422:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689440640 00000100:00100000:3.0:1784047406.821436:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689440640 00000100:00100000:3.0:1784047406.821553:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1243 00000100:00100000:3.0:1784047406.821567:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+18:69525:x1870705689440640:12345-192.168.204.40@tcp:101:md5sum.0 00010000:00010000:3.0:1784047406.821596:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047406.821666:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2ad expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.821782:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.821803:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.821818:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.821836:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.821844:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.821850:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822024:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c774b18 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822036:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c774b18 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822064:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c774b18 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047406.822077:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:3.0:1784047406.822202:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822212:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822219:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822229:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822237:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047406.822243:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822251:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822266:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842600) 00010000:00010000:3.0:1784047406.822269:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047406.822274:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822281:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418e00/0x4426598c0c774b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822299:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822314:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822321:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822325:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047406.822328:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822335:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822345:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccec842400) 00010000:00010000:3.0:1784047406.822347:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047406.822350:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822357:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419400/0x4426598c0c774b11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822434:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418800/0x4426598c0c774b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2ad expref: 21 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822450:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c774b18 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2ad expref: 20 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047406.822458:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:3.0:1784047406.822461:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047406.822470:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418c00, rc 0) 00010000:00000080:3.0:1784047406.822481:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccff10c700 x1870705689440640/t111669149711(0) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 800/872 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047406.822561:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+20:69525:x1870705689440640:12345-192.168.204.40@tcp:101:md5sum.0 Request processed in 997us (1306us total) trans 111669149711 rc 0/0 00000100:00100000:3.0:1784047406.822570:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1243 00000100:00100000:0.0:1784047406.831240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047406.831344:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689440768 00000100:00100000:1.0:1784047406.831367:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689440768 00002000:00100000:1.0:1784047406.831436:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x722:0x0] (0->32767) req@ffff99ccef506a00 x1870705689440768/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 488/0 e 0 to 0 dl 1784047417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047406.831449:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef506a00 with x1870705689440768 ext(0->32767) 00002000:00010000:1.0:1784047406.831456:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccef506a00 00000100:00100000:1.0:1784047406.831499:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 600 00000100:00100000:1.0:1784047406.831512:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2a2569b5-a558-4441-a96a-1d77608df16b+8:2399:x1870705689440768:12345-192.168.204.40@tcp:3:md5sum.0 00000100:00100000:1.0:1784047406.834748:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2a2569b5-a558-4441-a96a-1d77608df16b+8:2399:x1870705689440768:12345-192.168.204.40@tcp:3:md5sum.0 Request processed in 3221us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047406.834788:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 600 00002000:00100000:1.0:1784047406.834805:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x722:0x0] (0->32767) req@ffff99ccef506a00 x1870705689440768/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 488/440 e 0 to 0 dl 1784047417 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047406.834817:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef506a00 with x1870705689440768 ext(0->32767) 00002000:00010000:1.0:1784047406.834826:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccef506a00 00000100:00100000:2.0:1784047406.854420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047406.854853:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689440896 00000100:00100000:1.0:1784047406.854866:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689440896 00002000:00100000:1.0:1784047406.854932:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x722:0x0] (32768->1048575) req@ffff99cbc9c22d80 x1870705689440896/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 488/0 e 0 to 0 dl 1784047417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047406.854947:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc9c22d80 with x1870705689440896 ext(32768->1048575) 00002000:00010000:1.0:1784047406.854954:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cbc9c22d80 00000100:00100000:1.0:1784047406.855004:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 601 00000100:00100000:1.0:1784047406.855016:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689440896:12345-192.168.204.40@tcp:3:md5sum.0 00000100:00100000:1.0:1784047406.858828:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689440896:12345-192.168.204.40@tcp:3:md5sum.0 Request processed in 3802us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047406.858845:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 601 00002000:00100000:1.0:1784047406.858863:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x722:0x0] (32768->1048575) req@ffff99cbc9c22d80 x1870705689440896/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 488/440 e 0 to 0 dl 1784047417 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047406.858875:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc9c22d80 with x1870705689440896 ext(32768->1048575) 00002000:00010000:1.0:1784047406.858883:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cbc9c22d80 00000100:00100000:0.0:1784047406.901879:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047406.902284:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441152 00000100:00100000:3.0:1784047406.902297:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441152 00000100:00100000:3.0:1784047406.902476:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 228 00000100:00100000:3.0:1784047406.902489:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf35d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+20:69525:x1870705689441152:12345-192.168.204.40@tcp:35:md5sum.0 00010000:00000080:3.0:1784047406.904810:0:66222:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf35d2850 x1870705689441152/t111669149712(0) o35->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 392/456 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047406.906262:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf35d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+21:69525:x1870705689441152:12345-192.168.204.40@tcp:35:md5sum.0 Request processed in 3767us (4387us total) trans 111669149712 rc 0/0 00000100:00100000:3.0:1784047406.906275:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 228 00000100:00100000:2.0:1784047406.955418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047406.960196:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441280 00000100:00100000:1.0:1784047406.960214:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441280 00000100:00100000:1.0:1784047406.960303:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1244 00000100:00100000:1.0:1784047406.960314:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+21:69527:x1870705689441280:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:1.0:1784047406.960427:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960444:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960456:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960472:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960479:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960485:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960566:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960576:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047406.960583:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047406.961251:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1784047406.961262:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047406.961289:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961314:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961322:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961329:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961363:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961371:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.961376:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961386:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961408:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccec842600) 00010000:00010000:2.0:1784047406.961412:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.961417:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961424:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c774b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961444:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961450:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961456:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961461:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.961464:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961482:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961490:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99cce7ec2700) 00010000:00010000:2.0:1784047406.961492:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.961496:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.961501:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c774b2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962737:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962759:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962765:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962771:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047406.962774:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962782:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962794:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:2.0:1784047406.962797:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047406.962801:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047406.962825:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c774b34 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1784047406.962873:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c21180 x1870705689441280/t0(0) o34->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:537/0 lens 472/728 e 0 to 0 dl 1784047417 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047406.963812:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+21:69527:x1870705689441280:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 3491us (8404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047406.963826:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1244 00010000:00010000:2.0:1784047407.378888:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047407.749491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047407.749520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047407.749537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047407.749564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047407.749633:0:89035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441408 00000100:00100000:2.0:1784047407.749642:0:89035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441408 00000100:00100000:2.0:1784047407.749688:0:89035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:2.0:1784047407.749698:0:89035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689441408:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047407.749762:0:89035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+10:2399:x1870705689441408:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047407.749769:0:89035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:2.0:1784047407.749798:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441664 00000100:00100000:2.0:1784047407.749800:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441664 00000100:00100000:2.0:1784047407.749845:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441536 00000100:00100000:2.0:1784047407.749847:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441536 00000100:00100000:2.0:1784047407.749863:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1244 00000100:00100000:2.0:1784047407.749868:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689441664:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047407.749895:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689441664:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047407.749901:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1244 00000100:00100000:2.0:1784047407.749911:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1245 00000100:00100000:2.0:1784047407.749923:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+21:2399:x1870705689441536:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:2.0:1784047407.749936:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef504a80 x1870705689441536/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:538/0 lens 224/224 e 0 to 0 dl 1784047418 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047407.749957:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+21:2399:x1870705689441536:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047407.749963:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1245 00000100:00080000:2.0:1784047407.750080:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047407.751046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047407.751163:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441920 00000100:00100000:0.0:1784047407.751170:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441920 00000100:00100000:0.0:1784047407.751208:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689441792 00000100:00100000:0.0:1784047407.751211:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689441792 00000100:00100000:0.0:1784047407.751233:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2514 00000100:00100000:0.0:1784047407.751239:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+8:2399:x1870705689441920:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047407.751280:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+8:2399:x1870705689441920:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 41us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047407.751287:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2514 00000100:00100000:0.0:1784047407.751307:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2515 00000100:00100000:0.0:1784047407.751312:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689441792:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047407.751333:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689441792:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 21us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047407.751351:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2515 00010000:00010000:1.0:1784047408.406371:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784047408.659903:0:90391:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784047408.659960:0:90391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.659975:0:90391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.659983:0:90391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.659991:0:90391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.660077:0:90391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784047408.660084:0:90391:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784047408.660129:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784047408.660134:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784047408.660141:0:90391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784047408.660169:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784047408.660241:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709268864:0@lo:39:umount.0 00000100:00100000:0.0:1784047408.660313:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047408.660468:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268864 00000100:00100000:2.0:1784047408.660476:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268864 00000100:00100000:2.0:1784047408.660556:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1784047408.660567:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709268864:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784047408.660596:0:68026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774767 00000100:00080000:2.0:1784047408.660642:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccc3567800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784047408.660678:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047408.660686:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.660706:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418a00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047408.660710:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.660719:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047408.660727:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047408.660733:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047408.660735:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784047408.660738:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784047408.660765:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.660771:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047408.660793:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.660801:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418a00/0x4426598c0c774664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77466b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.660813:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.660814:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.660816:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047408.660823:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047408.660832:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709268992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047408.660864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047408.660908:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709268992 00000100:00100000:1.0:1784047408.660912:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709268992 00000100:00100000:1.0:1784047408.660945:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1784047408.660951:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709268992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047408.660962:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047408.660978:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77466b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774664 expref: 24 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.660991:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047408.661022:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709268992:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047408.661030:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1784047408.661066:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709268992:0@lo:103:ldlm_bl.0 00010000:00000080:2.0:1784047408.661304:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef507b80 x1870705709268864/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:539/0 lens 224/224 e 0 to 0 dl 1784047419 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047408.661454:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870705709268864:12345-0@lo:39:umount.0 Request processed in 890us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047408.661461:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000020:00000080:2.0:1784047408.661471:0:68026:0:(genops.c:906:class_export_put()) final put ffff99ccc3565800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1784047408.661550:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047408.661583:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3565800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784047408.661661:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc3567800 for lustre-MDT0000 00000100:00080000:3.0:1784047408.662155:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccff387000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784047408.662214:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709268864:0@lo:39:umount.0 00000100:00080000:0.0:1784047408.662260:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784047408.662264:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784047408.662268:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784047408.663558:0:90391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663574:0:90391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663581:0:90391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663588:0:90391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663833:0:90391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047408.663841:0:90391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663859:0:90391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663865:0:90391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.663871:0:90391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.663916:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047408.663923:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.663931:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047408.663935:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.663943:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047408.663950:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047408.663956:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047408.663958:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784047408.663993:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.664005:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784047408.664058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709269120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047408.664134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047408.664224:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269120 00000100:00100000:3.0:1784047408.664233:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269120 00000100:00100000:3.0:1784047408.664285:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784047408.664295:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709269120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047408.664308:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047408.664336:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0e00/0x4426598c0c77458b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774584 expref: 23 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.664353:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047408.664418:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.664427:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0c00/0x4426598c0c774584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77458b expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.664438:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047408.664442:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.664447:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047408.664450:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.664456:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047408.664462:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047408.664468:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047408.664471:0:16469:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1784047408.664484:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.664490:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784047408.664635:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709269120:12345-0@lo:103:ldlm_bl.0 Request processed in 340us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047408.664643:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00010000:00010000:1.0:1784047408.664719:0:90391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1784047408.664724:0:90391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784047408.664733:0:90391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664741:0:90391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664747:0:90391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664754:0:90391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664765:0:90391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047408.664776:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047408.664781:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664787:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047408.664797:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664804:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047408.664811:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047408.664816:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784047408.664818:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784047408.664820:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784047408.664838:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664843:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047408.664859:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664866:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1600/0x4426598c0c774656 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77465d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664876:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.664877:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.664879:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047408.664888:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709269376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047408.664917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047408.664951:0:90391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664959:0:90391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664971:0:90391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664977:0:90391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.664988:0:90391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784047408.664992:0:90391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1784047408.664998:0:90391:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1784047408.665025:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047408.665029:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665036:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047408.665038:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665045:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047408.665051:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047408.665056:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047408.665057:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784047408.665059:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784047408.665072:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665077:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047408.665093:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665099:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1200/0x4426598c0c774576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77457d expref: -99 pid: 89023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665108:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.665121:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.665124:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047408.665133:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047408.665141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709269504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047408.665170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047408.665197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269376 00000100:00100000:1.0:1784047408.665201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269376 00000100:00100000:1.0:1784047408.665232:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269504 00000100:00100000:1.0:1784047408.665235:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269504 00000100:00100000:1.0:1784047408.665254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1784047408.665261:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709269376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047408.665274:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047408.665285:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419a00/0x4426598c0c77465d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774656 expref: 23 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665294:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047408.665399:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047408.665449:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.665468:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c77468e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774695 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.665477:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047408.665479:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047408.665481:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047408.665570:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709269248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047408.665601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047408.665681:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+22:3645:x1870705709269376:12345-0@lo:103:ldlm_bl.0 Request processed in 419us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047408.665688:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1784047408.665823:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269248 00000100:00100000:1.0:1784047408.665828:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269248 00000100:00100000:1.0:1784047408.665855:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1784047408.665862:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf349ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+22:3645:x1870705709269504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047408.665876:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047408.665886:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1000/0x4426598c0c77457d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774576 expref: 22 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665894:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047408.665918:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf349ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+21:3645:x1870705709269504:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047408.665924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1784047408.665961:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1784047408.665967:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+20:3648:x1870705709269248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047408.665974:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047408.665983:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbde00/0x4426598c0c774695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77468e expref: 20 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.665992:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047408.666016:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+19:3648:x1870705709269248:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047408.666022:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1784047408.666059:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709269504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047408.666067:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709269376:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1784047408.666097:0:90391:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784047408.666101:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1784047408.666105:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1784047408.666122:0:90391:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1784047408.667484:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709269120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047408.668780:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709269248:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1784047408.668969:0:90391:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1784047408.669491:0:89024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00010000:00010000:0.0:1784047408.669647:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.669658:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.669667:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.669674:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047408.669678:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.669686:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.669706:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccfebe4300) 00010000:00010000:0.0:1784047408.669710:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047408.669716:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.669732:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774a9a lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784047408.669914:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1784047408.669922:0:90391:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc3566800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047408.669934:0:90391:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd001b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047408.669938:0:90391:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd001f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047408.669943:0:90391:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccc832a800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047408.669949:0:90391:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbc79c2000 2a2569b5-a558-4441-a96a-1d77608df16b 192.168.204.40@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 111669149712 stale:0 00000020:00080000:1.0:1784047408.669954:0:90391:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99cd00100000) has exports, disconnecting them 00000020:00080000:1.0:1784047408.669958:0:90391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccc3566800), last request at 1784047375 00000020:00000080:1.0:1784047408.669965:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774760 00000100:00080000:1.0:1784047408.669973:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccc3564800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047408.670029:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc3566800): rc 0 00000020:00000080:1.0:1784047408.670032:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccc3566800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1784047408.670042:0:90391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd001b000), last request at 1784047405 00000020:00000080:1.0:1784047408.670045:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774759 00000100:00080000:1.0:1784047408.670048:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccd001a800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047408.670087:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3566800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047408.670150:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc3564800 for lustre-MDT0000 00010000:00010000:0.0:1784047408.670443:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047408.670518:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd001b000): rc 0 00000020:00000080:1.0:1784047408.670521:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccd001b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784047408.670537:0:90391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd001f800), last request at 1784047405 00000020:00000080:1.0:1784047408.670541:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774752 00000100:00080000:1.0:1784047408.670548:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccd0018000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1784047408.670578:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd001b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784047408.670648:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd001a800 for lustre-MDT0000 00010000:00010000:2.0:1784047408.670743:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047408.670868:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd001f800): rc 0 00000020:00000080:1.0:1784047408.670871:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccd001f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784047408.670885:0:90391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccc832a800), last request at 1784047369 00000020:00000080:1.0:1784047408.670896:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745d8 00000100:00080000:1.0:1784047408.670906:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99cbc64cd000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784047408.670931:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd001f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784047408.670970:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd0018000 for lustre-MDT0000 00010000:00010000:2.0:1784047408.671027:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047408.671155:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc832a800): rc 0 00000020:00000080:1.0:1784047408.671157:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccc832a800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1784047408.671175:0:90391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.40@tcp (ffff99cbc79c2000), last request at 1784047407 00000020:00000080:1.0:1784047408.671191:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745d1 00000020:00010000:1.0:1784047408.671198:0:90391:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cbc79c2000: total 1 00000100:00080000:1.0:1784047408.671202:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e51800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047408.671234:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc832a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047408.671278:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc64cd000 for lustre-MDT0000 00000020:00010000:3.0:1784047408.671396:0:15071:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cbc79c2000: total 0 00010000:00010000:3.0:1784047408.671400:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047408.671462:0:15071:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cbc79c2000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1784047408.671503:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419e00/0x4426598c0c774ad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae29f expref: 11 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671532:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c77499e lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae22f expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671547:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418c00/0x4426598c0c774b18 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2ad expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671560:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774997 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae228 expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671575:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7749a5 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae236 expref: 7 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671592:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774a93 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae275 expref: 6 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671632:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff419200/0x4426598c0c774aaf lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 5 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047408.671648:0:15071:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cbc79c2000, canceled 7 locks, left on hash table 0. 00000020:00080000:1.0:1784047408.675207:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99cbc79c2000): rc 0 00000004:00000080:1.0:1784047408.675220:0:90391:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc914157fae0 00000100:00080000:1.0:1784047408.675245:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784047408.675251:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784047408.676190:0:90391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784047408.676227:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784047408.676363:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709269632:0@lo:39:umount.0 00000100:00100000:2.0:1784047408.676446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047408.676647:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269632 00000100:00100000:1.0:1784047408.676657:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269632 00000100:00100000:1.0:1784047408.676713:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:1.0:1784047408.676722:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709269632:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784047408.676750:0:83733:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774617 00000100:00080000:1.0:1784047408.676759:0:83733:0:(import.c:65:import_set_state_nolock()) ffff99ccc5c01800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784047408.678428:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784047408.678570:0:83733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411437 00000100:00100000:1.0:1784047408.678819:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3644:x1870705709269632:12345-0@lo:39:umount.0 Request processed in 2093us (2368us total) trans 77309411438 rc 0/0 00000100:00100000:1.0:1784047408.678832:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00080000:2.0:1784047408.679457:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784047408.679467:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709269632:0@lo:39:umount.0 00000100:00080000:2.0:1784047408.681492:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047408.681500:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 3 00000004:00080000:2.0:1784047408.681516:0:90391:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784047408.681586:0:90391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784047408.681642:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784047408.681660:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047408.681662:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968751 gen 3 00000004:00080000:2.0:1784047408.681672:0:90391:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047408.681748:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709269760:0@lo:9:umount.0 00000100:00100000:2.0:1784047408.681823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047408.681868:0:90391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784047408.681878:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784047408.681894:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709269888:0@lo:9:umount.0 00000100:00100000:2.0:1784047408.681940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784047408.682009:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cd00100000) has no exports 00000100:00100000:1.0:1784047408.682126:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269760 00000100:00100000:1.0:1784047408.682134:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269760 00000100:00100000:1.0:1784047408.682187:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709269888 00000100:00100000:1.0:1784047408.682190:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709269888 00000100:00100000:1.0:1784047408.682213:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971 00000100:00100000:1.0:1784047408.682223:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709269760:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784047408.682249:0:26192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774633 00000100:00080000:1.0:1784047408.682257:0:26192:0:(import.c:65:import_set_state_nolock()) ffff99ccec804800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784047408.682307:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047408.684380:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972 00000100:00100000:0.0:1784047408.684406:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709269888:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784047408.684441:0:26183:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774641 00000100:00080000:0.0:1784047408.684455:0:26183:0:(import.c:65:import_set_state_nolock()) ffff99ccec805800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047408.684517:0:26183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968752 00000100:00100000:0.0:1784047408.684726:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709269888:12345-0@lo:9:umount.0 Request processed in 332us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047408.684735:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972 00000100:00080000:0.0:1784047408.684761:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047408.684766:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047408.684776:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047408.684977:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784047408.685001:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784047408.685003:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047408.685024:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709269888:0@lo:9:umount.0 00000020:00080000:0.0:1784047408.685823:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cd00100000) has no exports 00000001:00000004:1.0:1784047408.686767:0:26192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968752 00000100:00100000:1.0:1784047408.686976:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709269760:12345-0@lo:9:umount.0 Request processed in 4750us (5148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047408.686988:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971 00000100:00080000:1.0:1784047408.687073:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784047408.687083:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784047408.687085:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784047408.687089:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709269760:0@lo:9:umount.0 00010000:00010000:2.0:1784047408.687404:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784047408.701549:0:15071:0:(genops.c:906:class_export_put()) final put ffff99cbc79c2000/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047408.701711:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc79c2000/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-MDT0000 00000020:00000080:2.0:1784047408.701778:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5e51800 for lustre-MDT0000 00010000:00010000:2.0:1784047408.701792:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047408.701795:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047408.701797:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784047408.729974:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745ed 00000020:00000080:0.0:1784047408.729991:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccc3559800/lustre-QMT0000_UUID 00000020:01000000:0.0:1784047408.730049:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784047408.730136:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047408.730148:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047408.730153:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99ccfebb4d40) has no exports 00000020:00000080:2.0:1784047408.730512:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745e6 00000020:00000080:2.0:1784047408.730519:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cbcaee1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047408.730546:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3559800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784047408.730787:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047408.730854:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047408.730864:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784047408.730867:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cbcaee1000/lustre-QMT0000_UUID 00000020:00000080:2.0:1784047408.730870:0:90391:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784047408.730878:0:90391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1784047408.731034:0:90391:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cd00117f00 - data ffff99ccf7a49870/ffff99cbc9ed1000 00000020:01000000:2.0:1784047408.731186:0:90391:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc74e5b40 - data ffff99ccf3391948/ffff99ccec90bc00 00000100:00080000:3.0:1784047408.784161:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784047408.784174:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784047408.784193:0:90391:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99cbc93bfb80 x1870705709269632/t77309411438(77309411438) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047418 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047408.784236:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784047408.785932:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784047408.785939:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 4 00000004:00080000:3.0:1784047408.786021:0:90391:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047408.786023:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047408.786311:0:89042:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047408.786317:0:89042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1784047408.786328:0:89042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:3.0:1784047408.787317:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784047408.787322:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968751 gen 4 00000004:00080000:3.0:1784047408.787363:0:90391:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047408.787365:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047408.787634:0:89044:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047408.787639:0:89044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:1.0:1784047408.787649:0:89044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:3.0:1784047408.788759:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745a7 00000020:00000080:3.0:1784047408.788771:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047408.789198:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047408.789541:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745bc 00000020:00000080:3.0:1784047408.789548:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccca573000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784047408.789925:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784047408.789932:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047408.789943:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784047408.789949:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99cd00104d40) has no exports 00000004:01000000:3.0:1784047408.790282:0:90391:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784047408.790294:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77463a 00000020:00000080:3.0:1784047408.790300:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccfddd1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047408.790405:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccca573000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784047408.790600:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784047408.790632:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047408.790641:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784047408.790644:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99cbc76ccd40) has no exports 00000020:00000080:3.0:1784047408.790651:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77462c 00000020:00000080:3.0:1784047408.790656:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cd0032c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047408.790831:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1784047408.791316:0:90391:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784047408.791321:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784047408.791325:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968751 gen 5 00000004:00080000:3.0:1784047408.791330:0:90391:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047408.791333:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047408.791380:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd0032c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047408.791468:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047408.791479:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784047408.791486:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77461e 00000020:00000080:3.0:1784047408.791492:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccff382000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047408.791516:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d7f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784047408.791529:0:52247:0:(genops.c:906:class_export_put()) final put ffff99ccff381800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047408.791532:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccff381800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784047408.791536:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784047408.791727:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784047408.791730:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047408.791736:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784047408.791739:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99cbc9898000) has no exports 00000020:00000080:3.0:1784047408.791744:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774610 00000020:00000080:3.0:1784047408.791747:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cce4923000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047408.791791:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccff382000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784047408.792176:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce4923000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784047408.792297:0:90391:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784047408.792302:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784047408.792304:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968751 gen 5 00000004:00080000:3.0:1784047408.792308:0:90391:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047408.792310:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784047408.792383:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047408.792391:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1784047408.792403:0:90391:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1784047408.792409:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774602 00000020:00000080:3.0:1784047408.792414:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047408.792449:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce4927800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784047408.792455:0:52247:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047408.792457:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784047408.792461:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784047408.792568:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784047408.792572:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047408.792578:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784047408.792581:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99cd001019c0) has no exports 00000020:00000080:3.0:1784047408.792586:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745fb 00000020:00000080:3.0:1784047408.792590:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cbcaee3000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047408.792668:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784047408.793179:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784047408.802987:0:90391:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784047408.802999:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784047408.803004:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784047408.803013:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047408.803220:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047408.803239:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047408.803290:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047408.803295:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047408.803302:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cbc7655000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047408.803308:0:90391:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7655000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784047408.803317:0:90391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047408.803326:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcaee7800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784047408.803336:0:52247:0:(genops.c:906:class_export_put()) final put ffff99ccf2d79000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047408.803338:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784047408.803343:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047408.803452:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745c3 00000020:00000080:0.0:1784047408.803460:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7d000/lustre-MDD0000_UUID 00000020:01000000:0.0:1784047408.804128:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784047408.804136:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047408.804144:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784047408.804148:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cd00103380) has no exports 00000020:00000080:0.0:1784047408.804215:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047408.804221:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784047408.804227:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7745ca 00000020:00000080:0.0:1784047408.804233:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047408.804346:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784047408.804352:0:52247:0:(genops.c:906:class_export_put()) final put ffff99ccf2d79800/lustre-MDD0000_UUID 00000020:00000080:1.0:1784047408.804354:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d79800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784047408.804360:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1784047408.804592:0:90391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccebeba000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784047408.804597:0:90391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccebeba000 3 00000020:01000004:0.0:1784047408.804600:0:90391:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccebeba000 from lustre-MDT0000 00000020:00000080:0.0:1784047408.804644:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047408.804648:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784047408.804651:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784047408.804656:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7a000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784047408.804660:0:90391:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784047408.804670:0:90391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784047408.804727:0:90391:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784047408.804731:0:90391:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784047408.804740:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784047408.804744:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047408.804748:0:90391:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784047408.804756:0:90391:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccf2d75000 6e36843b-2016-43fe-8842-da5818d68597 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047408.804766:0:90391:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccf2d71000 d42aef96-772a-4ce2-a768-bea713505b5b 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784047408.804771:0:90391:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff99ccfebb19c0) has exports, disconnecting them 00000020:00080000:0.0:1784047408.804777:0:90391:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ccf2d75000), last request at 1784047369 00000020:00000080:0.0:1784047408.804802:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774568 00000020:00010000:0.0:1784047408.804810:0:90391:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccf2d75000: total 0 00000100:00080000:0.0:1784047408.804816:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d70000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047408.804834:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccf2d75000): rc 0 00000020:00080000:0.0:1784047408.804839:0:90391:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.40@tcp (ffff99ccf2d71000), last request at 1784047366 00000020:00010000:1.0:1784047408.804878:0:16469:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccf2d75000: total 0 00000020:00000080:0.0:1784047408.804897:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774545 00000020:00010000:0.0:1784047408.804904:0:90391:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccf2d71000: total 0 00010000:00010000:1.0:1784047408.804918:0:16469:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccf2d75000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784047408.804951:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbce00/0x4426598c0c774705 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746fe expref: 14 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.804968:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7746f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746f0 expref: 13 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805000:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c774713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77470c expref: 12 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805010:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7746a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77469c expref: 11 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805020:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cee00/0x4426598c0c774721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77471a expref: 10 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805030:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418400/0x4426598c0c7746b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746aa expref: 9 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805041:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0600/0x4426598c0c77472f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774728 expref: 8 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805051:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0000/0x4426598c0c7746bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746b8 expref: 7 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805060:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418600/0x4426598c0c77473d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774736 expref: 6 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805073:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbdc00/0x4426598c0c7746cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746c6 expref: 5 pid: 89032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805084:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce200/0x4426598c0c7746db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746d4 expref: 4 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805094:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7746e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7746e2 expref: 3 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805131:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c77474b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774744 expref: 2 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047408.805141:0:16469:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccf2d75000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784047408.805160:0:16469:0:(genops.c:906:class_export_put()) final put ffff99ccf2d75000/6e36843b-2016-43fe-8842-da5818d68597 00010000:00010000:1.0:1784047408.805171:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.805178:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047408.805181:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047408.805187:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d75000/6e36843b-2016-43fe-8842-da5818d68597 for MGS 00000100:00080000:0.0:1784047408.805207:0:90391:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d77800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047408.805220:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccf2d71000): rc 0 00000020:00080000:0.0:1784047408.805226:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99ccfebb19c0) has no exports 00000020:00000080:1.0:1784047408.805227:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d70000 for MGS 00000020:00010000:0.0:1784047408.805243:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccf2d71000: total 0 00010000:00010000:0.0:1784047408.805267:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccf2d71000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784047408.805287:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce800/0x4426598c0c774561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae20c expref: 5 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.805302:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbd200/0x4426598c0c774553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae1fe expref: 4 pid: 89029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.805705:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce600/0x4426598c0c77455a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae205 expref: 3 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047408.805722:0:89032:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ccc4812e00:89032] 2 exiting: rc = 0 00010000:00010000:0.0:1784047408.805725:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc200/0x4426598c0c774687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae213 expref: 2 pid: 89031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047408.805741:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccf2d71000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784047408.805758:0:6506:0:(genops.c:906:class_export_put()) final put ffff99ccf2d71000/d42aef96-772a-4ce2-a768-bea713505b5b 00010000:00010000:0.0:1784047408.805770:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047408.805773:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047408.805775:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047408.805814:0:89031:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ccecaa7600:89031] 1 exiting: rc = 0 00000100:00100000:1.0:1784047408.805842:0:89029:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ccf3bcb200:89029] 0 exiting: rc = 1 00000020:00000080:0.0:1784047408.805876:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d71000/d42aef96-772a-4ce2-a768-bea713505b5b for MGS 00000020:00000080:0.0:1784047408.805903:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d77800 for MGS 00000100:00100000:2.0:1784047408.806240:0:89035:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99cbc1ddd000:89035] 3 exiting: rc = 0 00000100:00100000:1.0:1784047408.806317:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806327:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806333:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806341:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806349:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806357:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806366:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806374:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806385:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806390:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806396:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806402:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806407:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806413:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806426:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806432:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806440:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806449:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806458:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806481:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806491:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806498:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806504:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806511:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806519:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806530:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806538:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806547:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806555:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806563:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806568:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806573:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806580:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806585:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806590:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806597:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806602:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806622:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806628:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806636:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806645:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806652:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806659:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806670:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806682:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806692:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806702:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806710:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806715:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806721:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806727:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806733:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806740:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806746:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806766:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806777:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806787:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806798:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806810:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806821:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806832:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806842:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806852:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784047408.806863:0:90391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1784047408.814091:0:90391:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc781ae40 - data ffff99ccf79ccca8/ffff99cce7ed1400 00000020:01000000:0.0:1784047408.814447:0:90391:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc781a540 - data ffff99ccf7b316c0/ffff99ccef585000 00000020:00000080:1.0:1784047408.815820:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77453e 00000020:00000080:1.0:1784047408.815832:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cbc79c3800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784047408.815849:0:90391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccebeba000 from MGS, refs=2 00000020:01000004:1.0:1784047408.815853:0:90391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccebeba000 2 00000020:01000004:1.0:1784047408.815856:0:90391:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccebeba000 from MGS 00000020:00000080:0.0:1784047408.815905:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc79c3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047408.815946:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047408.815956:0:90391:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784047408.815959:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccf7599800/MGS 00000020:00000080:1.0:1784047408.815961:0:90391:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7599800/MGS for MGS 00000020:01000000:1.0:1784047408.815972:0:90391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784047408.816068:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784047408.816074:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047408.816085:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784047408.816094:0:90391:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ccebeb9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047408.816100:0:90391:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99cbc76c8000) has exports, disconnecting them 00000020:00080000:1.0:1784047408.816106:0:90391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ccebeb9800), last request at 1784047369 00000020:00000080:1.0:1784047408.816123:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774679 00000020:00080000:1.0:1784047408.816135:0:90391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccebeb9800): rc 0 00000020:00000080:1.0:1784047408.816142:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccebeb9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784047408.816443:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebeb9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784047408.818660:0:90391:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784047408.818669:0:90391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784047408.818674:0:90391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784047408.818692:0:90391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784047408.819156:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccff387000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784047408.820520:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047408.820538:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784047408.820544:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccebebc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784047408.820548:0:90391:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebebc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784047408.820556:0:90391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784047408.820659:0:90391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccebeba000 1 00000020:00000080:0.0:1784047408.820667:0:90391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774530 00000020:00000080:0.0:1784047408.820673:0:90391:0:(genops.c:906:class_export_put()) final put ffff99cbc7653800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784047408.820685:0:90391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784047408.820689:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047408.820694:0:90391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784047408.820698:0:90391:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99cceff399c0) has no exports 00000020:00000080:3.0:1784047408.822728:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7653800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047408.839564:0:90391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047408.839578:0:90391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784047408.839583:0:90391:0:(genops.c:906:class_export_put()) final put ffff99ccebebd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047408.839588:0:90391:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebebd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784047408.839604:0:90391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784047408.840022:0:90391:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ccebebb000 00000020:02000400:3.0:1784047408.840163:0:90391:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784047409.436459:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047409.805178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047409.814426:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442048 00000100:00100000:2.0:1784047409.814445:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442048 00002000:00100000:2.0:1784047409.814539:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x722:0x0] (1048576->2097151) req@ffff99ccef505500 x1870705689442048/t0(0) o4->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:540/0 lens 488/0 e 0 to 0 dl 1784047420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047409.814553:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef505500 with x1870705689442048 ext(1048576->2097151) 00002000:00010000:2.0:1784047409.814559:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef505500 00000100:00100000:2.0:1784047409.814592:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 602 00000100:00100000:2.0:1784047409.814621:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689442048:12345-192.168.204.40@tcp:4:md5sum.0 00000100:00080000:3.0:1784047409.814836:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047409.815061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047409.827180:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442176 00000100:00100000:3.0:1784047409.827207:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442176 00000100:00100000:3.0:1784047409.827331:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4973 00000100:00100000:3.0:1784047409.827344:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a2569b5-a558-4441-a96a-1d77608df16b+9:2401:x1870705689442176:12345-192.168.204.40@tcp:16:kworker.0 00000001:00100000:0.0:1784047409.837205:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047409.837219:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccec801000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784047409.837251:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968752 is committed 00000020:00000080:1.0:1784047409.841999:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec801000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784047409.842057:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec804800 for lustre-OST0000 00000100:00100000:3.0:1784047409.845005:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a2569b5-a558-4441-a96a-1d77608df16b+8:2401:x1870705689442176:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 17646us (29927us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047409.845022:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4973 00000100:00100000:2.0:1784047409.889813:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2401:x1870705689442048:12345-192.168.204.40@tcp:4:md5sum.0 Request processed in 75200us (84639us total) trans 4294968753 rc 0/0 00000100:00100000:2.0:1784047409.889827:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 602 00002000:00100000:2.0:1784047409.889841:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x722:0x0] (1048576->2097151) req@ffff99ccef505500 x1870705689442048/t4294968753(0) o4->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:540/0 lens 488/448 e 0 to 0 dl 1784047420 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047409.889851:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef505500 with x1870705689442048 ext(1048576->2097151) 00002000:00010000:2.0:1784047409.889858:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef505500 00000100:00100000:3.0:1784047410.451091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709270016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047410.451194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047410.451646:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709270144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047410.451681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047410.453042:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270016 00000100:00100000:0.0:1784047410.453056:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270016 00000100:00100000:0.0:1784047410.453332:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270144 00000100:00100000:0.0:1784047410.453336:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270144 00000100:00100000:0.0:1784047410.453368:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1784047410.453379:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709270016:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047410.453575:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:1.0:1784047410.453586:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709270144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047410.453643:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047410.453842:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709270144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 258us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047410.453850:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00080000:1.0:1784047410.453899:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047410.453903:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047410.453953:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709270144:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047410.454375:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047410.454421:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709270016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1044us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047410.454429:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00010000:00010000:2.0:1784047410.454524:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047410.457352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709270016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047410.963564:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709270272:0@lo:400:kworker.0 00000400:00000100:1.0:1784047410.963644:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709270272 offset 0 length 224: 4 00000100:00100000:0.0:1784047410.963788:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709270400:0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.963831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047410.964918:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270400 00000100:00100000:2.0:1784047410.964928:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270400 00000100:00100000:2.0:1784047410.964988:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1784047410.964995:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1870705709270400:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047410.965003:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047410.965063:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1870705709270400:12345-0@lo:400:kworker.0 Request processed in 66us (1231us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047410.965090:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00080000:0.0:1784047410.965191:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047410.965197:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047410.965201:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784047410.965206:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047410.965210:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3473 00000100:00080000:0.0:1784047410.965218:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047410.965246:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef504e00 x1870705709270528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047410.965278:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709270400:0@lo:400:kworker.0 00000100:00100000:2.0:1784047410.966255:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709270528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784047410.966273:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709271040:0@lo:400:kworker.0 00000100:00100000:1.0:1784047410.966301:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709270656:0@lo:400:kworker.0 00000100:00100000:2.0:1784047410.966323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047410.966323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047410.966346:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709270912:0@lo:400:kworker.0 00000100:00100000:3.0:1784047410.966391:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709270784:0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.967464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047410.967488:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709271168:0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.967520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047410.967552:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271168 00000100:00100000:0.0:1784047410.967558:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271168 00000100:00100000:0.0:1784047410.967596:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1784047410.967603:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709271168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.967674:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709271168:12345-0@lo:400:kworker.0 Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047410.967681:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1784047410.967718:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709271168:0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.967772:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270528 00000100:00100000:0.0:1784047410.967776:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270528 00000100:00100000:0.0:1784047410.967796:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270656 00000100:00100000:0.0:1784047410.967799:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270656 00000100:00100000:0.0:1784047410.967827:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1784047410.967834:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.967867:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709270656:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047410.967873:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1784047410.967884:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1784047410.967888:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709270528:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784047410.967905:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047410.967937:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709270528:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 43us (1615us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047410.967944:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1784047410.967962:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271040 00000100:00100000:0.0:1784047410.967966:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271040 00000100:00100000:0.0:1784047410.968001:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1784047410.968005:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1870705709271040:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784047410.968011:0:8442:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784047410.968040:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1870705709271040:12345-0@lo:400:kworker.0 Request processed in 34us (1722us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047410.968046:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1784047410.968084:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709270656:0@lo:400:kworker.0 00000100:00080000:0.0:1784047410.968114:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047410.968119:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047410.968129:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784047410.968136:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047410.968139:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3473 00000100:00080000:0.0:1784047410.968145:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047410.968169:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0047aa00 x1870705709271552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047410.968184:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709271040:0@lo:400:kworker.0 00000100:00080000:0.0:1784047410.968206:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047410.968861:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047410.968868:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047410.968872:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709270528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784047410.968895:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709271552:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784047410.968897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047410.968957:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270912 00000100:00100000:0.0:1784047410.968963:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270912 00000100:00100000:0.0:1784047410.968995:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1784047410.969001:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709270912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784047410.969251:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047410.971967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047410.972058:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271552 00000100:00100000:2.0:1784047410.972092:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271552 00000100:00100000:2.0:1784047410.972140:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:2.0:1784047410.972148:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709271552:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784047410.972171:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047410.972229:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709271552:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 81us (269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047410.972236:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00080000:2.0:1784047410.972275:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047410.972280:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047410.972284:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709271552:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784047410.974993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047410.975065:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709271296:0@lo:400:kworker.0 00000100:00100000:3.0:1784047410.975141:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047410.975219:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271296 00000100:00100000:3.0:1784047410.975226:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271296 00000100:00100000:3.0:1784047410.975277:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:3.0:1784047410.975286:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709271296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047410.975344:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709271296:12345-0@lo:400:kworker.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047410.975351:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:3.0:1784047410.975397:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709271296:0@lo:400:kworker.0 00000100:00100000:2.0:1784047410.975633:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709270784 00000100:00100000:2.0:1784047410.975639:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709270784 00000100:00100000:2.0:1784047410.975664:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1784047410.975669:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709270784:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047410.975676:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047410.975710:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709270784:12345-0@lo:400:kworker.0 Request processed in 39us (726us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047410.975716:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1784047410.975887:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709271424:0@lo:400:kworker.0 00000100:00100000:1.0:1784047410.975917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047410.976000:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271424 00000100:00100000:2.0:1784047410.976004:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271424 00000100:00100000:2.0:1784047410.976033:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1784047410.976038:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870705709271424:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047410.976043:0:66220:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047410.976084:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870705709271424:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047410.976090:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00080000:3.0:1784047410.976232:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784047410.976238:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784047410.976241:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784047410.976247:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047410.976251:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3473 00000100:00080000:3.0:1784047410.976257:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047410.976285:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc5a26d80 x1870705709271680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047410.976315:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709270784:0@lo:400:kworker.0 00000100:00080000:1.0:1784047410.976400:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047410.976404:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047410.976407:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047410.976410:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047410.976413:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3473 00000100:00080000:1.0:1784047410.976418:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047410.976439:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc93be300 x1870705709271808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047410.976450:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709271424:0@lo:400:kworker.0 00000100:00100000:2.0:1784047410.976693:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709271680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047410.976725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047410.976745:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709271808:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784047410.976758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047410.976821:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271680 00000100:00100000:1.0:1784047410.976825:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271680 00000100:00100000:1.0:1784047410.976845:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271808 00000100:00100000:1.0:1784047410.976847:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271808 00000100:00100000:1.0:1784047410.976856:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1784047410.976859:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709271680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1784047410.976877:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047410.976909:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709271680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47us (182us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047410.976916:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1784047410.976932:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1784047410.976937:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709271808:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1784047410.976945:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047410.976968:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709271808:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (208us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047410.976974:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1784047410.977002:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709270912:0@lo:400:kworker.0 00000100:00100000:0.0:1784047410.977051:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709270912:12345-0@lo:400:kworker.0 Request processed in 7984us (8091us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047410.977059:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00080000:2.0:1784047410.977079:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047410.977084:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047410.977087:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709271680:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1784047410.977096:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047410.977099:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047410.977101:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709271808:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1784047411.475358:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047412.498922:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784047412.505459:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047412.505473:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccec800000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784047412.505519:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968752 is committed 00000020:00000080:1.0:1784047412.508170:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec800000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1784047412.508260:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec805800 for lustre-OST0001 00000100:00100000:0.0:1784047412.873705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047412.873751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:0.0:1784047412.873776:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689442304 offset 0 length 224: 4 00000100:00100000:0.0:1784047412.873794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047412.873832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047412.873863:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442432 00000100:00100000:0.0:1784047412.873863:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442688 00000100:00100000:2.0:1784047412.873873:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442432 00000100:00100000:0.0:1784047412.873873:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442688 00000100:00100000:2.0:1784047412.873917:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442560 00000100:00100000:2.0:1784047412.873921:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442560 00000100:00100000:0.0:1784047412.873925:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2518 00000100:00100000:2.0:1784047412.873956:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1248 00000100:00100000:0.0:1784047412.873956:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+8:2399:x1870705689442688:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047412.873969:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689442560:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047412.874071:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1252 00000100:00100000:1.0:1784047412.874077:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1870705689442432:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:1.0:1784047412.874090:0:66220:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:0.0:1784047412.874141:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+8:2399:x1870705689442688:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047412.874148:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2518 00000100:00100000:0.0:1784047412.874164:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442816 00000100:00100000:0.0:1784047412.874168:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442816 00000100:00100000:0.0:1784047412.874191:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2519 00000100:00100000:0.0:1784047412.874198:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689442816:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:3.0:1784047412.874262:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047412.874267:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047412.874269:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047412.874351:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689442560:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 383us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047412.874360:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1248 00000100:00100000:1.0:1784047412.878924:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1870705689442432:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 4832us (5215us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047412.878941:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1252 00000100:00100000:0.0:1784047412.879182:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a2569b5-a558-4441-a96a-1d77608df16b+7:2399:x1870705689442816:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 4981us (5346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047412.879193:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2519 00000100:00100000:0.0:1784047412.892215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047412.892393:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689442944 00000100:00100000:3.0:1784047412.892403:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689442944 00000100:00100000:3.0:1784047412.892458:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1253 00000100:00100000:3.0:1784047412.892466:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689442944:12345-192.168.204.40@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1784047412.892488:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047412.892572:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689442944:12345-192.168.204.40@tcp:38:ptlrpcd_00_00.0 Request processed in 105us (368us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047412.892581:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1253 00010000:00010000:0.0:1784047413.523157:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047414.547483:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784047414.553553:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784047414.553571:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411438 is committed 00000020:00000080:1.0:1784047414.553578:0:75662:0:(genops.c:906:class_export_put()) final put ffff99ccc5c04000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047414.563504:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c04000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784047414.563594:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5c01800 for lustre-MDT0001 00010000:00010000:0.0:1784047415.571589:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047415.571725:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709272064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047415.571810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047415.572044:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272064 00000100:00100000:0.0:1784047415.572052:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272064 00000100:00100000:0.0:1784047415.572116:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1784047415.572137:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709272064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047415.572167:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047415.572215:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709272064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047415.572222:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1784047415.572269:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709272064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047415.572432:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709271936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047415.572465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047415.572674:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709271936 00000100:00100000:1.0:1784047415.572679:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709271936 00000100:00100000:1.0:1784047415.572718:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1784047415.572727:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709271936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047415.572745:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047415.572795:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709271936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047415.572802:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00080000:1.0:1784047415.572821:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047415.572824:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047415.572847:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709271936:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1784047415.578017:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968753 is committed 00000100:00080000:3.0:1784047416.088907:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047416.088915:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047416.088918:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047416.088926:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3509 00000100:00080000:3.0:1784047416.088945:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047416.088953:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047416.088986:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9be6d80 x1870705709272320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047416.089031:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047416.089035:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047416.089037:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047416.089040:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3509 00000100:00080000:3.0:1784047416.089043:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047416.089048:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047416.089060:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9be6300 x1870705709272576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047416.089075:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784047416.089076:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709272320:0@lo:38:kworker.0 00000100:00080000:3.0:1784047416.089089:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047416.089091:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047416.089094:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3509 00000100:00080000:3.0:1784047416.089096:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047416.089099:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047416.089111:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9be4e00 x1870705709272832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047416.089150:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784047416.089150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047416.089154:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047416.089155:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047416.089159:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3509 00000100:00080000:3.0:1784047416.089165:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047416.089168:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047416.089181:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9e8000 x1870705709273216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047416.089208:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709272576:0@lo:38:kworker.0 00000100:00100000:3.0:1784047416.089210:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709272448:0@lo:400:kworker.0 00000100:00100000:2.0:1784047416.089236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047416.089295:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709272960:0@lo:400:kworker.0 00000100:00100000:1.0:1784047416.089327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047416.089349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784047416.089355:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709272192:0@lo:400:kworker.0 00000400:00000100:1.0:1784047416.089372:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709272192 offset 0 length 224: 4 00000100:00100000:1.0:1784047416.089393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709273088:0@lo:400:kworker.0 00000100:00100000:1.0:1784047416.089424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047416.089452:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272960 00000100:00100000:1.0:1784047416.089458:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272960 00000100:00100000:1.0:1784047416.089496:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273088 00000100:00100000:1.0:1784047416.089499:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273088 00000100:00100000:2.0:1784047416.091307:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709272832:0@lo:38:kworker.0 00000100:00100000:2.0:1784047416.091386:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047416.091409:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709273216:0@lo:38:kworker.0 00000100:00100000:2.0:1784047416.091770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047416.093765:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:1.0:1784047416.093789:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709272960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047416.093888:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709272960:12345-0@lo:400:kworker.0 Request processed in 111us (4559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047416.093897:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:1.0:1784047416.093921:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:1.0:1784047416.093929:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709273088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047416.093962:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709273088:12345-0@lo:400:kworker.0 Request processed in 34us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047416.093967:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1784047416.094061:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272832 00000100:00100000:0.0:1784047416.094069:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272832 00000100:00100000:0.0:1784047416.094112:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:0.0:1784047416.094118:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709272832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047416.094137:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047416.094171:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709272832:12345-0@lo:38:kworker.0 Request processed in 52us (2784us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047416.094177:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:0.0:1784047416.094468:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709272704:0@lo:400:kworker.0 00000100:00100000:0.0:1784047416.094537:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709273088:0@lo:400:kworker.0 00000100:00100000:0.0:1784047416.094551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709272960:0@lo:400:kworker.0 00000100:00100000:2.0:1784047416.095646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047416.099070:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272320 00000100:00100000:3.0:1784047416.099090:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272320 00000100:00100000:3.0:1784047416.099164:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272576 00000100:00100000:3.0:1784047416.099168:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272576 00000100:00100000:3.0:1784047416.099190:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273216 00000100:00100000:3.0:1784047416.099193:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273216 00000100:00100000:3.0:1784047416.099210:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1784047416.099219:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709272320:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047416.099243:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047416.099343:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709272320:12345-0@lo:38:kworker.0 Request processed in 125us (10192us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047416.099351:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1784047416.099367:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1784047416.099371:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709272576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047416.099381:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047416.099409:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709272576:12345-0@lo:38:kworker.0 Request processed in 36us (10171us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047416.099415:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1784047416.099426:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1784047416.099430:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709273216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047416.099439:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047416.100122:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709273216:12345-0@lo:38:kworker.0 Request processed in 689us (8351us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047416.100129:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00080000:3.0:1784047416.100203:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047416.100209:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047416.100213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709273216:0@lo:38:kworker.0 00000100:00080000:3.0:1784047416.100223:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047416.100227:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047416.100229:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709272320:0@lo:38:kworker.0 00000100:00080000:3.0:1784047416.100257:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047416.100260:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047416.100263:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709272576:0@lo:38:kworker.0 00000100:00080000:3.0:1784047416.100273:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047416.100276:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047416.100278:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709272832:0@lo:38:kworker.0 00000100:00100000:3.0:1784047416.104015:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272704 00000100:00100000:3.0:1784047416.104030:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272704 00000100:00100000:3.0:1784047416.104123:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1784047416.104133:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709272704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047416.104214:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709272704:12345-0@lo:400:kworker.0 Request processed in 83us (8570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047416.104223:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1784047416.104266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047416.104302:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709272448 00000100:00100000:3.0:1784047416.104306:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709272448 00000100:00100000:3.0:1784047416.104346:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1784047416.104352:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709272448:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784047416.104378:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047416.104390:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709272448:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047416.104395:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1784047416.104412:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709272704:0@lo:400:kworker.0 00000100:00100000:3.0:1784047416.104418:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709272448:0@lo:400:kworker.0 00010000:00010000:2.0:1784047416.595142:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047417.619526:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047417.994582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:2.0:1784047417.994654:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689443072 offset 0 length 224: 4 00000100:00100000:2.0:1784047417.994676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047417.994697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047417.994717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047417.995128:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689443200 00000100:00100000:1.0:1784047417.995142:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689443200 00000100:00100000:1.0:1784047417.995189:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689443328 00000100:00100000:1.0:1784047417.995193:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689443328 00000100:00080000:1.0:1784047417.995221:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047417.995254:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1251 00000100:00100000:1.0:1784047417.995266:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689443328:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047417.995318:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689443456 00000100:00100000:0.0:1784047417.995324:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689443456 00000100:00100000:1.0:1784047417.995354:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689443328:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 90us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047417.995363:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1251 00000100:00100000:0.0:1784047417.995370:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689443584 00000100:00100000:0.0:1784047417.995375:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689443584 00000100:00100000:1.0:1784047417.995385:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1257 00000100:00100000:1.0:1784047417.995405:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689443200:12345-192.168.204.40@tcp:38:kworker.0 00000100:00100000:0.0:1784047417.995412:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2522 00000100:00100000:0.0:1784047417.995422:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689443456:12345-192.168.204.40@tcp:400:kworker.0 00010000:00020000:1.0:1784047417.995429:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047417.995448:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2523 00000100:00100000:1.0:1784047417.995458:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689443584:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047417.995461:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689443456:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 38us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047417.995470:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2522 00000100:00100000:1.0:1784047417.995494:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689443584:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 38us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047417.995501:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2523 00000100:00100000:1.0:1784047417.995536:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689443200:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 135us (966us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047417.995543:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1257 00000100:00080000:1.0:1784047417.995569:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047417.995572:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047418.643007:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047419.666832:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047420.690974:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047420.691070:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709273344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047420.691159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047420.691206:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273344 00000100:00100000:0.0:1784047420.691215:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273344 00000100:00100000:0.0:1784047420.691286:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1784047420.691296:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709273344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047420.691341:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047420.691390:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709273344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047420.691398:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00080000:3.0:1784047420.691484:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047420.691520:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709273344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047420.694642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047420.696326:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709273472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047420.696545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047420.696732:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273472 00000100:00100000:1.0:1784047420.696741:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273472 00000100:00100000:1.0:1784047420.696919:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:1.0:1784047420.696929:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709273472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047420.696963:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047420.697026:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709273472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047420.697033:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1784047420.697314:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709273472:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784047420.697647:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047421.205559:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047421.205568:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047421.205571:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047421.205583:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3514 00000100:00080000:2.0:1784047421.205590:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047421.205598:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047421.205718:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9e54700 x1870705709273728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047421.205821:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047421.205825:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047421.205841:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047421.205846:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3514 00000100:00080000:2.0:1784047421.205851:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047421.205856:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047421.205883:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9e56d80 x1870705709273984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047421.205929:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047421.205933:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047421.205935:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047421.205939:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3514 00000100:00080000:2.0:1784047421.205943:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047421.205947:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047421.205963:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00415f80 x1870705709274240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047421.205989:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047421.205992:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047421.205994:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047421.205996:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3514 00000100:00080000:2.0:1784047421.205999:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047421.206003:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047421.206014:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00414380 x1870705709274624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047421.206052:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709273856:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.206528:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047421.206586:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784047421.206595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709273600:0@lo:400:kworker.0 00000400:00000100:2.0:1784047421.206809:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709273600 offset 0 length 224: 4 00000100:00100000:2.0:1784047421.206855:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709274496:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.206907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047421.206953:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709274368:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.206986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047421.207009:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047421.207015:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709274112:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.207043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047421.207518:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709273728:0@lo:38:kworker.0 00000100:00100000:3.0:1784047421.207553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047421.207579:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709273984:0@lo:38:kworker.0 00000100:00100000:3.0:1784047421.207622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047421.207713:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709274240:0@lo:38:kworker.0 00000100:00100000:3.0:1784047421.207862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047421.207897:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709274624:0@lo:38:kworker.0 00000100:00100000:3.0:1784047421.207923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047421.207963:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274496 00000100:00100000:3.0:1784047421.207972:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274496 00000100:00100000:3.0:1784047421.208023:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274368 00000100:00100000:3.0:1784047421.208035:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274368 00000100:00100000:3.0:1784047421.208064:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1784047421.208074:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709274496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047421.208212:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709274496:12345-0@lo:400:kworker.0 Request processed in 138us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047421.208223:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1784047421.208250:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1784047421.208260:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047421.208310:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709274368:12345-0@lo:400:kworker.0 Request processed in 52us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047421.208317:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1784047421.208339:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273856 00000100:00100000:3.0:1784047421.208343:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273856 00000100:00100000:3.0:1784047421.208375:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274112 00000100:00100000:3.0:1784047421.208379:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274112 00000100:00100000:2.0:1784047421.208488:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273728 00000100:00100000:2.0:1784047421.208493:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273728 00000100:00100000:2.0:1784047421.208516:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709273984 00000100:00100000:2.0:1784047421.208519:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709273984 00000100:00100000:2.0:1784047421.208533:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274624 00000100:00100000:2.0:1784047421.208536:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274624 00000100:00100000:2.0:1784047421.208549:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1784047421.208558:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709273856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.208623:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709273856:12345-0@lo:400:kworker.0 Request processed in 49us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047421.208631:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1784047421.209869:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1784047421.209895:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709274112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047421.209951:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709274112:12345-0@lo:400:kworker.0 Request processed in 60us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047421.209958:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1784047421.209972:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1784047421.209976:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709273728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047421.209997:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047421.210042:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709273728:12345-0@lo:38:kworker.0 Request processed in 62us (2486us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047421.210049:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1784047421.210073:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1784047421.210151:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1784047421.210157:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709274624:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047421.210169:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047421.210200:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709274624:12345-0@lo:38:kworker.0 Request processed in 42us (2276us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047421.210207:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1784047421.210304:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274240 00000100:00100000:2.0:1784047421.210312:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274240 00000100:00100000:2.0:1784047421.210344:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1784047421.210350:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709274240:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047421.210362:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047421.211511:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709274240:12345-0@lo:38:kworker.0 Request processed in 1156us (3643us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047421.211523:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00080000:2.0:1784047421.211584:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047421.212022:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709273984:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047421.212041:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047421.212169:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709273984:12345-0@lo:38:kworker.0 Request processed in 2087us (4561us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047421.212178:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00080000:3.0:1784047421.212225:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047421.212233:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047421.212239:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709273728:0@lo:38:kworker.0 00000100:00080000:3.0:1784047421.212252:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047421.212256:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047421.212259:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709273984:0@lo:38:kworker.0 00000100:00080000:3.0:1784047421.212268:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047421.212272:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047421.212277:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709274240:0@lo:38:kworker.0 00000100:00080000:3.0:1784047421.212288:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047421.212292:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047421.212295:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709274624:0@lo:38:kworker.0 00000100:00100000:2.0:1784047421.212726:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709274112:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.213164:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709274368:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.213212:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709274496:0@lo:400:kworker.0 00000100:00100000:2.0:1784047421.213228:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709273856:0@lo:400:kworker.0 00010000:00010000:2.0:1784047421.715069:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047422.742378:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047423.127959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:0.0:1784047423.127999:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689443712 offset 0 length 224: 4 00000100:00100000:0.0:1784047423.128019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047423.128044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047423.128068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047423.128105:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444096 00000100:00100000:0.0:1784047423.128115:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444096 00000100:00100000:0.0:1784047423.128169:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444224 00000100:00100000:0.0:1784047423.128172:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444224 00000100:00100000:0.0:1784047423.128193:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2526 00000100:00100000:0.0:1784047423.128201:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689444096:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047423.128344:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2399:x1870705689444096:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047423.128352:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2526 00000100:00100000:0.0:1784047423.128370:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2527 00000100:00100000:0.0:1784047423.128376:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689444224:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047423.128401:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689444224:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047423.128407:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2527 00000100:00100000:0.0:1784047423.128426:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689443968 00000100:00100000:0.0:1784047423.128438:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689443968 00000100:00100000:0.0:1784047423.128469:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689443840 00000100:00100000:0.0:1784047423.128472:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689443840 00000100:00100000:0.0:1784047423.128487:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1254 00000100:00100000:0.0:1784047423.128494:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689443968:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047423.128523:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689443968:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047423.128529:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1254 00000100:00100000:0.0:1784047423.128541:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1261 00000100:00100000:0.0:1784047423.128546:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689443840:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:0.0:1784047423.128564:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047423.128591:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689443840:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 43us (545us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047423.128597:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1261 00000100:00080000:0.0:1784047423.130071:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047423.130080:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047423.130083:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047423.763724:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047424.791952:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047425.810868:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047425.811149:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709274752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047425.811236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047425.811453:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274752 00000100:00100000:1.0:1784047425.811463:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274752 00000100:00100000:1.0:1784047425.811552:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1784047425.811563:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709274752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047425.811631:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047425.811681:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709274752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047425.811689:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1784047425.811735:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709274752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784047425.811807:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047425.812520:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709274880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047425.812565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047425.812684:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709274880 00000100:00100000:0.0:1784047425.812690:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709274880 00000100:00100000:0.0:1784047425.812741:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1784047425.812750:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709274880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047425.812769:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047425.812822:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709274880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047425.812852:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00080000:2.0:1784047425.813141:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047425.813174:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709274880:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784047426.322891:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047426.322899:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047426.322902:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047426.322912:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3519 00000100:00080000:3.0:1784047426.322919:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047426.322927:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047426.322960:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9e8700 x1870705709275136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047426.322993:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047426.322997:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047426.322998:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047426.323001:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3519 00000100:00080000:3.0:1784047426.323004:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047426.323007:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047426.323018:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9ead80 x1870705709275392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047426.323034:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047426.323037:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047426.323039:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047426.323042:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3519 00000100:00080000:3.0:1784047426.323044:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047426.323047:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047426.323057:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9ea300 x1870705709275648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047426.323066:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047426.323069:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047426.323070:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047426.323073:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3519 00000100:00080000:3.0:1784047426.323075:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784047426.323078:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047426.323096:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9e8380 x1870705709275776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047426.323123:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047426.323139:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709275008:0@lo:400:kworker.0 00000400:00000100:3.0:1784047426.323192:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709275008 offset 0 length 224: 4 00000100:00100000:3.0:1784047426.323239:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709275136:0@lo:38:kworker.0 00000100:00100000:3.0:1784047426.323274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047426.323293:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709275392:0@lo:38:kworker.0 00000100:00100000:3.0:1784047426.323312:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047426.323327:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709275648:0@lo:38:kworker.0 00000100:00100000:3.0:1784047426.323409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047426.323427:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709275776:0@lo:38:kworker.0 00000100:00100000:3.0:1784047426.323449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047426.323477:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709275264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047426.323499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047426.323516:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047426.323521:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709275520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047426.323539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047426.323570:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709275136 00000100:00100000:3.0:1784047426.323577:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709275136 00000100:00100000:3.0:1784047426.323599:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709275392 00000100:00100000:3.0:1784047426.323601:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709275392 00000100:00100000:3.0:1784047426.323633:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709275776 00000100:00100000:3.0:1784047426.323635:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709275776 00000100:00100000:3.0:1784047426.323644:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709275264 00000100:00100000:3.0:1784047426.323646:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709275264 00000100:00100000:3.0:1784047426.323689:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1784047426.323700:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709275264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047426.323770:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709275264:12345-0@lo:400:kworker.0 Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047426.323787:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1784047426.323803:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709275520 00000100:00100000:3.0:1784047426.323806:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709275520 00000100:00100000:3.0:1784047426.323823:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1784047426.323829:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709275520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047426.323857:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709275520:12345-0@lo:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047426.323863:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1784047426.323873:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1784047426.323878:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709275136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047426.323896:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047426.323929:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709275136:12345-0@lo:38:kworker.0 Request processed in 49us (654us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047426.323934:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1784047426.323946:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1784047426.323950:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709275392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047426.323959:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047426.323983:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709275392:12345-0@lo:38:kworker.0 Request processed in 31us (670us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047426.323989:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1784047426.323999:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1784047426.324003:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709275776:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047426.324018:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047426.324044:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709275776:12345-0@lo:38:kworker.0 Request processed in 39us (594us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047426.324050:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1784047426.324075:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709275648 00000100:00100000:3.0:1784047426.324079:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709275648 00000100:00100000:3.0:1784047426.324101:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:3.0:1784047426.324105:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709275648:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047426.324115:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047426.324141:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709275648:12345-0@lo:38:kworker.0 Request processed in 34us (731us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047426.324147:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00080000:3.0:1784047426.324172:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047426.324205:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709275520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047426.324215:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709275264:0@lo:400:kworker.0 00000100:00080000:3.0:1784047426.324244:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047426.324249:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047426.324252:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709275136:0@lo:38:kworker.0 00000100:00080000:3.0:1784047426.324259:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047426.324263:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047426.324265:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709275392:0@lo:38:kworker.0 00000100:00080000:3.0:1784047426.324272:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047426.324276:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047426.324278:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709275648:0@lo:38:kworker.0 00000100:00080000:3.0:1784047426.324294:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047426.324298:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047426.324301:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709275776:0@lo:38:kworker.0 00010000:00010000:2.0:1784047426.836072:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1784047427.348774:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047410/real 1784047410] req@ffff99ccfdd08380 x1870705709270272/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047427.348808:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99ccfdd08380 x1870705709270272/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047427.348817:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784047427.348821:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1784047427.348824:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784047427.348826:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784047427.348829:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccfdd08380 x1870705709270272/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047427.348837:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbc5a26d80 x1870705709272192/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047427.349056:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbc9e55180 x1870705709273600/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047427.349078:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccec9e9180 x1870705709275008/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784047427.349086:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784047427.349090:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784047427.349091:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784047427.349093:0:3645:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1784047427.349122:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709275008:0@lo:400:kworker.0 00000100:00100000:0.0:1784047427.349128:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709270272:0@lo:400:kworker.0 00000100:00100000:1.0:1784047427.357233:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709273600:0@lo:400:kworker.0 00000100:00100000:3.0:1784047427.358046:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709272192:0@lo:400:kworker.0 00000100:00080000:3.0:1784047427.358125:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047427.358130:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784047427.358134:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047427.358139:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3467 00000100:00080000:3.0:1784047427.358147:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047427.358180:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00414380 x1870705709275904/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047427.358346:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709275904:0@lo:250:kworker.0 00000400:00000100:1.0:1784047427.358394:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709275904 offset 0 length 520: 4 00000100:00080000:3.0:1784047427.358453:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047427.358457:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047427.358459:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047427.358464:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3524 00000100:00080000:3.0:1784047427.358468:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047427.358473:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047427.358503:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00415f80 x1870705709276032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047427.368375:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709276032:0@lo:38:kworker.0 00000100:00100000:1.0:1784047427.368452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047427.368530:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276032 00000100:00100000:1.0:1784047427.368538:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276032 00000100:00100000:1.0:1784047427.368580:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1784047427.368588:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709276032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047427.368628:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047427.368673:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709276032:12345-0@lo:38:kworker.0 Request processed in 83us (220us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047427.368680:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00080000:1.0:1784047427.368721:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047427.368726:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047427.368730:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709276032:0@lo:38:kworker.0 00000100:00080000:3.0:1784047427.374690:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047427.374698:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047427.374702:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047427.374711:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3524 00000100:00080000:3.0:1784047427.374715:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047427.374734:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047427.374776:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9e9180 x1870705709276288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047427.374854:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047427.374858:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047427.374860:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047427.374863:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3524 00000100:00080000:3.0:1784047427.374866:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047427.374870:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047427.374881:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec9ea300 x1870705709276544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047427.374917:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709276672:0@lo:400:kworker.0 00000100:00100000:3.0:1784047427.374987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047427.375040:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276672 00000100:00100000:3.0:1784047427.375047:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276672 00000100:00100000:3.0:1784047427.375104:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:3.0:1784047427.375113:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709276672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047427.375164:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709276672:12345-0@lo:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047427.375171:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00080000:2.0:1784047427.375893:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047427.375897:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047427.375899:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047427.375912:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3524 00000100:00080000:2.0:1784047427.375915:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047427.375919:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047427.375934:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd08380 x1870705709276928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047427.375983:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709276672:0@lo:400:kworker.0 00000100:00100000:2.0:1784047427.375999:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047427.376004:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709276800:0@lo:400:kworker.0 00000100:00100000:2.0:1784047427.376037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047427.376065:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276800 00000100:00100000:2.0:1784047427.376069:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276800 00000100:00100000:2.0:1784047427.376100:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:2.0:1784047427.376106:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709276800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047427.376142:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709276800:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047427.376149:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:2.0:1784047427.376202:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709276800:0@lo:400:kworker.0 00000100:00080000:3.0:1784047427.376791:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047427.376799:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047427.378427:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709276160:0@lo:400:kworker.0 00000100:00100000:1.0:1784047427.378521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047427.378569:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047427.378576:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709276416:0@lo:400:kworker.0 00000100:00100000:1.0:1784047427.378600:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047427.378661:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709276288:0@lo:38:kworker.0 00000100:00100000:1.0:1784047427.378687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047427.378704:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709276544:0@lo:38:kworker.0 00000100:00100000:1.0:1784047427.378731:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047427.378772:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709276928:0@lo:38:kworker.0 00000100:00100000:1.0:1784047427.378797:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047427.378832:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276544 00000100:00100000:1.0:1784047427.378839:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276544 00000100:00100000:1.0:1784047427.378878:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:1.0:1784047427.378885:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709276544:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047427.378904:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047427.378945:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709276544:12345-0@lo:38:kworker.0 Request processed in 59us (212us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047427.378952:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:1.0:1784047427.378976:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276160 00000100:00100000:1.0:1784047427.378980:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276160 00000100:00100000:1.0:1784047427.379012:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276416 00000100:00100000:1.0:1784047427.379016:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276416 00000100:00100000:1.0:1784047427.379027:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276288 00000100:00100000:1.0:1784047427.379030:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276288 00000100:00100000:1.0:1784047427.379037:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709276928 00000100:00100000:1.0:1784047427.379039:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709276928 00000100:00100000:1.0:1784047427.379049:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1784047427.379055:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709276160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047427.379098:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709276160:12345-0@lo:400:kworker.0 Request processed in 43us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047427.379112:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1784047427.379125:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1784047427.379132:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709276416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047427.379161:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709276416:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047427.379167:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1784047427.379179:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1784047427.379183:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709276288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047427.379205:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047427.380462:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709276288:12345-0@lo:38:kworker.0 Request processed in 1272us (1768us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047427.380473:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1784047427.380565:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1784047427.380571:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709276928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047427.380586:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047427.380696:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709276416:0@lo:400:kworker.0 00000100:00100000:2.0:1784047427.380711:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709276160:0@lo:400:kworker.0 00000100:00080000:2.0:1784047427.380745:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047427.380750:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047427.380763:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709276288:0@lo:38:kworker.0 00000100:00080000:2.0:1784047427.380775:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047427.380779:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047427.380793:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709276544:0@lo:38:kworker.0 00000100:00100000:1.0:1784047427.380947:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709276928:12345-0@lo:38:kworker.0 Request processed in 373us (2147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047427.380954:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00080000:2.0:1784047427.381086:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047427.381090:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047427.381093:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709276928:0@lo:38:kworker.0 00010000:00010000:1.0:1784047427.862343:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047428.243072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047428.243112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047428.243158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047428.243639:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444736 00000100:00100000:1.0:1784047428.243649:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444736 00000100:00100000:1.0:1784047428.243707:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444864 00000100:00100000:1.0:1784047428.243710:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444864 00000100:00100000:1.0:1784047428.243736:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2530 00000100:00100000:1.0:1784047428.243759:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689444736:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:0.0:1784047428.243904:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047428.243909:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047428.244005:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689444736:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 249us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047428.244014:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2530 00000100:00100000:1.0:1784047428.244031:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2531 00000100:00100000:1.0:1784047428.244038:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689444864:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047428.244062:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689444864:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047428.244067:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2531 00000100:00100000:3.0:1784047428.244674:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444608 00000100:00100000:3.0:1784047428.244682:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444608 00000100:00100000:3.0:1784047428.244733:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1259 00000100:00100000:3.0:1784047428.244753:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689444608:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047428.244811:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689444608:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 70us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047428.244819:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1259 00000100:00080000:0.0:1784047428.244975:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1784047428.248951:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689444352 offset 0 length 520: 4 00000100:00100000:2.0:1784047428.248999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047428.249066:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444480 00000100:00100000:3.0:1784047428.249078:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444480 00000100:00100000:3.0:1784047428.249133:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1268 00000100:00100000:3.0:1784047428.249142:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689444480:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047428.249165:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047428.249231:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689444480:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 89us (232us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047428.249239:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1268 00010000:00010000:1.0:1784047428.895283:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047429.907124:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047430.931995:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709277056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047430.932074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047430.932442:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277056 00000100:00100000:0.0:1784047430.932451:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277056 00000100:00100000:0.0:1784047430.932527:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1784047430.932539:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709277056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047430.932572:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047430.932657:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709277056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047430.932665:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00080000:3.0:1784047430.932862:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047430.935979:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709277056:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784047430.936698:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047430.947463:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047430.947486:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709277184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047430.947562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047430.947781:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277184 00000100:00100000:0.0:1784047430.947789:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277184 00000100:00080000:3.0:1784047430.947890:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047430.948048:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1784047430.948060:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709277184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047430.948096:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047430.948160:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709277184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047430.948167:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1784047430.948497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709277184:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784047431.954821:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784047432.452450:0:91008:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784047432.452471:0:91008:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784047432.452473:0:91008:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784047432.452586:0:91008:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ccec31a000 00000020:01000004:2.0:1784047432.452623:0:91008:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784047432.452638:0:91008:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784047432.452655:0:91008:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99ccc4ac3380) 00000020:00000080:2.0:1784047432.452686:0:91008:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00000100:00080000:0.0:1784047432.467681:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047432.467692:0:45180:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784047432.467696:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047432.467699:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047432.467703:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047432.467733:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3525 00000100:00080000:0.0:1784047432.467738:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047432.467745:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047432.467791:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00479880 x1870705709277312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047432.467826:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047432.467829:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047432.467831:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047432.467834:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3525 00000100:00080000:0.0:1784047432.467837:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047432.467840:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047432.467849:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00478380 x1870705709277568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047432.467863:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047432.467866:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047432.467867:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047432.467870:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3525 00000100:00080000:0.0:1784047432.467872:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047432.467874:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047432.467884:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3ea680 x1870705709277824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047432.467927:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047432.467930:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047432.467931:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047432.467940:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3525 00000100:00080000:0.0:1784047432.467942:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047432.467945:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047432.467955:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef515c00 x1870705709278208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047432.467997:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709277440:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047432.468100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047432.468104:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709277696:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047432.468155:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277440 00000100:00100000:0.0:1784047432.468161:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277440 00000100:00100000:0.0:1784047432.468203:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277696 00000100:00100000:0.0:1784047432.468205:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277696 00000100:00100000:0.0:1784047432.468226:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1784047432.468234:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709277440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468297:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709277440:12345-0@lo:400:kworker.0 Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047432.468304:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1784047432.468319:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1784047432.468325:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709277696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468348:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709277696:12345-0@lo:400:kworker.0 Request processed in 24us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047432.468354:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1784047432.468368:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709278080:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047432.468414:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047432.468420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709277952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047432.468461:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278080 00000100:00100000:0.0:1784047432.468463:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278080 00000100:00100000:0.0:1784047432.468487:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277952 00000100:00100000:0.0:1784047432.468489:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277952 00000100:00100000:0.0:1784047432.468505:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1784047432.468510:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709278080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468538:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709278080:12345-0@lo:400:kworker.0 Request processed in 28us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047432.468544:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1784047432.468554:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1784047432.468558:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709277952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468579:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709277952:12345-0@lo:400:kworker.0 Request processed in 20us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047432.468584:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1784047432.468636:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709277952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468647:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709278080:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468685:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709277696:0@lo:400:kworker.0 00000100:00100000:0.0:1784047432.468694:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709277440:0@lo:400:kworker.0 00000100:00080000:0.0:1784047432.468726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047432.468731:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047432.468734:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047432.468966:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709277312:0@lo:38:kworker.0 00000100:00100000:1.0:1784047432.469065:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047432.469096:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709277568:0@lo:38:kworker.0 00000100:00100000:1.0:1784047432.469117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047432.469134:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709277824:0@lo:38:kworker.0 00000100:00100000:1.0:1784047432.469156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047432.469172:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709278208:0@lo:38:kworker.0 00000100:00100000:1.0:1784047432.469192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047432.469212:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277312 00000100:00100000:0.0:1784047432.469217:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277312 00000100:00100000:1.0:1784047432.469235:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277568 00000100:00100000:1.0:1784047432.469238:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277568 00000100:00100000:0.0:1784047432.469247:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278208 00000100:00100000:0.0:1784047432.469249:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278208 00000100:00100000:1.0:1784047432.469254:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1784047432.469271:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709277312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047432.469292:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047432.469332:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709277312:12345-0@lo:38:kworker.0 Request processed in 60us (265us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047432.469421:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1784047432.469426:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709277568:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047432.469437:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047432.469463:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709277568:12345-0@lo:38:kworker.0 Request processed in 35us (345us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047432.469469:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1784047432.469483:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1784047432.469486:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709278208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047432.469495:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047432.469517:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709278208:12345-0@lo:38:kworker.0 Request processed in 29us (324us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047432.469523:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1784047432.469571:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709277824 00000100:00100000:0.0:1784047432.469575:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709277824 00000100:00100000:0.0:1784047432.469631:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1784047432.469636:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709277824:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047432.469646:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047432.469685:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709277824:12345-0@lo:38:kworker.0 Request processed in 47us (527us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047432.469690:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00080000:0.0:1784047432.469888:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047432.469894:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047432.469898:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709277312:0@lo:38:kworker.0 00000100:00080000:0.0:1784047432.469980:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047432.469990:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047432.469993:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709277568:0@lo:38:kworker.0 00000100:00080000:0.0:1784047432.470004:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047432.470007:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047432.470010:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709277824:0@lo:38:kworker.0 00000100:00080000:0.0:1784047432.470017:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047432.470020:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047432.470023:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709278208:0@lo:38:kworker.0 00000100:00100000:1.0:1784047432.470865:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00100000:10000000:0.0:1784047432.585979:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784047432.587357:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1784047432.590760:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.591987:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784047432.592384:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.592840:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.593078:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.593276:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784047432.593476:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784047432.593948:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.594138:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.594388:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784047432.595224:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784047432.595569:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784047432.595841:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784047432.596419:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784047432.596857:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784047432.597107:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784047432.597302:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784047432.597680:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784047432.597998:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784047432.598218:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784047432.598456:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.599099:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.599345:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.599816:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.600098:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.600323:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.600649:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.600971:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.601166:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.601394:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.601799:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.602043:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.602256:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.602633:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.602958:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.603176:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.603407:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.603810:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.604047:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.604299:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.604680:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.605677:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.606307:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.606530:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784047432.606836:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784047432.611914:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784047432.613935:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784047432.614206:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784047432.616103:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784047432.616407:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784047432.617237:0:91008:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1784047432.619184:0:91008:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784047432.619858:0:91008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784047432.619872:0:91008:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784047432.619888:0:91008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774b42 00000020:01000004:1.0:1784047432.619897:0:91008:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784047432.619954:0:91008:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784047432.619962:0:91008:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccec31a000 from MGS 00000020:01000004:1.0:1784047432.619966:0:91008:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784047432.619979:0:91008:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cbc989cd40) 00000020:00000080:1.0:1784047432.619992:0:91008:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1784047432.620126:0:91008:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccec31a000 from MGS, refs=2 00080000:01000000:1.0:1784047432.620133:0:91008:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784047432.620138:0:91008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774b50 00010000:00010000:1.0:1784047432.620267:0:91008:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1784047432.636270:0:91008:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784047432.637479:0:91012:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784047432.637538:0:91008:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784047432.637576:0:91008:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784047432.638215:0:91008:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784047432.638702:0:91008:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784047432.638853:0:91008:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784047432.639009:0:91008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784047432.643116:0:91008:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784047432.643128:0:91008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784047432.645668:0:91008:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784047432.645687:0:91008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784047432.646314:0:91008:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784047432.646338:0:91008:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1784047432.646340:0:91008:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1784047432.646344:0:91008:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1784047432.646349:0:91008:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 67, was 0): CONNECTING 00000100:00100000:0.0:1784047432.646355:0:91008:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:1.0:1784047432.985385:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047433.350895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047433.350940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047433.350983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047433.351138:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689444992 00000100:00100000:1.0:1784047433.351148:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689444992 00000100:00100000:1.0:1784047433.351192:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445120 00000100:00100000:1.0:1784047433.351195:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445120 00000100:00100000:1.0:1784047433.351243:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1262 00000100:00100000:1.0:1784047433.351270:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689445120:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047433.351358:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689445120:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 92us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047433.351367:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1262 00000100:00100000:1.0:1784047433.351385:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1272 00000100:00100000:1.0:1784047433.351389:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689444992:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:1.0:1784047433.351413:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047433.351437:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689444992:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 47us (555us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047433.351444:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1272 00000100:00080000:1.0:1784047433.351477:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047433.352840:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445376 00000100:00100000:3.0:1784047433.353119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047433.353443:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445376 00000100:00100000:2.0:1784047433.353516:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445248 00000100:00100000:2.0:1784047433.353520:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445248 00000100:00100000:2.0:1784047433.353545:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2534 00000100:00100000:2.0:1784047433.353555:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689445376:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047433.353657:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689445376:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 88us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047433.353665:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2534 00000100:00100000:2.0:1784047433.353679:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2535 00000100:00100000:2.0:1784047433.353697:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689445248:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047433.353724:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689445248:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047433.353729:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2535 00000100:00080000:1.0:1784047433.356541:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047433.356552:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784047434.007212:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047435.026848:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047436.050885:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047436.050910:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709278336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047436.050995:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047436.051097:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278336 00000100:00100000:0.0:1784047436.051106:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278336 00010000:00010000:3.0:1784047436.051247:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047436.051299:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047436.051357:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047436.051375:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709278464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047436.051405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047436.056395:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278464 00000100:00100000:0.0:1784047436.056411:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278464 00000100:00100000:0.0:1784047436.058878:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1784047436.058894:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709278336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047436.058928:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047436.059018:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709278336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (8023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047436.059040:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1784047436.059059:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1784047436.059065:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709278464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047436.059080:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047436.059121:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709278464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (7715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047436.059127:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1784047436.059211:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709278336:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047436.059298:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047436.059329:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709278464:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784047437.079052:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047437.586812:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047427/real 1784047427] req@ffff99cd00414380 x1870705709275904/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047437 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047437.587026:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cd00414380 x1870705709275904/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047437 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047437.587048:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047437.587058:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1784047437.587072:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709275904:0@lo:250:kworker.0 10000000:01000000:3.0:1784047437.588152:0:91008:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1784047437.588183:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.588200:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.588235:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784047437.588268:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.588283:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc800/0x4426598c0c774736 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77473d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.588312:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.588320:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.588326:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.588331:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.588337:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c77469c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.588349:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.588356:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.588361:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.588365:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.588369:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cec00/0x4426598c0c7746b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746bf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.588381:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784047437.588385:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047437.588396:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 10000000:00010000:3.0:1784047437.588404:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.588410:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.588415:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1784047437.588419:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1784047437.588422:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd600/0x4426598c0c7746e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784047437.588431:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3525 00000100:00080000:1.0:1784047437.588441:0:81515:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 00010000:00010000:3.0:1784047437.588451:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784047437.588453:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 10000000:00010000:3.0:1784047437.588469:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.588476:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.588480:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.588485:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf600/0x4426598c0c7746f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.588498:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047437.588499:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c23800 x1870705709278592/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:3.0:1784047437.588529:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.588541:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.588548:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.588552:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce000/0x4426598c0c77470c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784047437.588567:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047437.588573:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047437.588574:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047437.588578:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3530 00000100:00080000:1.0:1784047437.588581:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047437.588585:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047437.588602:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c20000 x1870705709278720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047437.588644:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047437.588647:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047437.588648:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047437.588651:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3530 00000100:00080000:1.0:1784047437.588654:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047437.588657:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047437.588667:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c22a00 x1870705709278976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047437.588681:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047437.588684:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047437.588686:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047437.588696:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3530 00000100:00080000:1.0:1784047437.588699:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047437.588702:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047437.588718:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc79f3b80 x1870705709279232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047437.588753:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047437.588762:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047437.588763:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047437.588767:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3530 00000100:00080000:1.0:1784047437.588769:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047437.588773:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047437.588784:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc79f1180 x1870705709279616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047437.588834:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709279360:0@lo:400:kworker.0 00000100:00020000:2.0:1784047437.588999:0:3644:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff99cbc9c23800 x1870705709278592/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047437.590367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.590466:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047437.590488:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709279488:0@lo:400:kworker.0 00000100:00100000:1.0:1784047437.590533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047437.590880:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.590889:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.590896:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.590913:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.590924:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbc000/0x4426598c0c77471a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774721 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.590937:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.590944:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.590949:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.590954:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.590958:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbda00/0x4426598c0c774744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.590982:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.590987:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.590991:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.591029:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.591034:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce400/0x4426598c0c7746aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.591061:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.591068:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.591074:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047437.591077:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.591081:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1400/0x4426598c0c7746c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746cd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.591091:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.591097:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.591102:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784047437.591104:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.591108:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a1e00/0x4426598c0c7746d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7746db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.591125:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.591132:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.591147:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709278848:0@lo:400:kworker.0 10000000:01000000:3.0:1784047437.591169:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784047437.591182:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.591186:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c7746fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774705 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.591196:0:91008:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047437.591202:0:91008:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.591203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1784047437.591207:0:91008:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784047437.591210:0:91008:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784047437.591213:0:91008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c774728 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77472f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.591241:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047437.591263:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709279104:0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.591288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.591409:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279360 00000100:00100000:0.0:1784047437.591418:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279360 00000100:00100000:0.0:1784047437.591468:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279488 00000100:00100000:0.0:1784047437.591472:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279488 00000100:00100000:0.0:1784047437.591538:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:0.0:1784047437.591548:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.591651:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709279360:12345-0@lo:400:kworker.0 Request processed in 103us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.591659:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:0.0:1784047437.591676:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1784047437.591683:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709279488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.591724:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709279488:12345-0@lo:400:kworker.0 Request processed in 42us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.591730:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1784047437.591770:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278848 00000100:00100000:0.0:1784047437.591774:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278848 00000100:00100000:0.0:1784047437.591811:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279104 00000100:00100000:0.0:1784047437.591814:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279104 00000100:00100000:0.0:1784047437.591833:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1784047437.591839:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709278848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.591874:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709278848:12345-0@lo:400:kworker.0 Request processed in 36us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.591881:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1784047437.591893:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1784047437.591899:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709279104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.591923:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709279104:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.591929:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00080000:0.0:1784047437.591961:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047437.591991:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709279104:0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.592011:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709278848:0@lo:400:kworker.0 00000100:00100000:1.0:1784047437.595306:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709279488:0@lo:400:kworker.0 00000100:00100000:1.0:1784047437.595322:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709279360:0@lo:400:kworker.0 00000100:00080000:3.0:1784047437.626569:0:91008:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 68, was 0): CONNECTING 00000100:00080000:3.0:1784047437.626583:0:91008:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1784047437.626652:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047437.626671:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1784047437.626693:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:0:1870705709278592:0@lo:250:kworker.0 00000100:00080000:0.0:1784047437.627071:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047437.627078:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784047437.627081:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047437.627087:0:45180:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3535 00000100:00080000:0.0:1784047437.627092:0:45180:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784047437.627100:0:45180:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047437.627141:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c21f80 x1870705709279744/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047437.627179:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709278720:0@lo:38:kworker.0 00000100:00100000:0.0:1784047437.627256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.627301:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709278976:0@lo:38:kworker.0 00000100:00100000:0.0:1784047437.627323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.627349:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709279232:0@lo:38:kworker.0 00000100:00100000:0.0:1784047437.627446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.627478:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709279616:0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.627494:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278720 00000100:00100000:3.0:1784047437.627504:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278720 00000100:00100000:0.0:1784047437.627513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.627550:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709278976 00000100:00100000:3.0:1784047437.627554:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709278976 00000100:00100000:1.0:1784047437.630284:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279232 00000100:00100000:1.0:1784047437.630295:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279232 00000100:00100000:1.0:1784047437.630352:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1784047437.630362:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709279232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047437.630482:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047437.630586:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709279232:12345-0@lo:38:kworker.0 Request processed in 223us (3138us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047437.630593:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1784047437.630768:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709279744:0@lo:250:kworker.0 00000100:00100000:1.0:1784047437.630942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047437.631025:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047437.631030:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047437.631034:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709279232:0@lo:38:kworker.0 00000100:00100000:1.0:1784047437.631089:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279744 00000100:00100000:1.0:1784047437.631094:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279744 00000100:00100000:1.0:1784047437.631116:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784047437.631121:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870705709279744:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1784047437.631142:0:91013:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6e36843b-2016-43fe-8842-da5818d68597@0@lo t0 exp 0000000000000000 cur 3535 last 0 00000020:00000080:1.0:1784047437.631172:0:91013:0:(genops.c:1406:class_connect()) connect: client 6e36843b-2016-43fe-8842-da5818d68597, cookie 0x4426598c0c774b57 00000100:00080000:1.0:1784047437.631303:0:91013:0:(import.c:65:import_set_state_nolock()) ffff99ccc5024800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047437.631348:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+5:3644:x1870705709279744:12345-0@lo:250:kworker.0 Request processed in 225us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.631355:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784047437.631392:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 27 00000100:00100000:0.0:1784047437.631595:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279616 00000100:00100000:0.0:1784047437.631601:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279616 00000100:00100000:0.0:1784047437.631641:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1784047437.631647:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709278720:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047437.631663:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047437.631714:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709278720:12345-0@lo:38:kworker.0 Request processed in 66us (4459us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047437.631756:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1784047437.631786:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1784047437.631791:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709278976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047437.631801:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047437.632036:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709278976:12345-0@lo:38:kworker.0 Request processed in 242us (4710us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047437.632042:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1784047437.632057:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1784047437.632060:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709279616:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047437.632070:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047437.632098:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709279616:12345-0@lo:38:kworker.0 Request processed in 35us (4584us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047437.632104:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00080000:1.0:1784047437.632225:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:1.0:1784047437.632237:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784047437.632243:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784047437.632246:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784047437.632249:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784047437.632345:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784047437.632365:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709279744:0@lo:250:kworker.0 00000100:00080000:1.0:1784047437.632385:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047437.632390:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047437.632392:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709278720:0@lo:38:kworker.0 00000100:00080000:1.0:1784047437.632416:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047437.632419:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047437.632422:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709278976:0@lo:38:kworker.0 00000100:00080000:1.0:1784047437.632430:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047437.632433:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047437.632436:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709279616:0@lo:38:kworker.0 00000020:01000000:1.0:1784047437.632486:0:45180:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.140@tcp 10000000:01000000:1.0:1784047437.632502:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784047437.632505:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047437.632507:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784047437.632508:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047437.632509:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047437.632511:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047437.632512:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047437.632513:0:45180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047437.632515:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047437.632517:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047437.632571:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784047437.632578:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784047437.632580:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047437.632582:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784047437.632583:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047437.632584:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047437.632585:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047437.632586:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047437.632587:0:45180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047437.632588:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047437.632589:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047437.632626:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784047437.632632:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784047437.632634:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047437.632635:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784047437.632636:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047437.632637:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047437.632638:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047437.632640:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047437.632641:0:45180:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047437.632642:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047437.632643:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047437.632663:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784047437.632704:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709280128:0@lo:253:kworker.0 00000100:00100000:1.0:1784047437.632750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.632809:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709280000:0@lo:253:kworker.0 00000100:00100000:1.0:1784047437.633674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.633887:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047437.633896:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709279872:0@lo:253:kworker.0 00000100:00100000:1.0:1784047437.633932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.633971:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280128 00000100:00100000:1.0:1784047437.633978:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280128 00000100:00100000:1.0:1784047437.634012:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280000 00000100:00100000:1.0:1784047437.634014:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280000 00000100:00100000:1.0:1784047437.634024:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709279872 00000100:00100000:1.0:1784047437.634026:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709279872 00000100:00100000:1.0:1784047437.634038:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784047437.634046:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3647:x1870705709280128:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784047437.634074:0:91013:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1784047437.634254:0:91018:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784047437.634379:0:91013:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 117 00000100:00100000:1.0:1784047437.634599:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784047437.634629:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+7:3646:x1870705709280000:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784047437.634653:0:91015:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:0.0:1784047437.645037:0:91008:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1784047437.645058:0:91008:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784047437.645095:0:91008:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784047437.645101:0:91008:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784047437.645218:0:91008:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784047437.645251:0:91008:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784047437.645256:0:91008:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784047437.645257:0:91008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047437.645259:0:91008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047437.645260:0:91008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047437.645261:0:91008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047437.645263:0:91008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047437.645264:0:91008:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047437.645265:0:91008:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047437.645267:0:91008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047437.645268:0:91008:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784047437.645273:0:91008:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784047437.645275:0:91008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784047437.645276:0:91008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047437.645278:0:91008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047437.645279:0:91008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047437.645280:0:91008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047437.645281:0:91008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047437.645282:0:91008:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047437.645282:0:91008:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047437.645283:0:91008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047437.645284:0:91008:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784047437.645309:0:91008:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784047437.645330:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784047437.645413:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.645454:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.645478:0:91016:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1784047437.645483:0:91016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:0.0:1784047437.646881:0:91019:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784047437.646888:0:91019:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1784047437.646891:0:91019:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784047437.646894:0:91019:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784047437.648062:0:91019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784047437.648480:0:91013:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784047437.648506:0:91013:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784047437.649658:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280256 00000100:00100000:1.0:1784047437.649671:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280256 20000000:01000000:1.0:1784047437.650713:0:91013:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784047437.650726:0:91013:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784047437.650797:0:91018:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784047437.650802:0:91018:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784047437.651005:0:91015:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1784047437.651154:0:91018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651173:0:91018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047437.651183:0:91018:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000382464s 00010000:00010000:1.0:1784047437.651188:0:91018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651196:0:91018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651204:0:91018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651211:0:91018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651218:0:91018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047437.651222:0:91018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651247:0:91018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651261:0:91018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651269:0:91018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.651276:0:91018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff29600/0x4426598c0c774b5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.651421:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709280128:12345-0@lo:253:kworker.0 Request processed in 17371us (18666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.651431:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784047437.651469:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784047437.651479:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3646:x1870705709279872:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784047437.651507:0:91013:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:1.0:1784047437.651663:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784047437.651666:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784047437.651667:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047437.651668:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047437.651669:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047437.651671:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047437.651672:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047437.651675:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047437.651676:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047437.651679:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709280128:0@lo:253:kworker.0 00000100:00100000:3.0:1784047437.652934:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784047437.652950:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+7:91008:x1870705709280256:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784047437.652992:0:91020:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784047437.652995:0:91020:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784047437.652998:0:91020:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784047437.653004:0:91020:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784047437.656742:0:91015:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784047437.656757:0:91015:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784047437.657114:0:91018:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:3.0:1784047437.657118:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+7:91008:x1870705709280256:12345-0@lo:253:mount.lustre.0 Request processed in 4167us (11711us total) trans 0 rc 0/0 10000000:01000000:1.0:1784047437.657119:0:91018:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784047437.657142:0:91018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047437.657147:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784047437.657163:0:91018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047437.657183:0:91018:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000382464s 00010000:00010000:1.0:1784047437.657188:0:91018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657196:0:91018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657204:0:91018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657212:0:91018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657218:0:91018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047437.657222:0:91018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657230:0:91018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657242:0:91018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657250:0:91018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.657257:0:91018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff28400/0x4426598c0c774b65 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784047437.657410:0:91013:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784047437.657666:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+6:3646:x1870705709280000:12345-0@lo:253:kworker.0 Request processed in 23058us (23993us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.657680:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784047437.657812:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784047437.657917:0:91008:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784047437.657921:0:91008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784047437.657928:0:91008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047437.657929:0:91008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047437.657931:0:91008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047437.657932:0:91008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047437.657934:0:91008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047437.657935:0:91008:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047437.657937:0:91008:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047437.657938:0:91008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047437.657939:0:91008:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784047437.657961:0:91008:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccec31a000 from lustre-MDT0000 10000000:01000000:0.0:1784047437.657988:0:91008:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784047437.657991:0:91008:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784047437.658000:0:91008:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccec31a000 10000000:01000000:0.0:1784047437.658003:0:91008:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784047437.658007:0:91008:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ccec31a000 10000000:01000000:0.0:1784047437.658010:0:91008:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784047437.658013:0:91008:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccec31a000 from 1 10000000:01000000:0.0:1784047437.658016:0:91008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784047437.658046:0:91008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.658055:0:91008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.658064:0:91008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.658083:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047437.658120:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.658167:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047437.658225:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280384 00000100:00100000:1.0:1784047437.658230:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280384 00000100:00100000:1.0:1784047437.658271:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784047437.658279:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+6:91008:x1870705709280384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047437.658291:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047437.658305:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff29400/0x4426598c0c774b73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774b6c expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.658323:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff29400/0x4426598c0c774b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774b6c expref: 7 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.658332:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff29400/0x4426598c0c774b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774b6c expref: 7 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.658339:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29400, rc 0) 00000100:00100000:1.0:1784047437.658377:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+7:91008:x1870705709280384:12345-0@lo:101:mount.lustre.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.658383:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784047437.658511:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047437.658527:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658537:0:91008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.658553:0:91008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784047437.658573:0:91008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658580:0:91008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047437.658587:0:91008:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784047437.658592:0:91008:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784047437.658596:0:91008:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ccec31a000 10000000:01000000:3.0:1784047437.658600:0:91008:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784047437.658603:0:91008:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784047437.658630:0:91008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784047437.658648:0:91008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658656:0:91008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658665:0:91008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047437.658688:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784047437.658718:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.658734:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.658748:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280512 00000100:00100000:3.0:1784047437.658752:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280512 00000100:00100000:3.0:1784047437.658778:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784047437.658786:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+7:91008:x1870705709280512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047437.658793:0:91016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047437.658805:0:91016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419200/0x4426598c0c774b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774b7a expref: -99 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658819:0:91016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419200/0x4426598c0c774b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774b7a expref: 8 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658828:0:91016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419200/0x4426598c0c774b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774b7a expref: 8 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658835:0:91016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419200, rc 0) 00000100:00100000:3.0:1784047437.658866:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:91008:x1870705709280512:12345-0@lo:101:mount.lustre.0 Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.658873:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784047437.658909:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047437.658918:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.658926:0:91008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047437.658980:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047437.659005:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.659016:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.659029:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280640 00000100:00100000:3.0:1784047437.659032:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280640 00000100:00100000:3.0:1784047437.659049:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784047437.659055:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:91008:x1870705709280640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047437.659246:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709280640:12345-0@lo:501:mount.lustre.0 Request processed in 190us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.659254:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784047437.659284:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047437.659312:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047437.659369:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.659586:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.660557:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280768 00000100:00100000:0.0:1784047437.660575:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280768 00000100:00100000:0.0:1784047437.660632:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784047437.660640:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cccc0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709280768:12345-0@lo:503:mount.lustre.0 00000020:01000004:2.0:1784047437.660991:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784047437.660994:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784047437.660995:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047437.660997:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047437.660998:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047437.660999:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047437.661000:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047437.661002:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047437.661004:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784047437.661007:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709280000:0@lo:253:kworker.0 00000100:00100000:3.0:1784047437.662830:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cccc0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709280768:12345-0@lo:503:mount.lustre.0 Request processed in 2182us (3452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.662843:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784047437.662957:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709280768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047437.665675:0:91021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91021:1870705709280896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047437.665776:0:91021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.665816:0:91021:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047437.666051:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709280896 00000100:00100000:2.0:1784047437.666058:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709280896 00000100:00100000:2.0:1784047437.666110:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784047437.666119:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:91021:x1870705709280896:12345-0@lo:502:llog_process_th.0 20000000:01000000:0.0:1784047437.668257:0:91013:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047437.668276:0:91013:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784047437.668576:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:3646:x1870705709279872:12345-0@lo:253:kworker.0 Request processed in 17095us (34639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.668588:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:2.0:1784047437.669625:0:91018:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047437.669633:0:91018:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047437.669661:0:91018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669679:0:91018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784047437.669715:0:91018:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000382464s 00010000:00010000:2.0:1784047437.669721:0:91018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669727:0:91018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669733:0:91018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669740:0:91018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669747:0:91018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047437.669753:0:91018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669772:0:91018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669787:0:91018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669795:0:91018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.669800:0:91018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774b88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047437.670891:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:91021:x1870705709280896:12345-0@lo:502:llog_process_th.0 Request processed in 4767us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.670904:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784047437.670984:0:91021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91021:1870705709280896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047437.671020:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047437.671037:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.671040:0:91021:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784047437.671045:0:91021:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784047437.671048:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047437.671064:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cbc9898000) 00000020:00000080:1.0:1784047437.671087:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1784047437.671093:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784047437.671178:0:91021:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784047437.671185:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774b96 00000020:01000004:3.0:1784047437.677921:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784047437.677929:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784047437.677930:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047437.677931:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047437.677932:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047437.677935:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047437.677937:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784047437.677939:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047437.677940:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784047437.677946:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709279872:0@lo:253:kworker.0 00000020:00000080:1.0:1784047437.680125:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784047437.680141:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047437.680162:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.680165:0:91021:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784047437.680168:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047437.680175:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.680177:0:91021:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784047437.680182:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047437.680202:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cd00100000) 00000020:00000080:1.0:1784047437.680233:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1784047437.680238:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784047437.680240:0:91021:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784047437.680243:0:91021:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784047437.680250:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784047437.680326:0:91021:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccec31a000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784047437.680338:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cd00103380) 00000020:00000080:1.0:1784047437.680348:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1784047437.680915:0:91021:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784047437.680924:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774bab 00000020:00000080:1.0:1784047437.681090:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784047437.681098:0:91021:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784047437.681102:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4426598c0c774bb2 00080000:01000000:1.0:1784047437.681109:0:91021:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784047437.681113:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774bb9 00010000:00010000:0.0:1784047437.822894:0:91021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1784047437.823036:0:91021:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a2569b5-a558-4441-a96a-1d77608df16b idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:0.0:1784047437.823082:0:91021:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:0.0:1784047437.823104:0:91021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:0.0:1784047437.823227:0:91021:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1784047437.823282:0:91021:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cbc8ce8900: xid 1870705689435776, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:0.0:1784047437.823292:0:91021:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cbc8ce8540: xid 1870705689435520, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:0.0:1784047437.825799:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99cbc76c8000) 00000020:00000080:0.0:1784047437.825829:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1784047437.825926:0:91021:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784047437.825933:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774bd5 00000020:00000080:0.0:1784047437.826894:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784047437.839645:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4426598c0c774bdc 00000020:00000080:0.0:1784047437.844727:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784047437.844743:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047437.844752:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047437.844754:0:91021:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784047437.844758:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784047437.844770:0:91021:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1784047437.844772:0:91021:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047437.844773:0:91021:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047437.844775:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784047437.844786:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047437.844787:0:91021:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784047437.844790:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047437.844795:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047437.844796:0:91021:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784047437.844800:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784047437.844851:0:91021:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784047437.844874:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047437.844877:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047437.844879:0:91021:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784047437.844881:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047437.844885:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047437.844886:0:91021:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1784047437.844889:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784047437.844895:0:91021:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:0.0:1784047437.844922:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784047437.844938:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99cbc76ccd40) 00000020:00000080:0.0:1784047437.844959:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1784047437.844965:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784047437.845026:0:91021:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1784047437.845033:0:91021:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784047437.845040:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774bea 00010000:00080000:0.0:1784047437.845073:0:91021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccf2d79000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1784047437.856163:0:91021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1784047437.862905:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047437.862922:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784047437.862965:0:91021:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784047437.862992:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774bf1 00000100:00080000:1.0:1784047437.863005:0:91021:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784047437.863011:0:91021:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99ccf2d79000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047437.863049:0:91021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc79f0700 x1870705709281024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047437.863080:0:91021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1784047437.863140:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047437.863145:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.863147:0:91021:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784047437.863150:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784047437.863152:0:91021:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1784047437.863154:0:91021:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047437.863155:0:91021:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047437.863156:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784047437.863159:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.863160:0:91021:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784047437.863162:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784047437.863167:0:91021:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784047437.863170:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.863171:0:91021:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784047437.863174:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784047437.863178:0:91021:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:1.0:1784047437.863201:0:91021:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784047437.863204:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047437.863216:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cd00104d40) 00000020:00000080:1.0:1784047437.863231:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1784047437.863236:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784047437.863302:0:91021:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784047437.863309:0:91021:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784047437.863320:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774bff 00010000:00080000:1.0:1784047437.863352:0:91021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc6ea5000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00000100:00100000:2.0:1784047437.863771:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709281024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784047437.863842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.863907:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281024 00000100:00100000:2.0:1784047437.863915:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281024 00000100:00100000:2.0:1784047437.863947:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1784047437.863954:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709281024:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784047437.863978:0:23872:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3536 last 0 00000020:00000080:2.0:1784047437.864009:0:23872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774c06 00000004:00100000:2.0:1784047437.864023:0:23872:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047437.864122:0:23872:0:(import.c:65:import_set_state_nolock()) ffff99ccec98e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047437.864173:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709281024:12345-0@lo:38:llog_process_th.0 Request processed in 217us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047437.864180:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1784047437.864213:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047437.864220:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1784047437.864226:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784047437.864230:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784047437.864233:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d79000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784047437.864238:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709281024:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1784047437.864408:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047437.864413:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047437.864416:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047437.864421:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3535 00000100:00080000:0.0:1784047437.864424:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047437.864428:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047437.864445:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e9180 x1870705709281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047437.864481:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047437.864485:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047437.864487:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047437.864491:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3535 00000100:00080000:0.0:1784047437.864493:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047437.864501:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047437.864514:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00479c00 x1870705709281536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047437.864529:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047437.864532:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047437.864534:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047437.864537:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3535 00000100:00080000:0.0:1784047437.864539:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047437.864542:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047437.864571:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00478e00 x1870705709281792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047437.864592:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047437.864595:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047437.864597:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047437.864600:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3535 00000100:00080000:0.0:1784047437.864602:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047437.864628:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047437.864639:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00478a80 x1870705709282176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047437.864805:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709281664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.864842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.864864:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047437.864870:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709281408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.864892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.864921:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281664 00000100:00100000:3.0:1784047437.864925:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281664 00000100:00100000:3.0:1784047437.864958:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281408 00000100:00100000:3.0:1784047437.864961:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281408 00000100:00100000:3.0:1784047437.864979:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1784047437.864985:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709281664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.865023:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709281664:12345-0@lo:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.865030:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1784047437.865045:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1784047437.865051:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709281408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.865079:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709281408:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.865085:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1784047437.865118:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709281408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.865127:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709281664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.865169:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047437.865175:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709282304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047437.865202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.865230:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282304 00000100:00100000:3.0:1784047437.865240:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282304 00000100:00100000:3.0:1784047437.865267:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1784047437.865273:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709282304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047437.865296:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047437.865330:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709282304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.865336:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1784047437.865366:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709282304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047437.865879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709281920:0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.865914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.865938:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784047437.865944:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709281152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.865973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.865997:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709282048:0@lo:400:kworker.0 00000100:00100000:0.0:1784047437.866019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.866099:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281920 00000100:00100000:3.0:1784047437.866103:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281920 00000100:00100000:3.0:1784047437.866130:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282048 00000100:00100000:3.0:1784047437.866132:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282048 00000100:00100000:3.0:1784047437.866153:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1784047437.866160:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709281920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.866201:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709281920:12345-0@lo:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.866207:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1784047437.866221:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1784047437.866227:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709282048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.866254:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709282048:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.866259:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1784047437.866276:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281152 00000100:00100000:3.0:1784047437.866279:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281152 00000100:00100000:3.0:1784047437.866302:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784047437.866308:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709281152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.866337:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709281152:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.866353:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784047437.866395:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709281152:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.866406:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709282048:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.866415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709281920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047437.866457:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709281280:0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.866483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.866501:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709281536:0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.866523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.866540:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709281792:0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.866580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.866596:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709282176:0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.866636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.866664:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281280 00000100:00100000:3.0:1784047437.866667:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281280 00000100:00100000:3.0:1784047437.866684:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281536 00000100:00100000:3.0:1784047437.866687:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281536 00000100:00100000:3.0:1784047437.866698:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282176 00000100:00100000:3.0:1784047437.866700:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282176 00000100:00100000:3.0:1784047437.866709:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1784047437.866713:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709281280:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.866756:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709281280:12345-0@lo:38:kworker.0 Request processed in 41us (271us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047437.866895:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1784047437.866909:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1784047437.866913:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709281536:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.866951:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709281536:12345-0@lo:38:kworker.0 Request processed in 36us (426us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047437.866957:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1784047437.866969:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1784047437.866973:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709282176:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784047437.867000:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709282176:12345-0@lo:38:kworker.0 Request processed in 26us (364us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047437.867006:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00080000:3.0:1784047437.867041:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047437.867046:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784047437.867049:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709281280:0@lo:38:kworker.0 00000100:00080000:3.0:1784047437.867056:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047437.867060:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784047437.867062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709281536:0@lo:38:kworker.0 00000100:00080000:3.0:1784047437.867068:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047437.867071:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784047437.867074:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709282176:0@lo:38:kworker.0 00000100:00100000:2.0:1784047437.867178:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709281792 00000100:00100000:2.0:1784047437.867184:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709281792 00000100:00100000:2.0:1784047437.867208:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:2.0:1784047437.867213:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709281792:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784047437.867250:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709281792:12345-0@lo:38:kworker.0 Request processed in 35us (668us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784047437.867256:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00080000:3.0:1784047437.867349:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047437.867353:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784047437.867356:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709281792:0@lo:38:kworker.0 00010000:00010000:1.0:1784047437.867519:0:91021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1784047437.868359:0:91021:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784047437.868383:0:91021:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784047437.868871:0:91021:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1784047437.869446:0:91021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047437.869474:0:91021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:1.0:1784047437.870981:0:91021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:3.0:1784047437.871429:0:91027:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:3.0:1784047437.871434:0:91027:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784047437.871645:0:91027:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1784047437.871663:0:91027:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1784047437.872090:0:91027:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1784047437.872100:0:91027:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784047437.872988:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784047437.873000:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784047437.873043:0:91021:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784047437.873067:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774c0d 00000100:00080000:3.0:1784047437.873078:0:91021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784047437.873084:0:91021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cbc6ea5000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047437.873119:0:91021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef515c00 x1870705709282432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047437.873154:0:91021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784047437.873250:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047437.873255:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047437.873258:0:91021:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784047437.873260:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784047437.873263:0:91021:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784047437.873264:0:91021:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784047437.873266:0:91021:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784047437.873268:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784047437.873270:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047437.873271:0:91021:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784047437.873274:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784047437.873278:0:91021:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784047437.873281:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047437.873282:0:91021:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784047437.873285:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784047437.873289:0:91021:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:3.0:1784047437.873312:0:91021:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784047437.873314:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784047437.873325:0:91021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cceff399c0) 00000020:00000080:3.0:1784047437.873339:0:91021:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784047437.873344:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784047437.873413:0:91021:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784047437.873421:0:91021:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784047437.873427:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c774c1b 00010000:00080000:3.0:1784047437.873460:0:91021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccc6da9800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:3.0:1784047437.873676:0:91021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1784047437.873742:0:91021:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784047437.873763:0:91021:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784047437.874069:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709282432:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784047437.874140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.874448:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282432 00000100:00100000:3.0:1784047437.874456:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282432 00000100:00100000:3.0:1784047437.874488:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:3.0:1784047437.874496:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3644:x1870705709282432:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1784047437.874543:0:26187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3536 last 0 00000020:00000080:3.0:1784047437.874578:0:26187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774c22 00002000:00100000:3.0:1784047437.874592:0:26187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ccc6dae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784047437.874596:0:26187:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784047437.874599:0:26187:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784047437.874688:0:26187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784047437.874712:0:26187:0:(import.c:65:import_set_state_nolock()) ffff99ccc6daa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047437.874993:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709282432:12345-0@lo:8:llog_process_th.0 Request processed in 495us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.875000:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00000100:00100000:3.0:1784047437.875072:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047437.875081:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784047437.875088:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784047437.875092:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784047437.875095:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6ea5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784047437.875115:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784047437.875121:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709282432:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784047437.875227:0:91027:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784047437.875279:0:91027:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3536127671351ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784047437.875284:0:91027:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784047437.875531:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047437.875550:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709282560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047437.875603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.875662:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282560 00000100:00100000:2.0:1784047437.875667:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282560 00000100:00100000:2.0:1784047437.875708:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:2.0:1784047437.875716:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709282560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047437.875736:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047437.875874:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709282560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047437.875881:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00080000:2.0:1784047437.875904:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047437.875934:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709282560:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1784047437.876091:0:91021:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000004:00080000:3.0:1784047437.878372:0:91009:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1784047437.880568:0:91021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784047437.880755:0:91021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:0.0:1784047437.880985:0:91021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:0.0:1784047437.881402:0:91029:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:0.0:1784047437.881407:0:91029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1784047437.881571:0:91029:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:0.0:1784047437.881587:0:91029:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784047437.882297:0:91021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047437.882310:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784047437.882352:0:91021:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784047437.882381:0:91021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774c29 00000100:00080000:2.0:1784047437.882392:0:91021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047437.882397:0:91021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ccc6da9800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047437.882438:0:91021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd0ad80 x1870705709282688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047437.882472:0:91021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784047437.882552:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047437.882566:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047437.882569:0:91021:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784047437.882572:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047437.882576:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047437.882578:0:91021:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784047437.882581:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784047437.882589:0:91021:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784047437.882592:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047437.882595:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047437.882596:0:91021:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784047437.882598:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047437.882601:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047437.882603:0:91021:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784047437.882626:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784047437.882659:0:91021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91021:1870705709282816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047437.882734:0:91021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.882831:0:91021:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047437.882895:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282816 00000100:00100000:1.0:1784047437.882903:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282816 00000100:00100000:1.0:1784047437.882954:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047437.882965:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:91021:x1870705709282816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047437.883083:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:91021:x1870705709282816:12345-0@lo:502:llog_process_th.0 Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.883091:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047437.883132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709282688:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784047437.883161:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1784047437.883407:0:91029:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:0.0:1784047437.883412:0:91029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1784047437.883514:0:91021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91021:1870705709282816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047437.883542:0:91021:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1784047437.883778:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282688 00000100:00100000:0.0:1784047437.883784:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282688 00000100:00100000:0.0:1784047437.883816:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4975 00000100:00100000:0.0:1784047437.883822:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870705709282688:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784047437.883848:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3536 last 0 00000020:00000080:0.0:1784047437.883873:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c774c30 00002000:00100000:0.0:1784047437.883887:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99ccc5e52000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784047437.883898:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784047437.883900:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784047437.883959:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047437.883982:0:8431:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e53800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047437.884036:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709282688:12345-0@lo:8:llog_process_th.0 Request processed in 211us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.884042:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4975 00000100:00100000:0.0:1784047437.884079:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784047437.884088:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784047437.884095:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784047437.884100:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784047437.884104:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784047437.884114:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784047437.884120:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709282688:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1784047437.884140:0:91029:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784047437.884185:0:91029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3536136577931ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784047437.884192:0:91029:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784047437.884415:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709282944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047437.884448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1784047437.884638:0:91021:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047437.884641:0:91021:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784047437.884647:0:91021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1784047437.887391:0:91008:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1784047437.887436:0:91008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784047437.887460:0:91008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.887473:0:91008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047437.887501:0:91008:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccec31a000 from 1 10000000:01000000:0.0:1784047437.887504:0:91008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784047437.887544:0:91008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.887566:0:91008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.887578:0:91008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.887619:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047437.887690:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.887735:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd843cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047437.887878:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283072 00000100:00100000:2.0:1784047437.887887:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283072 00000100:00100000:2.0:1784047437.887937:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784047437.887946:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:91008:x1870705709283072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047437.887959:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047437.887974:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774c37 expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.887996:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774c37 expref: 9 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.888006:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c37 expref: 9 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.888025:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1000, rc 0) 00000100:00100000:2.0:1784047437.888073:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709283072:12345-0@lo:101:mount.lustre.0 Request processed in 128us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047437.888080:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784047437.889989:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047437.890017:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.890028:0:91008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.890661:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283200:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784047437.890736:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.891916:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283200 00000100:00100000:2.0:1784047437.891928:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283200 00000100:00100000:2.0:1784047437.891999:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784047437.892011:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709283200:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784047437.892035:0:91015:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784047437.892060:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784047437.892064:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784047437.892067:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784047437.892070:0:91015:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 120 00000100:00100000:2.0:1784047437.892179:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709283200:12345-0@lo:256:mount.lustre.0 Request processed in 170us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047437.892187:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784047437.892289:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd843cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.892309:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283200:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784047437.895321:0:91008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784047437.895362:0:91008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.895374:0:91008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047437.895384:0:91008:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccec31a000 from 1 10000000:01000000:0.0:1784047437.895387:0:91008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047437.895425:0:91008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.895433:0:91008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.895443:0:91008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.895470:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047437.895537:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.896573:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd843cd80 going to sleep for 11 seconds 00000004:00080000:2.0:1784047437.897124:0:91009:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784047437.897333:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709282944 00000100:00100000:1.0:1784047437.897343:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709282944 00000100:00100000:1.0:1784047437.897418:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:1.0:1784047437.897430:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709282944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047437.897462:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047437.897529:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709282944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (13079us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.897568:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00080000:2.0:1784047437.897651:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047437.897896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709282944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047437.906085:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283328 00000100:00100000:3.0:1784047437.906100:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283328 00000100:00100000:3.0:1784047437.906166:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784047437.906177:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+9:91008:x1870705709283328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047437.906194:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047437.906215:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418c00/0x4426598c0c774c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774c45 expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.906243:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418c00/0x4426598c0c774c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774c45 expref: 10 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.906253:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418c00/0x4426598c0c774c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c45 expref: 10 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047437.906263:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418c00, rc 0) 00000100:00100000:3.0:1784047437.906338:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709283328:12345-0@lo:101:mount.lustre.0 Request processed in 164us (10801us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.906345:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784047437.906570:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047437.906588:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.906598:0:91008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.906694:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047437.906746:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.906791:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd843cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047437.906970:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283456 00000100:00100000:1.0:1784047437.906975:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283456 00000100:00100000:1.0:1784047437.907014:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784047437.907022:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfddcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709283456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047437.907154:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfddcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709283456:12345-0@lo:501:mount.lustre.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.907161:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784047437.907441:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047437.907471:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047437.907510:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.907537:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd843cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.907629:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283584 00000100:00100000:3.0:1784047437.907634:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283584 00000100:00100000:3.0:1784047437.907665:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784047437.907672:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfddca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709283584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047437.907768:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfddca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709283584:12345-0@lo:503:mount.lustre.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.907776:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784047437.907954:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047437.908371:0:91031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91031:1870705709283712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047437.908405:0:91031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.908432:0:91031:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd843cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.908477:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283712 00000100:00100000:3.0:1784047437.908481:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283712 00000100:00100000:3.0:1784047437.908516:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784047437.908522:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:91031:x1870705709283712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047437.909503:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:91031:x1870705709283712:12345-0@lo:502:llog_process_th.0 Request processed in 978us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.909512:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784047437.909642:0:91031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91031:1870705709283712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047437.909677:0:91031:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047437.909687:0:91031:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.909689:0:91031:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784047437.909697:0:91031:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccec31a000 00000020:00000080:1.0:1784047437.909700:0:91031:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784047437.909707:0:91031:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047437.909709:0:91031:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.909710:0:91031:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784047437.909713:0:91031:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047437.909715:0:91031:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.909717:0:91031:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784047437.909720:0:91031:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccec31a000 00000020:00000080:1.0:1784047437.909722:0:91031:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784047437.909817:0:91031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91031:1870705709283840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047437.909857:0:91031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.909881:0:91031:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.910674:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283840 00000100:00100000:0.0:1784047437.910682:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283840 00000100:00100000:0.0:1784047437.910718:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784047437.910725:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:91031:x1870705709283840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047437.910845:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:91031:x1870705709283840:12345-0@lo:502:llog_process_th.0 Request processed in 119us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.910853:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784047437.911000:0:91031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91031:1870705709283840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047437.911028:0:91031:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047437.911038:0:91031:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047437.911040:0:91031:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784047437.911045:0:91031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784047437.911661:0:91008:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784047437.911683:0:91008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047437.911706:0:91008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.911718:0:91008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047437.911890:0:91008:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784047437.911899:0:91008:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccec31a000 10000000:01000000:0.0:1784047437.911903:0:91008:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccec31a000 10000000:01000000:0.0:1784047437.911907:0:91008:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784047437.911913:0:91008:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccec31a000 from 1 10000000:01000000:0.0:1784047437.911916:0:91008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047437.911944:0:91008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.911954:0:91008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.911963:0:91008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.911985:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047437.912029:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.912885:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd4c159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047437.923998:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709283968 00000100:00100000:1.0:1784047437.924013:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709283968 00000100:00100000:1.0:1784047437.924077:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784047437.924088:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709283968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047437.924103:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047437.924123:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff28400/0x4426598c0c774c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774c53 expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.924153:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff28400/0x4426598c0c774c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774c53 expref: 11 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.924165:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff28400/0x4426598c0c774c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c53 expref: 11 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.924173:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28400, rc 0) 00000100:00100000:1.0:1784047437.924245:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:91008:x1870705709283968:12345-0@lo:101:mount.lustre.0 Request processed in 159us (12215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.924252:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784047437.925336:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709283968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047437.925362:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.925372:0:91008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.925459:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709284096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047437.925503:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.925538:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd4c159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047437.925753:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284096 00000100:00100000:1.0:1784047437.925768:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284096 00000100:00100000:1.0:1784047437.925810:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784047437.925819:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:91008:x1870705709284096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047437.925942:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:91008:x1870705709284096:12345-0@lo:501:mount.lustre.0 Request processed in 124us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.925950:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784047437.926063:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709284096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047437.926091:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709284224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047437.926138:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047437.926165:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd4c159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.926180:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284224 00000100:00100000:0.0:1784047437.926183:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284224 00000100:00100000:0.0:1784047437.926206:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047437.926211:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:91008:x1870705709284224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047437.926286:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:91008:x1870705709284224:12345-0@lo:503:mount.lustre.0 Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.926293:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047437.926342:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709284224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047437.935017:0:91034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91034:1870705709284352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047437.935106:0:91034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.935156:0:91034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.935331:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284352 00000100:00100000:0.0:1784047437.935340:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284352 00000100:00100000:0.0:1784047437.935426:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784047437.935438:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:91034:x1870705709284352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047437.935582:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:91034:x1870705709284352:12345-0@lo:502:llog_process_th.0 Request processed in 146us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.935590:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784047437.936269:0:91034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91034:1870705709284352:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784047437.936338:0:91034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784047437.936355:0:91034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99cceff3b380) 00000020:00000080:3.0:1784047437.936382:0:91034:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1784047437.938242:0:91034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccec31a000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784047437.938252:0:91034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccec31a000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784047437.938256:0:91034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccec31a000 4 00010000:00080000:3.0:1784047437.938300:0:91034:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc7654800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047437.956597:0:91034:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1784047437.956758:0:91034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784047437.956811:0:91034:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784047437.956826:0:91034:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4426598c0c774c68 00000100:00080000:2.0:1784047437.956837:0:91034:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047437.956843:0:91034:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbc7654800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047437.956883:0:91034:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdd08380 x1870705709284480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047437.956914:0:91034:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784047437.957627:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709284480:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047437.957714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.966127:0:91034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91034:1870705709284608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047437.966153:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284480 00000100:00100000:2.0:1784047437.966161:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284480 00000100:00100000:2.0:1784047437.966205:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1784047437.966213:0:91034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.966213:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709284480:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784047437.966246:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284608 00000100:00100000:3.0:1784047437.966249:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284608 00000100:00100000:2.0:1784047437.966276:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709284480:12345-0@lo:38:llog_process_th.0 Request processed in 62us (8561us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047437.966277:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784047437.966283:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:91034:x1870705709284608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047437.966283:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1784047437.966375:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047437.966384:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7654800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047437.966389:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784047437.966391:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:91034:x1870705709284608:12345-0@lo:502:llog_process_th.0 Request processed in 108us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047437.966393:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709284480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784047437.966411:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784047437.966461:0:91034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd08340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.966482:0:91034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91034:1870705709284608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047437.966520:0:91034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91034:1870705709284736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047437.966551:0:91034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047437.966582:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284736 00000100:00100000:3.0:1784047437.966586:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284736 00000100:00100000:3.0:1784047437.966624:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784047437.966631:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:91034:x1870705709284736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047437.966652:0:91034:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd08340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.966822:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:91034:x1870705709284736:12345-0@lo:502:llog_process_th.0 Request processed in 181us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.966828:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784047437.968160:0:91034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:91034:1870705709284736:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784047437.968206:0:91034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784047437.968446:0:91008:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784047437.968474:0:91008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047437.968499:0:91008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.968511:0:91008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784047437.968684:0:91008:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784047437.968686:0:91008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047437.968692:0:91008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047437.968693:0:91008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047437.968694:0:91008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047437.968695:0:91008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047437.968697:0:91008:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047437.968698:0:91008:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047437.968700:0:91008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047437.968701:0:91008:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784047437.968704:0:91008:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784047437.968706:0:91008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784047437.968707:0:91008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047437.968708:0:91008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047437.968709:0:91008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047437.968710:0:91008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047437.968711:0:91008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047437.968712:0:91008:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047437.968712:0:91008:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047437.968713:0:91008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047437.968714:0:91008:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047437.968789:0:91008:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784047437.968808:0:91008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709284864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784047437.969196:0:91008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.969233:0:91008:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047437.969281:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284864 00000100:00100000:3.0:1784047437.969288:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284864 00000100:00100000:3.0:1784047437.969342:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784047437.969352:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:91008:x1870705709284864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784047437.969376:0:91013:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784047437.969391:0:91013:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784047437.971320:0:91013:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784047437.971338:0:91013:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784047437.971480:0:91018:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047437.971485:0:91018:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047437.971511:0:91018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.971530:0:91018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c37 expref: 11 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.971540:0:91018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.972142:0:91018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c774c37 expref: 11 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047437.972162:0:91018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c774c37 expref: 11 pid: 91020 timeout: 3636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047437.972183:0:91018:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91018:1870705709284992:0@lo:104: 00000100:00100000:2.0:1784047437.972271:0:91018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047437.972323:0:91018:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047437.972828:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709284992 00000100:00100000:0.0:1784047437.972837:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709284992 00000100:00100000:0.0:1784047437.972889:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1784047437.972899:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:91018:x1870705709284992:12345-0@lo:104: 00010000:00010000:0.0:1784047437.972914:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047437.972989:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047437.972996:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:91018:x1870705709284992:12345-0@lo:104: Request processed in 98us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047437.973003:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:1.0:1784047437.973063:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047437.973071:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973079:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047437.973083:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973093:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047437.973101:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047437.973106:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047437.973150:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973156:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047437.973178:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973185:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24be00/0x4426598c0c774c37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774c3e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973198:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047437.973200:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047437.973202:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047437.973214:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709285120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047437.973257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047437.973300:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285120 00000100:00100000:1.0:1784047437.973303:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285120 00010000:00010000:1.0:1784047437.973322:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c774c37 expref: 12 pid: 91020 timeout: 3636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047437.973342:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1784047437.973349:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+12:3648:x1870705709285120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047437.973360:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047437.973365:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c774c37 expref: 12 pid: 91020 timeout: 3636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973376:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c774c37 expref: 12 pid: 91020 timeout: 3636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973406:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973415:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047437.973430:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001945511s 00010000:00010000:1.0:1784047437.973434:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973442:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973449:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973465:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973469:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047437.973473:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973479:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973487:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973497:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047437.973537:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+12:3648:x1870705709285120:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047437.973544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00010000:00010000:1.0:1784047437.973594:0:91018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1000/0x4426598c0c774c3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c774c37 expref: 11 pid: 91020 timeout: 3636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047437.973624:0:91018:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd0ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91018:1870705709284992:0@lo:104: 00010000:00010000:1.0:1784047437.973646:0:91018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973655:0:91018:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047437.973655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709285120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047437.973661:0:91018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047437.973677:0:91018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1200/0x4426598c0c774c6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047437.974393:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:91008:x1870705709284864:12345-0@lo:253:mount.lustre.0 Request processed in 5038us (5192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047437.974473:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784047437.974575:0:91008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:91008:1870705709284864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784047437.974589:0:91008:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784047437.974596:0:91008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784047437.974597:0:91008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047437.974599:0:91008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047437.974600:0:91008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047437.974601:0:91008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047437.974602:0:91008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047437.974632:0:91008:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047437.974634:0:91008:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047437.974637:0:91008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047437.974638:0:91008:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784047437.974657:0:91008:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1784047438.006472:0:91008:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411365 00000040:01000000:1.0:1784047438.007152:0:91008:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1784047438.007522:0:91040:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784047438.007679:0:91008:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784047438.008217:0:91040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784047438.009956:0:91041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91041:1870705709285248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047438.010102:0:91041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047438.010143:0:91041:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784047438.010295:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285248 00000100:00100000:3.0:1784047438.010303:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285248 00000100:00100000:3.0:1784047438.010367:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1784047438.010379:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91041:x1870705709285248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784047438.012220:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91041:x1870705709285248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1835us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047438.012244:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:0.0:1784047438.012512:0:91041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91041:1870705709285248:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784047438.012562:0:91041:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784047438.012626:0:91041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91041:1870705709285376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047438.012670:0:91041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047438.012693:0:91041:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047438.014127:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285376 00000100:00100000:0.0:1784047438.014141:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285376 00000100:00100000:0.0:1784047438.014200:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:0.0:1784047438.014213:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91041:x1870705709285376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047438.014379:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91041:x1870705709285376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 168us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047438.014387:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000020:00080000:2.0:1784047438.014918:0:91039:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411365 00000020:00080000:2.0:1784047438.014923:0:91039:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411365 00000100:00100000:0.0:1784047438.016151:0:91041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91041:1870705709285376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047438.016282:0:91041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91041:1870705709285504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047438.016355:0:91041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784047438.016930:0:91008:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784047438.017051:0:91008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784047438.017941:0:91041:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f0c0 going to sleep for 11 seconds 00000040:00080000:1.0:1784047438.018538:0:91040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784047438.018668:0:91040:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1784047438.018885:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285504 00000100:00100000:0.0:1784047438.018897:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285504 00000100:00100000:0.0:1784047438.018950:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1784047438.019030:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91041:x1870705709285504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047438.019162:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91041:x1870705709285504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 203us (2807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047438.019169:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000004:00000080:3.0:1784047438.019376:0:91008:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1784047438.019624:0:91041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0047a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91041:1870705709285504:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784047438.019704:0:91041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1784047438.020052:0:91008:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784047438.020144:0:91008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047438.024231:0:91008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784047438.026551:0:91008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784047438.026673:0:91008:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784047438.029045:0:91008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784047438.030574:0:91041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784047438.031060:0:91041:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784047438.031065:0:91041:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:2.0:1784047438.032720:0:91008:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:2.0:1784047438.040096:0:91008:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00010000:00080000:2.0:1784047438.042214:0:91042:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91042 00010000:02000000:2.0:1784047438.042232:0:91042:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1784047438.042236:0:91042:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784047438.042239:0:91042:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784047438.042402:0:91008:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784047438.042426:0:91008:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784047438.042452:0:91008:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784047438.042488:0:91008:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784047438.049198:0:91008:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047438.049477:0:91008:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784047438.099898:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047438.472871:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047438.472936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047438.473104:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445760 00000100:00100000:3.0:1784047438.473116:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445760 00000100:00100000:3.0:1784047438.473187:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1267 00000100:00100000:3.0:1784047438.473199:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689445760:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047438.473277:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689445760:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 80us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047438.473285:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1267 00000100:00080000:3.0:1784047438.473308:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047438.474694:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445504 00000100:00100000:0.0:1784047438.474712:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445504 00000100:00100000:0.0:1784047438.475130:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:0.0:1784047438.475149:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1870705689445504:12345-192.168.204.40@tcp:250:kworker.0 00010000:00080000:0.0:1784047438.475183:0:91016:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d42aef96-772a-4ce2-a768-bea713505b5b@192.168.204.40@tcp t0 exp 0000000000000000 cur 3536 last 0 00000020:00000080:0.0:1784047438.475215:0:91016:0:(genops.c:1406:class_connect()) connect: client d42aef96-772a-4ce2-a768-bea713505b5b, cookie 0x4426598c0c774c76 00000100:00080000:3.0:1784047438.481180:0:91016:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047438.485129:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+5:2398:x1870705689445504:12345-192.168.204.40@tcp:250:kworker.0 Request processed in 9967us (12178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047438.485144:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:0.0:1784047438.485996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047438.486030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047438.486065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047438.486138:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445888 00000100:00100000:0.0:1784047438.486148:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445888 00000100:00100000:0.0:1784047438.486197:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446016 00000100:00100000:0.0:1784047438.486200:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446016 00000100:00100000:0.0:1784047438.486221:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2540 00000100:00100000:0.0:1784047438.486231:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689445888:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047438.486298:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689445888:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 67us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047438.486305:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2540 00000100:00100000:0.0:1784047438.486318:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2541 00000100:00100000:0.0:1784047438.486325:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689446016:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047438.486351:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689446016:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047438.486357:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2541 00000100:00080000:0.0:1784047438.486378:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047438.486396:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047438.486468:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689445632 00000100:00100000:1.0:1784047438.486473:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689445632 00000100:00100000:1.0:1784047438.486506:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1280 00000100:00100000:1.0:1784047438.486511:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689445632:12345-192.168.204.40@tcp:38:kworker.0 00010000:00080000:1.0:1784047438.486535:0:66219:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a2569b5-a558-4441-a96a-1d77608df16b' at ffff99cbd0b6f800, cookie 0x4426598c0c774bc0 00010000:00080000:1.0:1784047438.486542:0:66219:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp recovering/t111669149704 exp ffff99cbd0b6f800 cur 3536 last 1784047437 00010000:02000400:1.0:1784047438.486560:0:66219:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1784047438.495715:0:66219:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1784047438.495775:0:66219:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784047438.495944:0:66219:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047438.496031:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689445632:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 9517us (9998us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047438.496044:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1280 00000100:00100000:0.0:1784047438.503695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047438.503812:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689436672 00000100:00100000:2.0:1784047438.503823:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689436672 00000100:00100000:2.0:1784047438.503886:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1281 00000100:00100000:2.0:1784047438.503899:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0047a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689436672:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00080000:2.0:1784047438.503921:0:67153:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:2.0:1784047438.503943:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0047a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689436672:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 48us (258us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047438.503951:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1281 00010000:00080000:3.0:1784047438.504290:0:91042:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1784047439.123090:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784047439.194831:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784047439.194839:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccec31a000 from 121 10000000:01000000:2.0:1784047439.194843:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784047439.194892:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.194904:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.194915:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047439.194955:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709285632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.195025:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047439.195068:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc7b8db40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.195787:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285632 00000100:00100000:2.0:1784047439.195795:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285632 00000100:00100000:2.0:1784047439.195844:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784047439.195852:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:6515:x1870705709285632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.195865:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047439.195879:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1c00/0x4426598c0c774c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774c7d expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.195905:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1c00/0x4426598c0c774c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774c7d expref: 11 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.195915:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1c00/0x4426598c0c774c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c7d expref: 11 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.195924:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1c00, rc 0) 00000100:00100000:2.0:1784047439.195981:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709285632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.195988:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784047439.196158:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709285632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.196175:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.196195:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.196266:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709285760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.196302:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.196334:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.196641:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285760 00000100:00100000:3.0:1784047439.196647:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285760 00000100:00100000:3.0:1784047439.196691:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784047439.196699:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709285760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047439.196715:0:91013:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784047439.196742:0:91013:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047439.196746:0:91013:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 121 00000100:00100000:3.0:1784047439.196838:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709285760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.196846:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784047439.196883:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709285760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784047439.196930:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784047439.196938:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.196947:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.196957:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047439.196959:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 52 10000000:01000000:3.0:1784047439.196962:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047439.196980:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.196987:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.196994:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.197008:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709285888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.197038:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.197056:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d540 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.197215:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709285888 00000100:00100000:2.0:1784047439.197221:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709285888 00000100:00100000:2.0:1784047439.197252:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784047439.197269:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709285888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.197277:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047439.197293:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0800/0x4426598c0c774c92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774c8b expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.197310:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0800/0x4426598c0c774c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774c8b expref: 12 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.197318:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0800/0x4426598c0c774c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c8b expref: 12 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.197325:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0800, rc 0) 00000100:00100000:2.0:1784047439.197355:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709285888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.197361:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784047439.197394:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709285888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.197404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.197412:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047439.197467:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.197507:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047439.197522:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc7b8d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.197544:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286016 00000100:00100000:2.0:1784047439.197548:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286016 00000100:00100000:2.0:1784047439.197571:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784047439.197576:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709286016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.197730:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709286016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.198193:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784047439.198242:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.202566:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.202678:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047439.202716:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc7b8d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.202766:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286144 00000100:00100000:2.0:1784047439.202774:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286144 00000100:00100000:2.0:1784047439.202826:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784047439.202834:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709286144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.202962:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709286144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.202971:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784047439.203035:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047439.212556:0:91094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047439.213094:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047439.213120:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047439.213144:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.213156:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047439.213165:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784047439.213168:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 118 10000000:01000000:1.0:1784047439.213171:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047439.213209:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.213217:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.213227:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.213252:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.213510:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.213587:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.213838:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286272 00000100:00100000:2.0:1784047439.213847:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286272 00000100:00100000:2.0:1784047439.213899:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784047439.213908:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709286272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.213921:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047439.213935:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774c99 expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.213960:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774c99 expref: 13 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.213971:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774c99 expref: 13 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.213987:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1800, rc 0) 00000100:00100000:2.0:1784047439.214034:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709286272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.214040:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784047439.214188:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.214203:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.214213:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.214340:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.214373:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.214438:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.216936:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286400 00000100:00100000:3.0:1784047439.216952:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286400 00000100:00100000:2.0:1784047439.219521:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784047439.219545:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709286400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784047439.219588:0:91016:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784047439.219635:0:91016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784047439.219640:0:91016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784047439.219643:0:91016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784047439.219646:0:91016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784047439.219648:0:91016:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 121 00000100:00100000:2.0:1784047439.219794:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709286400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 260us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.219803:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784047439.219901:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784047439.219985:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047439.219997:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.220008:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047439.220017:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784047439.220019:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784047439.220022:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784047439.220055:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.220063:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.220071:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.220098:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.220129:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.220567:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.220686:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286528 00000100:00100000:3.0:1784047439.220692:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286528 00000100:00100000:3.0:1784047439.220731:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784047439.220751:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709286528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.220761:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047439.220775:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419400/0x4426598c0c774cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774ca7 expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.220798:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419400/0x4426598c0c774cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774ca7 expref: 14 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.220809:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419400/0x4426598c0c774cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774ca7 expref: 14 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.220817:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419400, rc 0) 00000100:00100000:3.0:1784047439.220853:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709286528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.220859:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784047439.221030:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.221044:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.221053:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.221116:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.221141:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.221167:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.221210:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286656 00000100:00100000:3.0:1784047439.221214:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286656 00000100:00100000:3.0:1784047439.221244:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784047439.221251:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709286656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.221401:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709286656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.221423:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784047439.221486:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.221514:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.221564:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.221592:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.221848:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286784 00000100:00100000:3.0:1784047439.221854:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286784 00000100:00100000:3.0:1784047439.221884:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784047439.221891:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709286784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.222779:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709286784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 886us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.222790:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784047439.225724:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047439.226878:0:91096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1784047439.227034:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1784047439.227061:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784047439.227074:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227085:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.227093:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1784047439.227095:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc355c000 from 1 10000000:01000000:3.0:1784047439.227097:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784047439.227136:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227144:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227154:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.227179:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.227268:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.227310:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047439.227408:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709286912 00000100:00100000:1.0:1784047439.227416:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709286912 00000100:00100000:1.0:1784047439.227470:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784047439.227480:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709286912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.227493:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047439.227512:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff29e00/0x4426598c0c774cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774cb5 expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.227545:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff29e00/0x4426598c0c774cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774cb5 expref: 15 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.227556:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff29e00/0x4426598c0c774cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774cb5 expref: 15 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.227564:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29e00, rc 0) 00000100:00100000:1.0:1784047439.227639:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709286912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047439.227646:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784047439.227801:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709286912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.227815:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227825:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.227839:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784047439.227843:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227848:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.227855:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784047439.227856:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc355c000 from 7 10000000:01000000:3.0:1784047439.227859:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784047439.227873:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227880:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.227886:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.227899:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.227933:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.227964:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047439.228389:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287040 00000100:00100000:1.0:1784047439.228395:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287040 00000100:00100000:1.0:1784047439.228436:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784047439.228444:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709287040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.228454:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047439.228464:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff28600/0x4426598c0c774cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774cc3 expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.228480:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff28600/0x4426598c0c774cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774cc3 expref: 16 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.228488:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff28600/0x4426598c0c774cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774cc3 expref: 16 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.228495:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28600, rc 0) 00000100:00100000:1.0:1784047439.228544:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709287040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047439.228560:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784047439.229385:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.229404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.229412:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.229487:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.229537:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.232800:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6aff00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.233041:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287168 00000100:00100000:3.0:1784047439.233050:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287168 00000100:00100000:3.0:1784047439.233142:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784047439.233154:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709287168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.233430:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709287168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.233440:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784047439.235419:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.235490:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.235567:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.235644:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6aff00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047439.235671:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287296 00000100:00100000:1.0:1784047439.235677:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287296 00000100:00100000:1.0:1784047439.235724:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784047439.235735:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709287296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.235849:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709287296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047439.235857:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784047439.235915:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047439.237801:0:91098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784047439.239936:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784047439.239973:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784047439.239984:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.239997:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047439.240008:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047439.240011:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 52 10000000:01000000:2.0:1784047439.240013:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047439.240049:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.240062:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.240073:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047439.240099:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.240164:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047439.240358:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc7b8d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.242396:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287424 00000100:00100000:3.0:1784047439.242410:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287424 00000100:00100000:2.0:1784047439.245024:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784047439.245038:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709287424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.245057:0:91016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047439.245076:0:91016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774cd1 expref: -99 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.245104:0:91016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774cd1 expref: 17 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.245115:0:91016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774cd1 expref: 17 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.245124:0:91016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1a00, rc 0) 00000100:00100000:2.0:1784047439.245268:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709287424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (5102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.245275:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784047439.248436:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.248463:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.248476:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.249359:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.249503:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047439.249565:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.249731:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287552 00000100:00100000:3.0:1784047439.249739:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287552 00000100:00100000:3.0:1784047439.249792:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784047439.249803:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709287552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.249949:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709287552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.249957:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784047439.250047:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.250086:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.250119:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047439.250145:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.250204:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287680 00000100:00100000:2.0:1784047439.250208:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287680 00000100:00100000:2.0:1784047439.250245:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784047439.250251:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709287680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.250427:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709287680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.250433:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784047439.250500:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047439.260172:0:91101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784047439.264820:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784047439.264864:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047439.264876:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.264889:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047439.266375:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784047439.266381:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784047439.266385:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784047439.266429:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.266441:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.266451:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.266477:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.266564:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.266627:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6aff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.266777:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287808 00000100:00100000:0.0:1784047439.266784:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287808 00000100:00100000:0.0:1784047439.266842:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784047439.266850:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709287808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047439.266862:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047439.266876:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b400/0x4426598c0c774ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774cdf expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.266898:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b400/0x4426598c0c774ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774cdf expref: 18 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.266908:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b400/0x4426598c0c774ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774cdf expref: 18 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.266916:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b400, rc 0) 00000100:00100000:0.0:1784047439.266964:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709287808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.266971:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784047439.267052:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.267066:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.267075:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.267138:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.267166:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.267197:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6aff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.267239:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709287936 00000100:00100000:0.0:1784047439.267243:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709287936 00000100:00100000:0.0:1784047439.267283:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047439.267290:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709287936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.267417:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709287936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.267425:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784047439.267562:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709287936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.267601:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.267675:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.267704:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6aff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.267805:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288064 00000100:00100000:0.0:1784047439.267810:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288064 00000100:00100000:0.0:1784047439.267839:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784047439.267845:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709288064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.271509:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709288064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3651us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.271525:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784047439.271758:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047439.273464:0:91104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1784047439.273732:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1784047439.273761:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784047439.273773:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.273786:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047439.273795:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784047439.273798:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccf756a000 from 7 10000000:01000000:0.0:1784047439.273801:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047439.273852:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.273861:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.273872:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047439.273900:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.273963:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047439.274011:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.274352:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288192 00000100:00100000:3.0:1784047439.274360:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288192 00000100:00100000:3.0:1784047439.274412:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784047439.274421:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709288192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.274434:0:91016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047439.274446:0:91016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418200/0x4426598c0c774cf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774ced expref: -99 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.274469:0:91016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418200/0x4426598c0c774cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774ced expref: 19 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.274480:0:91016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418200/0x4426598c0c774cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774ced expref: 19 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.274488:0:91016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418200, rc 0) 00000100:00100000:3.0:1784047439.274544:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709288192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.274552:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784047439.274759:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047439.274774:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.274783:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047439.274843:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.274871:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047439.274904:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.275171:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288320 00000100:00100000:3.0:1784047439.275176:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288320 00000100:00100000:3.0:1784047439.275196:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784047439.275202:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709288320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.275737:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709288320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 533us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.275747:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784047439.275797:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.275837:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.275878:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.275901:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.276196:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288448 00000100:00100000:2.0:1784047439.276202:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288448 00000100:00100000:2.0:1784047439.276240:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784047439.276249:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709288448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.277472:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709288448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1219us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.277482:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784047439.277735:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047439.278538:0:91105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784047439.278597:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784047439.278643:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784047439.278654:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.278664:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.278673:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047439.278676:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 52 10000000:01000000:3.0:1784047439.278678:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047439.278710:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.278718:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.278726:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.278746:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.278799:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.278845:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.278864:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288576 00000100:00100000:3.0:1784047439.278870:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288576 00000100:00100000:3.0:1784047439.278909:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784047439.278918:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709288576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.278929:0:91016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047439.278942:0:91016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418400/0x4426598c0c774d02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774cfb expref: -99 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.278963:0:91016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418400/0x4426598c0c774d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774cfb expref: 20 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.278973:0:91016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418400/0x4426598c0c774d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774cfb expref: 20 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.278981:0:91016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418400, rc 0) 00000100:00100000:3.0:1784047439.279018:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709288576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.279024:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784047439.279062:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.279074:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.279083:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.279125:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.279148:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.279173:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.279185:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288704 00000100:00100000:3.0:1784047439.279189:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288704 00000100:00100000:3.0:1784047439.281395:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784047439.281413:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709288704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.281620:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709288704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047439.281629:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784047439.282148:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.282204:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.282267:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.282306:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.282724:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288832 00000100:00100000:0.0:1784047439.282731:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288832 00000100:00100000:0.0:1784047439.282772:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784047439.282779:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709288832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.282875:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709288832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.282892:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784047439.282936:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047439.283867:0:91106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784047439.283935:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784047439.283961:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047439.283971:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.283983:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047439.284162:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784047439.284166:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1784047439.284169:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784047439.284203:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.284211:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.284220:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047439.284241:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.284556:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047439.284710:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.285054:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709288960 00000100:00100000:2.0:1784047439.285061:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709288960 00000100:00100000:2.0:1784047439.285112:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784047439.285122:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709288960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.285134:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047439.285148:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0a00/0x4426598c0c774d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774d09 expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.285171:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0a00/0x4426598c0c774d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774d09 expref: 21 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.285181:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0a00/0x4426598c0c774d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774d09 expref: 21 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.285189:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0a00, rc 0) 00000100:00100000:2.0:1784047439.285382:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709288960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.285399:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784047439.286839:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709288960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047439.286865:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047439.286876:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047439.286958:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.287003:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.287044:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.287351:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289088 00000100:00100000:0.0:1784047439.287357:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289088 00000100:00100000:0.0:1784047439.287412:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784047439.287421:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709289088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.287589:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709289088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.287598:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784047439.288193:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.288234:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047439.288359:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047439.288391:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa6af3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047439.288511:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289216 00000100:00100000:2.0:1784047439.288517:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289216 00000100:00100000:2.0:1784047439.288866:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784047439.288878:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709289216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.292374:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709289216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3488us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.292390:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784047439.292484:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047439.294146:0:91108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784047439.295070:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784047439.295102:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784047439.295114:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.295126:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047439.295136:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784047439.295139:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfe6b8800 from 7 10000000:01000000:2.0:1784047439.295142:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047439.295183:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.295191:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.295203:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047439.295230:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047439.295302:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047439.295350:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc7b8db40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.295359:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289344 00000100:00100000:0.0:1784047439.295369:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289344 00000100:00100000:0.0:1784047439.295426:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784047439.295437:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa39f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709289344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047439.295451:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047439.295466:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b600/0x4426598c0c774d1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774d17 expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.295488:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b600/0x4426598c0c774d1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774d17 expref: 22 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.295498:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b600/0x4426598c0c774d1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774d17 expref: 22 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.295507:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b600, rc 0) 00000100:00100000:0.0:1784047439.295565:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa39f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709289344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.295580:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784047439.295748:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.295763:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.295773:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.295837:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.295866:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.295894:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.295939:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289472 00000100:00100000:0.0:1784047439.295943:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289472 00000100:00100000:0.0:1784047439.295979:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784047439.295986:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcba91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709289472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.296094:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcba91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709289472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.296109:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784047439.296174:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.296204:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.296239:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.296274:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.296374:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289600 00000100:00100000:0.0:1784047439.296378:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289600 00000100:00100000:0.0:1784047439.296408:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784047439.296415:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcba93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709289600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.296499:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcba93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709289600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.296505:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784047439.296554:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047439.297854:0:91109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784047439.298056:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784047439.298078:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047439.298087:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.298098:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047439.298107:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784047439.298110:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047439.298112:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784047439.298147:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.298155:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.298164:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047439.298199:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.298560:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047439.299397:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe679cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047439.301192:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289728 00000100:00100000:3.0:1784047439.301204:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289728 00000100:00100000:2.0:1784047439.301520:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784047439.301542:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcba92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709289728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047439.301562:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047439.301594:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c774d2c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774d25 expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.301653:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c774d2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774d25 expref: 23 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.301666:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c774d2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774d25 expref: 23 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047439.301674:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a0c00, rc 0) 00000100:00100000:2.0:1784047439.301748:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcba92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709289728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047439.301754:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784047439.301923:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.301943:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.301953:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.301973:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784047439.301979:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.301986:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047439.301994:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784047439.301996:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:3.0:1784047439.301998:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784047439.302025:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.302032:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.302040:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.302060:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.302106:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.302144:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.302236:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289856 00000100:00100000:0.0:1784047439.302241:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289856 00000100:00100000:0.0:1784047439.302280:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784047439.302288:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcba91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709289856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047439.302295:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047439.302304:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24ac00/0x4426598c0c774d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c774d33 expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.302320:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24ac00/0x4426598c0c774d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774d33 expref: 24 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.302328:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24ac00/0x4426598c0c774d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774d33 expref: 24 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047439.302335:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24ac00, rc 0) 00000100:00100000:0.0:1784047439.302368:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcba91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709289856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047439.302374:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784047439.302513:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047439.302525:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.302545:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047439.302641:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047439.302665:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047439.302688:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00005840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047439.302806:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709289984 00000100:00100000:0.0:1784047439.302810:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709289984 00000100:00100000:0.0:1784047439.302833:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784047439.302839:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc750e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709289984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047439.302914:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc750e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709289984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (247us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047439.302929:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784047439.303013:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709289984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784047439.303042:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784047439.303047:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047439.303055:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.175348:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047440.196742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047440.196944:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446144 00000100:00100000:0.0:1784047440.196954:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446144 00000100:00100000:0.0:1784047440.197014:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:0.0:1784047440.197024:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc750c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+5:42435:x1870705689446144:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047440.197041:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047440.197060:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24be00/0x4426598c0c774d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2b4 expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047440.197090:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24be00/0x4426598c0c774d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2b4 expref: 6 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047440.197101:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24be00/0x4426598c0c774d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2b4 expref: 6 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047440.197110:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24be00, rc 0) 00000100:00100000:0.0:1784047440.197177:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc750c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689446144:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 153us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047440.197184:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:0.0:1784047440.208013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047440.211092:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446272 00000100:00100000:3.0:1784047440.211106:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446272 00000100:00100000:3.0:1784047440.211176:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:3.0:1784047440.211186:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc750dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689446272:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047440.211210:0:91020:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784047440.211235:0:91020:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047440.211239:0:91020:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784047440.211242:0:91020:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784047440.211244:0:91020:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784047440.211246:0:91020:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 121 00000100:00100000:3.0:1784047440.214164:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc750dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689446272:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 2966us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047440.214179:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:1.0:1784047440.226044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047440.226537:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446400 00000100:00100000:3.0:1784047440.226548:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446400 00000100:00100000:3.0:1784047440.226762:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:3.0:1784047440.226774:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+6:42435:x1870705689446400:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047440.226791:0:91015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047440.226811:0:91015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff418a00/0x4426598c0c774d48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2bb expref: -99 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.226840:0:91015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff418a00/0x4426598c0c774d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2bb expref: 7 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.226852:0:91015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff418a00/0x4426598c0c774d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2bb expref: 7 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.226861:0:91015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff418a00, rc 0) 00000100:00100000:3.0:1784047440.227312:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689446400:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 539us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047440.227321:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:0.0:1784047440.233780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047440.236717:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446528 00000100:00100000:2.0:1784047440.236734:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446528 00000100:00100000:2.0:1784047440.236873:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:2.0:1784047440.236885:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+7:42435:x1870705689446528:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047440.237083:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689446528:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 199us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047440.237092:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:0.0:1784047440.243723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047440.243904:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446656 00000100:00100000:3.0:1784047440.243969:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446656 00000100:00100000:0.0:1784047440.244235:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:0.0:1784047440.244247:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689446656:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047440.244455:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689446656:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 210us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047440.244472:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:1.0:1784047440.255762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047440.258870:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446784 00000100:00100000:3.0:1784047440.258915:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446784 00000100:00100000:2.0:1784047440.259587:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:2.0:1784047440.259651:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+8:42435:x1870705689446784:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047440.259674:0:91020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047440.259699:0:91020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec3a1e00/0x4426598c0c774d4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2c2 expref: -99 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047440.259884:0:91020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec3a1e00/0x4426598c0c774d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2c2 expref: 9 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047440.259898:0:91020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec3a1e00/0x4426598c0c774d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2c2 expref: 9 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047440.259910:0:91020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec3a1e00, rc 0) 00000100:00100000:2.0:1784047440.260001:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689446784:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 395us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047440.260010:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:1.0:1784047440.261684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047440.261777:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689446912 00000100:00100000:3.0:1784047440.261788:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689446912 00000100:00100000:3.0:1784047440.261852:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:3.0:1784047440.261862:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689446912:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047440.262041:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689446912:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 180us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047440.262050:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:0.0:1784047440.263815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047440.263980:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447040 00000100:00100000:1.0:1784047440.263993:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447040 00000100:00100000:1.0:1784047440.264100:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:1.0:1784047440.264111:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689447040:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047440.264300:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689447040:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 190us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047440.264319:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:2.0:1784047440.269119:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047440.269220:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447168 00000100:00100000:3.0:1784047440.269237:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447168 00000100:00100000:3.0:1784047440.269391:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:3.0:1784047440.269414:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+9:42435:x1870705689447168:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047440.269438:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047440.269464:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccff419600/0x4426598c0c774d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2c9 expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.269501:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccff419600/0x4426598c0c774d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2c9 expref: 10 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.269529:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccff419600/0x4426598c0c774d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2c9 expref: 10 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047440.269540:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccff419600, rc 0) 00000100:00100000:3.0:1784047440.269667:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689447168:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 257us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047440.269676:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:3.0:1784047440.272018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047440.272836:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447296 00000100:00100000:2.0:1784047440.272851:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447296 00000100:00100000:2.0:1784047440.272919:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:2.0:1784047440.272932:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cccc0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689447296:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047440.273093:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cccc0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aef96-772a-4ce2-a768-bea713505b5b+10:42435:x1870705689447296:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 163us (1086us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784047440.273103:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:2.0:1784047441.171181:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709290112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047441.171294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047441.172112:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290112 00000100:00100000:0.0:1784047441.172125:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290112 00000100:00100000:0.0:1784047441.172216:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:0.0:1784047441.172230:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709290112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047441.172278:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047441.172351:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709290112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047441.172359:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00080000:0.0:1784047441.172471:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047441.172490:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047441.172566:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709290112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047441.173752:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047441.173787:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709290240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047441.173890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047441.174025:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290240 00000100:00100000:1.0:1784047441.174034:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290240 00000100:00100000:1.0:1784047441.174101:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:1.0:1784047441.174111:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709290240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047441.174148:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047441.174203:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709290240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047441.174211:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:1.0:1784047441.174265:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709290240:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784047441.175190:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784047442.198127:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784047443.044221:0:91293:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784047443.219981:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047443.223509:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709290368:0@lo:400:kworker.0 00000100:00100000:1.0:1784047443.223628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047443.224009:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047443.224024:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047443.224028:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047443.224037:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047443.224062:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e9180 x1870705709290624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047443.224102:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047443.224106:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047443.224108:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047443.224112:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047443.224125:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9e57100 x1870705709290880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047443.224142:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047443.224145:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047443.224147:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047443.224151:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047443.224162:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9e54e00 x1870705709291136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047443.224237:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709290624:0@lo:38:kworker.0 00000100:00100000:2.0:1784047443.224288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.224312:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709290880:0@lo:38:kworker.0 00000100:00100000:2.0:1784047443.224334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.224351:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709291136:0@lo:38:kworker.0 00000100:00100000:2.0:1784047443.224422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.224483:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291136 00000100:00100000:2.0:1784047443.224490:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291136 00000100:00100000:2.0:1784047443.224524:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1784047443.224532:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709291136:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784047443.224559:0:8441:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99cbd0b6d800, cookie 0x4426598c0c774bc7 00010000:00080000:2.0:1784047443.224564:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff99cbd0b6d800 cur 3541 last 1784047437 00000004:00100000:2.0:1784047443.224583:0:8441:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784047443.224825:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccff3d4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047443.224886:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709291136:12345-0@lo:38:kworker.0 Request processed in 352us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047443.224894:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00080000:2.0:1784047443.224936:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:2.0:1784047443.224945:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1784047443.224949:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1784047443.224952:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:2.0:1784047443.224956:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc6531800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:2.0:1784047443.224959:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1784047443.227432:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709291264:0@lo:400:kworker.0 00000100:00100000:1.0:1784047443.227527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047443.227578:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047443.227586:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709290496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047443.227645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.228375:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709291136:0@lo:38:kworker.0 00000100:00100000:0.0:1784047443.229533:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291264 00000100:00100000:0.0:1784047443.229544:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291264 00000100:00100000:0.0:1784047443.229635:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1784047443.229646:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709291264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047443.229758:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709291264:12345-0@lo:400:kworker.0 Request processed in 114us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.229766:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1784047443.229793:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290368 00000100:00100000:0.0:1784047443.229797:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290368 00000100:00100000:0.0:1784047443.229826:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784047443.229833:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709290368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047443.229882:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709290368:12345-0@lo:400:kworker.0 Request processed in 49us (6255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.229889:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784047443.229929:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290624 00000100:00100000:0.0:1784047443.229934:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290624 00000100:00100000:0.0:1784047443.229958:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290880 00000100:00100000:0.0:1784047443.229962:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290880 00000100:00100000:0.0:1784047443.229984:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1784047443.229989:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709290624:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047443.230015:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3541 last 0 00000020:00000080:0.0:1784047443.230054:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c774d5d 00000004:00100000:0.0:1784047443.230071:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047443.230107:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99ccd897c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047443.230154:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709290624:12345-0@lo:38:kworker.0 Request processed in 163us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.230161:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1784047443.230175:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1784047443.230194:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709290880:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047443.230208:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3541 last 0 00000020:00000080:0.0:1784047443.230233:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4426598c0c774d64 00000004:00100000:0.0:1784047443.230240:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047443.230256:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99cbd0b6e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047443.230286:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870705709290880:12345-0@lo:38:kworker.0 Request processed in 106us (5951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.230292:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1784047443.230314:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290496 00000100:00100000:0.0:1784047443.230325:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290496 00000100:00100000:0.0:1784047443.230358:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:0.0:1784047443.230364:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709290496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047443.230391:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047443.230427:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709290496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.230434:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:0.0:1784047443.230508:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709290496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047443.230526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709291264:0@lo:400:kworker.0 00000100:00100000:0.0:1784047443.230537:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709290368:0@lo:400:kworker.0 00000100:00080000:0.0:1784047443.230576:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784047443.230634:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ccfa3e9180 x1870705709290624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047443.230648:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00080000:0.0:1784047443.231464:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99ccfa3e9180 x1870705709290624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047468 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047443.231474:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047443.231479:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047443.231483:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047443.231489:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709290624:0@lo:38:kworker.0 00010000:00080000:0.0:1784047443.231509:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9e57100 x1870705709290880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047443.231520:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:0.0:1784047443.232348:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99cbc9e57100 x1870705709290880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047468 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047443.232379:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047443.232383:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047443.232387:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047443.232392:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709290880:0@lo:38:kworker.0 00010000:00080000:1.0:1784047443.234350:0:91301:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1784047443.234357:0:91301:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1784047443.234364:0:91301:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1784047443.235080:0:91301:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1784047443.235141:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709291392:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784047443.235232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.235634:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291392 00000100:00100000:2.0:1784047443.235653:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291392 00000100:00100000:2.0:1784047443.235950:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1784047443.235961:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709291392:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784047443.235981:0:8441:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99ccfdd08380 x1870705709291392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:574/0 lens 224/0 e 0 to 0 dl 1784047454 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047443.235994:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709291392:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 36us (763us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047443.236001:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1784047443.236319:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709291520:0@lo:400:kworker.0 00000100:00100000:1.0:1784047443.236364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047443.236420:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047443.236425:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047443.236428:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047443.236436:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047443.236469:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9e56680 x1870705709291648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047443.236500:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784047443.236512:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047443.236514:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc7654800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047443.236519:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cbc7654800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047443.236531:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9e54700 x1870705709292032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047443.236559:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709290752:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.236602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.236651:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709291776:0@lo:400:kworker.0 00000100:00100000:2.0:1784047443.236857:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291520 00000100:00100000:2.0:1784047443.236862:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291520 00000100:00100000:2.0:1784047443.236910:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1784047443.236918:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709291520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.236999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.237023:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784047443.237029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709291008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.237053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.237072:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709291904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.237101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.237143:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709290752 00000100:00100000:3.0:1784047443.237147:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709290752 00000100:00100000:3.0:1784047443.237175:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291008 00000100:00100000:3.0:1784047443.237190:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291008 00000100:00100000:3.0:1784047443.237209:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1784047443.237215:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709290752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.237252:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709290752:12345-0@lo:400:kworker.0 Request processed in 37us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.237260:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1784047443.237467:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1784047443.237474:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709291008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.237515:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709291008:12345-0@lo:400:kworker.0 Request processed in 43us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.237522:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00010000:00080000:3.0:1784047443.237593:0:91042:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784047443.237599:0:91042:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:3.0:1784047443.237624:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.237628:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:3.0:1784047443.237634:0:91042:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:3.0:1784047443.237636:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.237648:0:91042:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689436672 t111669149704 from 192.168.204.40@tcp req@ffff99cd0047a300 x1870705689436672/t0(111669149704) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:569/0 lens 528/0 e 0 to 0 dl 1784047449 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047443.238133:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291776 00000100:00100000:3.0:1784047443.238138:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291776 00000100:00100000:3.0:1784047443.238166:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291904 00000100:00100000:3.0:1784047443.238169:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291904 00000100:00100000:3.0:1784047443.238256:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1784047443.238263:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709291776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.238305:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709291776:12345-0@lo:400:kworker.0 Request processed in 42us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.238311:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1784047443.238323:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1784047443.238330:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709291904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.238360:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709291904:12345-0@lo:400:kworker.0 Request processed in 30us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.238366:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1784047443.238550:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709291008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.238581:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709291904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.238629:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709290752:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.238643:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709291776:0@lo:400:kworker.0 00000100:00100000:3.0:1784047443.246027:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709291648:0@lo:38:kworker.0 00000100:00100000:3.0:1784047443.246124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.246176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709292032:0@lo:38:kworker.0 00000100:00100000:3.0:1784047443.246390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.246437:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709291648 00000100:00100000:3.0:1784047443.246445:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709291648 00000100:00100000:3.0:1784047443.246495:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292032 00000100:00100000:3.0:1784047443.246499:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292032 00000100:00100000:3.0:1784047443.246515:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1784047443.246522:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709291648:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047443.246598:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3541 last 0 00000020:00000080:3.0:1784047443.246661:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4426598c0c774d6b 00000004:00100000:3.0:1784047443.246779:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047443.246814:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99cbc7656000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047443.246865:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870705709291648:12345-0@lo:38:kworker.0 Request processed in 341us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.246873:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1784047443.246891:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1784047443.246895:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709292032:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047443.246908:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3541 last 0 00000020:00000080:3.0:1784047443.246928:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4426598c0c774d72 00000004:00100000:3.0:1784047443.246943:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047443.246957:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99cbc7652800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047443.246987:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709292032:12345-0@lo:38:kworker.0 Request processed in 90us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.246994:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00010000:00080000:3.0:1784047443.247046:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9e56680 x1870705709291648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047443.247063:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00080000:3.0:1784047443.252816:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99cbc9e56680 x1870705709291648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047468 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047443.252833:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784047443.252839:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784047443.252844:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784047443.252850:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709291648:0@lo:38:kworker.0 00010000:00080000:3.0:1784047443.252888:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9e54700 x1870705709292032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047443.252905:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:3.0:1784047443.252914:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784047443.252919:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784047443.252921:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7654800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784047443.252925:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709292032:0@lo:38:kworker.0 00000100:00100000:2.0:1784047443.253834:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709291520:12345-0@lo:400:kworker.0 Request processed in 16911us (17463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047443.253847:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00080000:2.0:1784047443.253893:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047443.253899:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047443.253903:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047443.254834:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709291520:0@lo:400:kworker.0 00000004:00080000:1.0:1784047443.256002:0:91042:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17902us 00010000:00010000:1.0:1784047443.298407:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.298432:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.298803:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.299548:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.299565:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.299585:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302065:0:91042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302079:0:91042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302094:0:91042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302101:0:91042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047443.302106:0:91042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302114:0:91042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302130:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce7ec2600) 00010000:00010000:1.0:1784047443.302134:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047443.302138:0:91042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.302145:0:91042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c774d79 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047443.302168:0:91042:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee8a4e9b reply state 0000000088da7e2b transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.305191:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.305209:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cce7ec2500) 00010000:00010000:1.0:1784047443.305213:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047443.305218:0:91042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784047443.305662:0:91042:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1784047443.305687:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047443.305690:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:1.0:1784047443.306472:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047443.306474:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000100:00100000:1.0:1784047443.310903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047443.310934:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689437184 00000100:00100000:1.0:1784047443.310943:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689437184 00000100:00100000:1.0:1784047443.310996:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1286 00000100:00100000:1.0:1784047443.311006:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689437184:12345-192.168.204.40@tcp:36:rm.0 00010000:00080000:1.0:1784047443.311025:0:68026:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:1.0:1784047443.311036:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689437184:12345-192.168.204.40@tcp:36:rm.0 Request processed in 32us (144us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047443.311043:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1286 00000020:00080000:1.0:1784047443.311060:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047443.311064:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:1.0:1784047443.311068:0:91042:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:1.0:1784047443.311071:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047443.311080:0:91042:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689437184 t111669149705 from 192.168.204.40@tcp req@ffff99cbc9c22a00 x1870705689437184/t0(111669149705) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:574/0 lens 512/0 e 0 to 0 dl 1784047454 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784047443.311157:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311172:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311184:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311196:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311215:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311222:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311294:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311302:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311309:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311515:0:91042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311522:0:91042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311530:0:91042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311535:0:91042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047443.311540:0:91042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.311548:0:91042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312817:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff99ccef89e600) 00010000:00010000:1.0:1784047443.312872:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784047443.312879:0:91042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312889:0:91042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28e00/0x4426598c0c774d95 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312916:0:91042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312923:0:91042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312930:0:91042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312936:0:91042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047443.312939:0:91042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312946:0:91042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312956:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccef89e700) 00010000:00010000:1.0:1784047443.312958:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047443.312961:0:91042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.312966:0:91042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774d87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047443.312978:0:91042:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000108cf0c reply state 0000000022f704e0 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.313001:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.313008:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cce7ec2500) 00010000:00010000:1.0:1784047443.313011:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047443.313014:0:91042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784047443.313104:0:91042:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784047443.313235:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047443.313240:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:1.0:1784047443.313244:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047443.313246:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000001:00080000:0.0:1784047443.316387:0:91009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149704 is committed 00010000:00010000:1.0:1784047443.316533:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.316546:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.316553:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.316570:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047443.317197:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.317208:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.317227:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cce7ec2500) 00010000:00010000:1.0:1784047443.317230:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047443.317248:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.317255:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774d80 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047443.323101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047443.323231:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438592 00000100:00100000:3.0:1784047443.323243:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438592 00000100:00100000:3.0:1784047443.323340:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1287 00000100:00100000:3.0:1784047443.323351:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689438592:12345-192.168.204.40@tcp:36:dd.0 00010000:00080000:3.0:1784047443.323379:0:66220:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:3.0:1784047443.323399:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689438592:12345-192.168.204.40@tcp:36:dd.0 Request processed in 50us (305us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047443.323408:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1287 00000020:00080000:3.0:1784047443.328575:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.328586:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:3.0:1784047443.328599:0:91042:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149704) 00000020:00080000:3.0:1784047443.328616:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.328633:0:91042:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689438592 t111669149708 from 192.168.204.40@tcp req@ffff99cd00d9f100 x1870705689438592/t0(111669149708) o36->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:574/0 lens 488/0 e 0 to 0 dl 1784047454 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784047443.329167:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.329260:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.329276:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047443.329331:0:91042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:3.0:1784047443.329356:0:91042:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000024e1a99 reply state 00000000627e240d transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.329370:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.329379:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:3.0:1784047443.329382:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047443.329393:0:91042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784047443.330079:0:91042:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784047443.330090:0:91042:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1784047443.330103:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.330106:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:3.0:1784047443.330110:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.330112:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:0.0:1784047443.348369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047443.352315:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689438976 00000100:00100000:3.0:1784047443.352331:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689438976 00000100:00100000:3.0:1784047443.352465:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1288 00000100:00100000:3.0:1784047443.352477:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689438976:12345-192.168.204.40@tcp:101:dd.0 00010000:00080000:3.0:1784047443.352504:0:67153:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1784047443.352519:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689438976:12345-192.168.204.40@tcp:101:dd.0 Request processed in 45us (4162us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047443.352527:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1288 00000020:00080000:3.0:1784047443.354517:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.354529:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:3.0:1784047443.354534:0:91042:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:3.0:1784047443.354541:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.354557:0:91042:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689438976 t111669149709 from 192.168.204.40@tcp req@ffff99cd00d9c700 x1870705689438976/t0(111669149709) o101->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:574/0 lens 640/0 e 0 to 0 dl 1784047454 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1784047443.354592:0:91042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047443.354652:0:91042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774da3 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae283 expref: -99 pid: 91042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.354715:0:91042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c774daa lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.354744:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c774daa lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.354756:0:91042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c774daa lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047443.355023:0:91042:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x4b1:0x0], count =625 00000004:00080000:3.0:1784047443.355028:0:91042:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x4b1:0x0]+625 in llog 00000004:00080000:3.0:1784047443.355063:0:91042:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x722:0x0], index 0: 0 00000004:00080000:3.0:1784047443.355071:0:91042:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x723:0x0], index 1: 0 00010000:00010000:3.0:1784047443.355174:0:91042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c774daa lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 14 pid: 91042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.355184:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:3.0:1784047443.355187:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784047443.355203:0:91042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774da3 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 14 pid: 91042 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.355475:0:91042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c774daa lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 13 pid: 91042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.355514:0:91042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:3.0:1784047443.355517:0:91042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1784047443.355520:0:91042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f000, rc 0) 00010000:00080000:3.0:1784047443.355671:0:91042:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784047443.355692:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.355695:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:3.0:1784047443.355699:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.355707:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:0.0:1784047443.363979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047443.364947:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447424 00000100:00100000:3.0:1784047443.364959:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447424 00000100:00100000:3.0:1784047443.365015:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1270 00000100:00100000:3.0:1784047443.365026:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+13:2398:x1870705689447424:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784047443.365051:0:66221:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cd00d9c380 x1870705689447424/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:574/0 lens 224/0 e 0 to 0 dl 1784047454 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047443.365069:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+13:2398:x1870705689447424:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 Request processed in 47us (1099us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047443.365076:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1270 00000020:00080000:3.0:1784047443.365096:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.365100:0:91042:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:3.0:1784047443.365103:0:91042:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1784047443.365106:0:91042:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047443.365113:0:91042:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784047443.365115:0:91042:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1784047443.365229:0:91042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:3.0:1784047443.366599:0:91009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00100000:3.0:1784047443.366624:0:91009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784047443.366642:0:91009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00010000:00010000:0.0:1784047443.366706:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366719:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366726:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366732:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc1a764f0) 00000001:00080000:3.0:1784047443.366735:0:91042:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1784047443.366737:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366744:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366762:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047443.366766:0:91042:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:0.0:1784047443.366768:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774d8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047443.366780:0:91042:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99ccfdd08380 x1870705709291392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:574/0 lens 224/0 e 0 to 0 dl 1784047454 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047443.366807:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366812:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366817:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366822:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047443.366824:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366830:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366841:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:0.0:1784047443.366844:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047443.366847:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.366852:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccff418000/0x4426598c0c774d9c lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047443.367145:0:91042:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.40@tcp: req@ffff99cd00d9c380 x1870705689447424/t0(0) o400->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:574/0 lens 224/0 e 0 to 0 dl 1784047454 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047443.367199:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784047443.367207:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99cbc79f3800 x1870705709291392/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047459 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784047443.367220:0:91042:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1784047443.367224:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99cbc79f3800 x1870705709291392/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047459 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047443.367231:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047443.367247:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047443.367252:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709291392:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784047443.381082:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709292160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047443.381153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047443.381487:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292160 00000100:00100000:0.0:1784047443.381496:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292160 00000100:00100000:0.0:1784047443.381551:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1784047443.381561:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709292160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047443.381871:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047443.381927:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709292160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 367us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.381935:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:1.0:1784047443.382110:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709292160:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1784047443.410361:0:91042:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc914831be10 00100000:10000000:3.0:1784047443.410376:0:91042:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784047443.420219:0:91028:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x722:0x0] 00000100:00100000:0.0:1784047443.420272:0:91028:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91028:1870705709292288:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784047443.420343:0:91028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047443.420378:0:91028:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047443.420670:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292288 00000100:00100000:0.0:1784047443.420677:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292288 00000100:00100000:0.0:1784047443.420737:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976 00000100:00100000:0.0:1784047443.420747:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:91028:x1870705709292288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784047443.420778:0:8824:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -31 00002000:02000040:0.0:1784047443.420782:0:8824:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1827 to 0x280000401:1857) 00000004:00080000:3.0:1784047443.420801:0:91030:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x723:0x0] 00000100:00100000:3.0:1784047443.420827:0:91030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91030:1870705709292416:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784047443.420860:0:91030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047443.420918:0:91030:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047443.420950:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292416 00000100:00100000:1.0:1784047443.420955:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292416 00000100:00100000:1.0:1784047443.421021:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977 00000100:00100000:1.0:1784047443.421029:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:91030:x1870705709292416:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784047443.421044:0:26185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -30 00002000:02000040:1.0:1784047443.421048:0:26185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1828 to 0x2c0000401:1857) 00002000:00010000:0.0:1784047443.434787:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.434806:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434829:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.434834:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.434858:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434876:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434887:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434895:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434917:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047443.434930:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.434936:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434945:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.434949:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434957:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434973:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.434991:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554b5804/0x4426598c0c774db1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.435013:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.435015:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.435016:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.439003:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.439021:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.439042:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.439048:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.439055:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.439069:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.439090:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.439098:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.439129:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.441173:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.441186:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441201:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.441206:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.441213:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441226:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441236:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441245:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441282:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784047443.441335:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.441341:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441350:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.441353:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.441357:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441379:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441388:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441396:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441411:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784047443.441421:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784047443.441427:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441435:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.441445:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441466:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441484:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441492:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000738245e2/0x4426598c0c774db8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441512:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047443.441516:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441523:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.441526:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441533:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441544:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441552:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000620aa5e3/0x4426598c0c774dbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441719:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047443.441724:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441732:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a1600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.441735:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441744:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441755:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441763:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4fcb6b5/0x4426598c0c774dc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441775:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.441777:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.441779:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.441827:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.441833:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441841:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.441850:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.441855:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441866:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441874:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441882:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441898:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047443.441906:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047443.441910:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441917:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.441920:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441927:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441937:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441956:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af366002/0x4426598c0c774dcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.441971:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.441973:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.441975:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.442020:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.442025:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442033:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.442036:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.442041:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442050:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442059:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442067:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442081:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047443.442087:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047443.442097:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442104:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.442107:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442116:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442127:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442135:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb33982/0x4426598c0c774dd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442148:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.442150:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.442152:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.442193:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.442199:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442207:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.442210:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.442215:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442235:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442243:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442251:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442263:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047443.442269:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047443.442273:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442280:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.442283:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442291:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442302:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442310:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c774ddb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442330:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.442331:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.442333:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.442490:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.442589:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.442860:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.442866:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442875:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.442878:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.442882:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442891:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442899:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442906:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.442995:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.443037:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.443043:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.443062:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.443065:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.443069:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.443078:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.443085:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.443091:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444171:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047443.444182:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444203:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.444207:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444216:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444232:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444241:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c774de2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444264:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.444268:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444286:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.444289:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444296:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444306:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444314:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.444315:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.444317:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784047443.444433:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784047443.444500:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.444507:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c774de9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.444694:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.444700:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.444710:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.444713:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.444719:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.444739:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.444748:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.444756:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444800:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.444806:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444813:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.444817:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444825:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444836:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.444851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.444852:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.444854:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.444891:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.444896:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c774df0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.444910:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.444952:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.444958:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.444967:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.444969:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.444973:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.444982:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445002:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445009:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445059:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.445147:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.445153:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445160:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.445163:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.445167:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445176:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445184:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445254:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445298:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047443.445303:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445309:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.445312:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445319:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445330:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445336:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c774df7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445350:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.445353:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445359:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.445379:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445386:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445398:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445406:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.445407:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.445409:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.445511:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.445516:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c774dfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.445570:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047443.445578:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.445701:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445709:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.445712:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.445716:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445724:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445731:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445737:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445792:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.445836:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.445840:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445854:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.445857:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.445861:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445870:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445878:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.445884:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445915:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047443.445921:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445928:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.445932:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445939:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445950:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445957:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c774e05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445979:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.445983:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.445989:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.445993:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.446001:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.446012:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.446019:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.446020:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.446022:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.446051:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.446056:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c774e0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.446108:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.446113:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446121:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.446124:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.446128:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446144:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446151:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446159:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446181:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047443.446200:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.446207:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446217:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.446221:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446229:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446241:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446249:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.446272:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.446274:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.446278:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.446280:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.446350:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.446355:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446437:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.446440:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.446444:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446461:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446469:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446487:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446507:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.446549:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.446554:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446567:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.446571:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1784047443.446590:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.446597:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446676:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446687:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446695:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446701:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446781:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047443.446801:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.446806:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.446811:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.446827:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.446839:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.446843:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.446865:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446868:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.446878:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.446881:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446884:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446904:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446912:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.446920:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446946:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047443.446952:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446961:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.446961:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047443.446965:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.446969:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.446981:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.446983:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.446989:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447003:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447003:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447028:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c774e1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447032:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447044:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047443.447048:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c774e21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447050:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447070:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.447077:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.447082:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447083:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447105:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.447107:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447110:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447128:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447132:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.447143:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447146:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.447150:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.447153:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.447157:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.447161:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.447163:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.447281:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047443.447287:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.447322:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.447329:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c774e2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.447406:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.447412:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.447420:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.447424:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.447428:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.447458:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.447467:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.447474:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447558:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.447563:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447571:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.447692:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447701:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447711:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447719:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.447726:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.447728:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.447898:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.447904:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdf5ce6a/0x4426598c0c774e36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.447968:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.448102:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.448318:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.448325:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448333:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.448336:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.448341:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448350:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448435:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448441:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448498:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.448541:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.448545:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448553:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.448555:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.448559:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448567:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448585:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.448591:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449069:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047443.449075:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449084:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.449088:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449096:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449110:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449117:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3f4676/0x4426598c0c774e3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449131:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.449135:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449141:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.449143:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449163:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449174:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.449182:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.449183:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.449185:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.449262:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.449268:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c0a78e/0x4426598c0c774e44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.449330:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.449335:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449343:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.449346:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.449350:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449358:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449429:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449438:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449493:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.449540:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.449551:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449567:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.449570:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.449585:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449594:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449602:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.449628:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047443.450107:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.450115:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.450127:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.450130:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.450134:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.450145:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.450166:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.450173:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453787:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047443.453800:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453814:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.453819:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453830:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453852:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453859:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099f0761d/0x4426598c0c774e4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453903:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047443.453907:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453914:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.453917:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453924:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453932:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453939:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.453943:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453950:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.453953:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453960:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453980:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.453989:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.453991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.453993:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.454159:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.454167:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000808d3352/0x4426598c0c774e52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.454301:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.454307:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454320:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.454324:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.454331:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454350:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454359:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454490:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454513:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.454551:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.454556:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454565:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.454568:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047443.454633:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047443.454641:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.454650:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.454670:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.454671:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.454682:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.454697:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454703:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.454705:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000715cf9c2/0x4426598c0c774e60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454729:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454740:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.454743:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.454750:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.454752:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.454755:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.454764:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454808:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.454843:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.454848:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454856:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.454859:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.454863:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454872:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454879:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454887:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454907:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784047443.454941:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.454945:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454959:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.454962:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.454967:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454976:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454984:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.454991:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455003:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1784047443.455037:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.455041:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455048:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.455051:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.455054:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455062:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455080:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455087:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455096:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1784047443.455128:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.455132:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455139:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.455142:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.455145:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455154:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455163:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455170:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455203:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1784047443.455277:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.455283:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455284:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784047443.455293:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455295:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.455302:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.455311:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455312:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.455318:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455329:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455332:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455344:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455351:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455354:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455369:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca0a96e1/0x4426598c0c774e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455379:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1784047443.455391:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784047443.455396:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455402:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.455406:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.455412:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047443.455415:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455418:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455435:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:1.0:1784047443.455436:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455458:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047443.455461:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8911dd2/0x4426598c0c774e6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455465:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455479:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784047443.455483:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455484:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455498:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455513:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047443.455516:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455525:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.455530:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784047443.455540:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455552:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455560:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051ca19e/0x4426598c0c774e75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784047443.455565:0:8824:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1826 00010000:00010000:1.0:1784047443.455575:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047443.455580:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455587:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.455590:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455597:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455628:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455637:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfae3f5b/0x4426598c0c774e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455769:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047443.455774:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455782:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.455786:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455794:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047443.455798:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:91028:x1870705709292288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 35047us (35451us total) trans 0 rc 0/0 00010000:00010000:1.0:1784047443.455811:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047443.455816:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976 00010000:00010000:1.0:1784047443.455825:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c774e83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455840:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047443.455844:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455850:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.455854:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455874:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047443.455884:0:91028:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91028:1870705709292288:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1784047443.455887:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455897:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359fe1ee/0x4426598c0c774e8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047443.455905:0:91028:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x722:0x0] 00010000:00010000:1.0:1784047443.455912:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047443.455916:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455923:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.455926:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455934:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455943:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455952:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bef096da/0x4426598c0c774e91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.455978:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.455981:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047443.455982:0:91028:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91028:1870705709292672:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1784047443.455984:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047443.456002:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709292544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047443.456037:0:91028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047443.456054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.456068:0:91028:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047443.456091:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292672 00000100:00100000:2.0:1784047443.456096:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292672 00000100:00100000:1.0:1784047443.456105:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292544 00000100:00100000:1.0:1784047443.456111:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292544 00000100:00100000:2.0:1784047443.456137:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4978 00000100:00100000:1.0:1784047443.456147:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:2.0:1784047443.456163:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:91028:x1870705709292672:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784047443.456164:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709292544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047443.456199:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00002000:00080000:2.0:1784047443.456207:0:26187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00000100:00100000:1.0:1784047443.456241:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709292544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047443.456250:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:1.0:1784047443.456291:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709292544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784047443.456309:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.456315:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.456651:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784047443.456824:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.457368:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c774e59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1784047443.457437:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1784047443.457550:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.457557:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457569:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.457574:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.457580:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457592:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457602:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457791:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457811:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047443.457859:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.457866:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457874:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.457878:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.457882:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457892:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457900:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457908:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457922:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047443.457966:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.457972:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.457985:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.457988:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.457993:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458004:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458012:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458019:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458031:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047443.458080:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.458085:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458092:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.458095:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.458099:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458108:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458127:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458135:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458144:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784047443.458194:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.458200:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458208:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.458210:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.458214:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458223:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458232:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458238:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458478:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047443.458486:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458495:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ae00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.458500:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458509:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458525:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458532:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c774e98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458547:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047443.458550:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458563:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.458566:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458619:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784047443.458662:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458676:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458683:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c774e9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458695:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047443.458698:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458705:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24aa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.458708:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458716:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458725:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458738:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c774ea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458753:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047443.458756:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458763:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.458767:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458775:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458786:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458793:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c774ead lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458805:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.458808:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458814:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.458823:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458831:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458842:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458849:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096235f10/0x4426598c0c774eb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.458864:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.458867:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.458869:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.458879:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.458917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.458923:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.458927:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047443.458958:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.458964:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458973:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.458976:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.458980:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458989:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.458998:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459005:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459023:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047443.459072:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.459079:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459087:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.459096:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.459101:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459110:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459118:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459126:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459139:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784047443.459161:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:91028:x1870705709292672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3003us (3122us total) trans 4294968754 rc 0/0 00000100:00100000:2.0:1784047443.459173:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4978 00002000:00010000:0.0:1784047443.459178:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.459184:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459192:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.459195:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.459200:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459209:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459218:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459231:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459261:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784047443.459275:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047443.459282:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459290:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.459294:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047443.459303:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047443.459304:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459312:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459321:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459323:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.459327:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.459337:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459341:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c774ebb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459355:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459364:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047443.459366:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459370:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459382:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459385:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.459391:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459399:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047443.459402:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459416:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459424:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c774ec2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047443.459434:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047443.459438:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047443.459441:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459444:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459475:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.459479:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.459483:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047443.459488:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.459490:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459499:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459510:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459518:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074f8c12c/0x4426598c0c774ec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459530:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.459533:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459541:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.459544:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459551:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459560:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459566:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7424b0f/0x4426598c0c774ed0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.459583:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.459585:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.459587:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.459593:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.459668:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047443.459990:0:91028:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91028:1870705709292672:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784047443.460011:0:91028:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00010000:00010000:1.0:1784047443.460029:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.460318:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460328:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460335:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460385:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047443.460456:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.460463:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460472:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.460475:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.460480:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460489:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460522:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.460530:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465524:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047443.465541:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465574:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.465579:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465591:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465627:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465635:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c774ed7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465838:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047443.465843:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465851:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.465855:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465863:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465874:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.465886:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.465888:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.465890:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.467326:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.467330:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047443.467341:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066057cc9/0x4426598c0c774ede lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047443.467504:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.467511:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.467803:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.467810:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.467817:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.467900:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.467911:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.467937:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.467999:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047443.468053:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.468058:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468067:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.468070:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.468075:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468084:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468092:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468098:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468128:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047443.468136:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468143:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.468148:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468157:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468171:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468179:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c774ee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468197:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.468200:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468229:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.468233:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468240:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468250:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.468258:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.468260:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.468262:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.468497:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047443.468502:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c774eec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.468568:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047443.468810:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.468815:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468888:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.468892:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.468896:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468907:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468914:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468921:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468940:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047443.468978:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.468983:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.468989:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.468991:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.469003:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469012:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469019:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469025:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469046:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047443.469086:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.469092:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469099:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.469102:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.469106:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469113:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469121:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469137:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469189:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047443.469243:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.469249:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469257:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.469260:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.469264:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469272:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469280:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.469287:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469430:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047443.469436:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469444:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.469456:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469464:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469477:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469493:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bcae0b/0x4426598c0c774ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469511:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047443.469514:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469532:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.469536:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469543:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469554:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469560:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e4a5f3a/0x4426598c0c774efa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469573:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047443.469576:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469582:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff418000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.469601:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469630:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469641:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469648:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000756559f3/0x4426598c0c774f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469661:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.469664:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469670:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbda00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.469673:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469681:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469689:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.469696:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.469703:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.469705:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.469905:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.471077:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047443.471088:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd21c5cc/0x4426598c0c774f08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.471338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047443.471424:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047443.471431:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.471445:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:0.0:1784047443.471462:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047443.471469:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.471483:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.471494:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.471502:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.471599:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.471628:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.471638:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.471642:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.471652:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.471668:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.471726:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.471729:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.471730:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.471998:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784047443.472004:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c774f0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472360:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784047443.472428:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.472433:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472440:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.472442:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.472445:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472470:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472483:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472490:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472636:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.472746:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.472751:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472760:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.472763:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.472767:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472775:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472783:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472790:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472793:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.472798:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472806:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.472810:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472847:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.472890:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047443.472891:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472895:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472903:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.472910:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.472914:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472917:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472923:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472925:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007ce7ad8/0x4426598c0c774f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472931:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.472938:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472942:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.472945:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472952:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.472955:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472962:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.472967:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.472972:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.472973:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472980:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f044eff2/0x4426598c0c774f1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.472981:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.472985:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472991:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.472991:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.472993:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.472999:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.473002:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.473009:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.473011:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.473012:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.473063:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.473068:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000507feb1e/0x4426598c0c774f24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.473117:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.473122:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473129:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.473132:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.473136:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473144:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473157:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473164:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.473193:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047443.473199:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.473205:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047443.473214:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.473223:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.473234:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.473241:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.473243:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047443.473244:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.473800:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.473807:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098adb28b/0x4426598c0c774f2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.473884:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.473889:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473898:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.473901:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.473905:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473914:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473922:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.473942:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.474029:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.474034:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.474052:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.474056:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.474063:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.474074:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.474081:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.474083:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.474085:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.474118:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.474123:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000127f4944/0x4426598c0c774f32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.474171:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.474186:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474194:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.474197:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.474200:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474209:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047443.474273:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.474396:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474404:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474470:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.474513:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.474518:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474544:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.474547:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.474551:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474560:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474568:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.474575:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.474984:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047443.474990:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.474998:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.475003:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475012:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475024:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475032:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95e852f/0x4426598c0c774f39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475046:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047443.475049:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475056:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047443.475059:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475067:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475084:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047443.475092:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.475094:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047443.475096:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.475166:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.475182:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa9ebbd/0x4426598c0c774f40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.475376:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.475382:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475399:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.475402:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.475407:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475418:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475426:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475434:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475490:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784047443.475532:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.475537:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475545:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.475548:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.475552:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475560:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475578:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.475596:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475746:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047443.475752:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475760:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.475764:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475772:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475785:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475799:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2eb9e5/0x4426598c0c774f47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475813:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.475817:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475958:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.475961:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475970:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475981:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.475990:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.475991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.475994:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047443.476044:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784047443.476050:0:26185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfae3f5b/0x4426598c0c774f4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047443.476098:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047443.476104:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.476112:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=3541s v=(0 0) 00010000:00010000:2.0:1784047443.476116:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047443.476120:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.476129:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.476138:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.476155:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047443.476182:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1784047443.476210:0:26185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1827 00000100:00100000:2.0:1784047443.476465:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:91030:x1870705709292416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 55432us (55599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047443.476475:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977 00010000:00010000:0.0:1784047443.476538:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047443.476543:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.476552:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047443.476560:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.476569:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.476579:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.476597:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000051ca19e/0x4426598c0c774f55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047443.476632:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.476634:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047443.476635:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047443.476773:0:91030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91030:1870705709292416:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784047443.476788:0:91030:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x723:0x0] 00000100:00100000:2.0:1784047443.476875:0:91030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91030:1870705709292928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784047443.476910:0:91030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.476934:0:91030:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047443.477029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709292800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047443.477060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047443.477126:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292800 00000100:00100000:2.0:1784047443.477133:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292800 00000100:00100000:0.0:1784047443.477514:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1784047443.477526:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709292800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047443.477556:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047443.477629:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709292800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047443.477636:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1784047443.477670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709292800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784047443.477811:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047443.477909:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709292928 00000100:00100000:1.0:1784047443.477914:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709292928 00000100:00100000:1.0:1784047443.477943:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979 00000100:00100000:1.0:1784047443.477950:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:91030:x1870705709292928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784047443.477978:0:26183:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00010000:00010000:0.0:1784047443.478891:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047443.480030:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:91030:x1870705709292928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2076us (3114us total) trans 4294968753 rc 0/0 00000100:00100000:1.0:1784047443.480041:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979 00000100:00100000:2.0:1784047443.480114:0:91030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91030:1870705709292928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784047443.480130:0:91030:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00000100:00100000:2.0:1784047443.593291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047443.593380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047443.593419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047443.593464:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447936 00000100:00100000:2.0:1784047443.593473:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447936 00000100:00100000:2.0:1784047443.593538:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2546 00000100:00100000:2.0:1784047443.593551:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689447936:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047443.594113:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447680 00000100:00100000:1.0:1784047443.594118:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447680 00000100:00100000:1.0:1784047443.594158:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1271 00000100:00100000:1.0:1784047443.594165:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689447680:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047443.594248:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:2402:x1870705689447680:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 83us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047443.594267:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1271 00000100:00100000:1.0:1784047443.594326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047443.594435:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447808 00000100:00100000:1.0:1784047443.594441:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447808 00000100:00100000:1.0:1784047443.594481:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2547 00000100:00100000:1.0:1784047443.594487:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689447808:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047443.594534:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689447808:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 46us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047443.594540:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2547 00000100:00100000:3.0:1784047443.594795:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689447552 00000100:00100000:3.0:1784047443.594800:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689447552 00000100:00100000:3.0:1784047443.594835:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:3.0:1784047443.594843:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689447552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047443.594874:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2402:x1870705689447552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047443.594881:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00080000:3.0:1784047443.594929:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047443.594934:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047443.594936:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047443.595377:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689447936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1828us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047443.595385:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2546 00000001:00100000:1.0:1784047443.736493:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:0.0:1784047444.073150:0:91348:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784047444.073365:0:91348:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047444.243061:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784047445.004345:0:91398:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784047445.005060:0:91398:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047445.268053:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047446.291009:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047446.291037:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709293056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047446.291168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047446.291423:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293056 00000100:00100000:0.0:1784047446.291431:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293056 00000100:00100000:0.0:1784047446.291500:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1784047446.291511:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709293056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047446.291543:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047446.291589:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709293056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047446.291596:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00080000:3.0:1784047446.291723:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047446.291766:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709293056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047446.299807:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709293184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047446.299942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047446.300560:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293184 00000100:00100000:0.0:1784047446.300570:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293184 00000100:00100000:0.0:1784047446.300672:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1784047446.300684:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709293184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047446.300716:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784047446.300819:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047446.310146:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709293184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9450us (10189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047446.310172:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:1.0:1784047446.312900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709293184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047447.244731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047447.250717:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448064 00000100:00100000:2.0:1784047447.250733:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448064 00000100:00080000:3.0:1784047447.250842:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047447.250856:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1289 00000100:00100000:2.0:1784047447.250868:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:69852:x1870705689448064:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047447.250890:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047447.250932:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47000/0x4426598c0c774f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2d0 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047447.251020:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047447.251037:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047447.251053:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047447.251108:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047447.251112:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047447.251150:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047447.251176:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47000/0x4426598c0c774f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047447.251216:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047447.251225:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:2.0:1784047447.251227:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047447.251231:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47800, rc 0) 00000100:00100000:2.0:1784047447.251305:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:69852:x1870705689448064:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 440us (6583us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047447.251313:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1289 00000100:00100000:1.0:1784047447.261789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047447.262006:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448192 00000100:00100000:3.0:1784047447.262017:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448192 00000100:00100000:3.0:1784047447.262084:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1290 00000100:00100000:3.0:1784047447.262109:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:69852:x1870705689448192:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047447.262254:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:3.0:1784047447.262337:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:69852:x1870705689448192:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 229us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047447.262345:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1290 00000100:00100000:1.0:1784047447.270773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047447.270863:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448320 00000100:00100000:0.0:1784047447.270872:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448320 00000100:00100000:0.0:1784047447.270936:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1291 00000100:00100000:0.0:1784047447.270945:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:69852:x1870705689448320:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047447.270982:0:68026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047447.271062:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:69852:x1870705689448320:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047447.271067:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1291 00000100:00080000:3.0:1784047447.272368:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047447.275429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047447.275683:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448448 00000100:00100000:0.0:1784047447.275694:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448448 00000100:00100000:0.0:1784047447.275775:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2080 00000100:00100000:0.0:1784047447.275787:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:69852:x1870705689448448:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047447.275825:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1784047447.275938:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047447.276107:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:69852:x1870705689448448:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 321us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047447.276116:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2080 00000100:00100000:2.0:1784047447.285334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047447.285582:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448576 00000100:00100000:0.0:1784047447.285603:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448576 00000100:00100000:0.0:1784047447.285717:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2081 00000100:00100000:0.0:1784047447.285734:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+7:69852:x1870705689448576:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047447.285770:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047447.285895:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+7:69852:x1870705689448576:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 168us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047447.285903:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2081 00000100:00080000:3.0:1784047447.286339:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784047447.315400:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047448.338889:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709293312:0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.338974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047448.339117:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293312 00000100:00100000:0.0:1784047448.339125:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293312 00000100:00100000:1.0:1784047448.339145:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709293696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.339184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047448.339194:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784047448.339206:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709293312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.339230:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709293440:0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.339264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047448.339290:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047448.339295:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709293568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.339349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047448.339390:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293696 00000100:00100000:1.0:1784047448.339395:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293696 00000100:00100000:1.0:1784047448.339433:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293440 00000100:00100000:1.0:1784047448.339436:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293440 00000100:00100000:1.0:1784047448.342077:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293568 00000100:00100000:1.0:1784047448.342091:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293568 00000100:00100000:1.0:1784047448.342124:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1784047448.342138:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709293696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.342243:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709293696:12345-0@lo:400:kworker.0 Request processed in 110us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047448.342250:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1784047448.342268:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1784047448.342275:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709293440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.342321:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709293440:12345-0@lo:400:kworker.0 Request processed in 46us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047448.342328:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1784047448.342339:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1784047448.342346:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709293568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.342388:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709293568:12345-0@lo:400:kworker.0 Request processed in 43us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047448.342395:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00080000:1.0:1784047448.342429:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047448.342434:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047448.342555:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709293696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.342602:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709293568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.342653:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709293440:0@lo:400:kworker.0 00000100:00100000:0.0:1784047448.353444:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709293312:12345-0@lo:400:kworker.0 Request processed in 14224us (14453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047448.353461:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1784047448.354065:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047448.354075:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047448.354093:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709293824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047448.354347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047448.354400:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293824 00000100:00100000:0.0:1784047448.354407:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293824 00000100:00100000:0.0:1784047448.354451:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1784047448.354458:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709293824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047448.354490:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047448.354541:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709293824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047448.354547:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1784047448.354589:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709293824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047448.355662:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709294208:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.355718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.355747:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709294720:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.355770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.355795:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784047448.355800:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709294336:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.355823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.355840:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709294848:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.355865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.355897:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294208 00000100:00100000:2.0:1784047448.355903:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294208 00000100:00100000:2.0:1784047448.355949:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294720 00000100:00100000:2.0:1784047448.355951:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294720 00000100:00100000:3.0:1784047448.355959:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709293312:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.355969:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294336 00000100:00100000:2.0:1784047448.355971:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294336 00000100:00100000:3.0:1784047448.355984:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709294080:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356001:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:2.0:1784047448.356008:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709294208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047448.356032:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709294592:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356049:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709294208:12345-0@lo:400:kworker.0 Request processed in 41us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047448.356053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.356056:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1784047448.356068:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784047448.356068:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294592 00000100:00100000:2.0:1784047448.356071:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294592 00000100:00100000:3.0:1784047448.356073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709293952:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356091:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1784047448.356092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.356097:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709294720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356108:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709294464:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356127:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709294720:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047448.356128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.356134:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1784047448.356146:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1784047448.356152:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709294336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356157:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1784047448.356164:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709294592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356179:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709294336:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.356186:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00080000:2.0:1784047448.356216:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047448.356220:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047448.356238:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709294336:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356247:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709294208:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709294720:0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356281:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294848 00000100:00100000:2.0:1784047448.356284:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294848 00000100:00100000:2.0:1784047448.356322:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709293952 00000100:00100000:2.0:1784047448.356326:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709293952 00000100:00100000:2.0:1784047448.356373:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294464 00000100:00100000:2.0:1784047448.356377:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294464 00000100:00100000:2.0:1784047448.356393:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1784047448.356399:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709294848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047448.356439:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709294848:12345-0@lo:400:kworker.0 Request processed in 41us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.356462:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1784047448.356476:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1784047448.356482:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709293952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356505:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709294592:12345-0@lo:400:kworker.0 Request processed in 29us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.356513:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709293952:12345-0@lo:400:kworker.0 Request processed in 32us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.356519:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1784047448.356521:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1784047448.356530:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1784047448.356536:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709294464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356543:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294080 00000100:00100000:3.0:1784047448.356546:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294080 00000100:00100000:2.0:1784047448.356562:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709294464:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.356568:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1784047448.356572:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1784047448.356578:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709294080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784047448.356590:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047448.356629:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709294848:0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356631:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709294080:12345-0@lo:400:kworker.0 Request processed in 54us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047448.356638:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1784047448.356664:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709293952:0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356673:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709294464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356682:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709294080:0@lo:400:kworker.0 00000100:00100000:3.0:1784047448.356690:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709294592:0@lo:400:kworker.0 00000100:00100000:1.0:1784047448.709094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047448.709140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047448.709186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047448.709221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047448.709252:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047448.709284:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448832 00000100:00100000:1.0:1784047448.709293:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448832 00000100:00100000:3.0:1784047448.709316:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449088 00000100:00100000:3.0:1784047448.709320:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449088 00000100:00100000:3.0:1784047448.709347:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449216 00000100:00100000:1.0:1784047448.709347:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448960 00000100:00100000:3.0:1784047448.709362:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449216 00000100:00100000:1.0:1784047448.709362:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448960 00000100:00100000:3.0:1784047448.709386:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2552 00000100:00100000:1.0:1784047448.709386:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1278 00000100:00100000:3.0:1784047448.709397:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689449088:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047448.709397:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689448832:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047448.709509:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1279 00000100:00100000:2.0:1784047448.709520:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689448960:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047448.709577:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689448832:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 181us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047448.709585:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1278 00000100:00100000:1.0:1784047448.709642:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2553 00000100:00100000:1.0:1784047448.709650:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689449216:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047448.709714:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689448704 00000100:00100000:0.0:1784047448.709719:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689448704 00000100:00100000:0.0:1784047448.709751:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:0.0:1784047448.709758:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689448704:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047448.711687:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689449088:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2280us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047448.711992:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2552 00000100:00100000:2.0:1784047448.712995:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689448960:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 3470us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.713007:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1279 00000100:00100000:1.0:1784047448.714209:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689449216:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 4551us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047448.714221:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2553 00000100:00100000:0.0:1784047448.714650:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689448704:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 4888us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047448.714664:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:2.0:1784047448.851305:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709294976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047448.851407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047448.851493:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709294976 00000100:00100000:2.0:1784047448.851504:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709294976 00000100:00100000:2.0:1784047448.851557:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1784047448.851567:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709294976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047448.851628:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047448.851676:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709294976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047448.851684:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1784047448.851733:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709294976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047448.860944:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047448.860966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709295232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047448.861031:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047448.861073:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295232 00000100:00100000:0.0:1784047448.861080:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295232 00000100:00100000:0.0:1784047448.861123:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:0.0:1784047448.861131:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709295232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047448.861164:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047448.861202:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709295232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047448.861216:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:0.0:1784047448.861258:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709295232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047448.861596:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709295104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047448.861666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047448.861761:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295104 00000100:00100000:0.0:1784047448.861767:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295104 00000100:00100000:0.0:1784047448.861805:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1784047448.861812:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709295104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047448.861831:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047448.861876:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709295104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047448.861883:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:3.0:1784047448.861954:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709295104:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1784047448.872134:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968754 is committed 00010000:00010000:0.0:1784047449.363062:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784047449.879361:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968753 is committed 00010000:00010000:0.0:1784047450.389513:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047451.410820:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047451.411003:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709295360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047451.411087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047451.411148:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295360 00000100:00100000:2.0:1784047451.411158:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295360 00000100:00100000:2.0:1784047451.411232:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:2.0:1784047451.411244:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709295360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047451.411290:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047451.411347:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709295360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047451.411354:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00080000:3.0:1784047451.412228:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047451.412240:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047451.412265:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709295488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047451.412320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047451.412460:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295488 00000100:00100000:0.0:1784047451.412466:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295488 00000100:00100000:0.0:1784047451.412518:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1784047451.412527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709295488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047451.412551:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047451.412594:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709295488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047451.412602:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00080000:1.0:1784047451.412694:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047451.412794:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709295360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047451.412834:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709295488:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047452.439396:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784047453.332955:0:91592:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:1.0:1784047453.458935:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1784047453.459327:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047453.460273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047453.460315:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709296000:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.460436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.460521:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709295872:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.460552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.460578:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047453.460586:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709295744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047453.460642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.460681:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296000 00000100:00100000:3.0:1784047453.460690:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296000 00000100:00100000:3.0:1784047453.460778:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295872 00000100:00100000:3.0:1784047453.460782:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295872 00000100:00100000:3.0:1784047453.460813:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1784047453.460825:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709296000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.460894:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709296000:12345-0@lo:400:kworker.0 Request processed in 72us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.460903:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1784047453.460942:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1784047453.460949:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709295872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.460986:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709295872:12345-0@lo:400:kworker.0 Request processed in 37us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.460993:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1784047453.461015:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295744 00000100:00100000:3.0:1784047453.461019:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295744 00000100:00100000:3.0:1784047453.461050:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:3.0:1784047453.461057:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709295744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047453.461093:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047453.461144:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709295744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.461151:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00080000:3.0:1784047453.461170:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047453.461174:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047453.461249:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709295744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047453.461279:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709295872:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.461324:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709296000:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.462872:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709295616:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.462971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.463878:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709295616 00000100:00100000:3.0:1784047453.463894:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709295616 00000100:00100000:3.0:1784047453.463975:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784047453.463988:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709295616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.464087:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709295616:12345-0@lo:400:kworker.0 Request processed in 102us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.464096:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784047453.464712:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709295616:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.465964:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709296128:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.466054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.466210:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296128 00000100:00100000:1.0:1784047453.466219:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296128 00000100:00100000:2.0:1784047453.466579:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047453.466596:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709296256:0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.466668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.467232:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296256 00000100:00100000:1.0:1784047453.467240:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296256 00000100:00100000:1.0:1784047453.467663:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1784047453.467678:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709296128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.467951:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1784047453.467979:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709296256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.468056:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709296256:12345-0@lo:400:kworker.0 Request processed in 80us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047453.468065:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1784047453.468596:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709296128:12345-0@lo:400:kworker.0 Request processed in 919us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.468634:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00080000:1.0:1784047453.468670:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047453.468678:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047453.468721:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709296128:0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.469244:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709296256:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.469578:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709296640:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.469674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.469712:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047453.469719:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709296512:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.469905:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709296384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.469951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.469979:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709296896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.470003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.470024:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047453.470030:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709296768:0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.470058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047453.470093:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296384 00000100:00100000:3.0:1784047453.470101:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296384 00000100:00100000:2.0:1784047453.470623:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296640 00000100:00100000:2.0:1784047453.470629:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296640 00000100:00100000:2.0:1784047453.470700:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296896 00000100:00100000:2.0:1784047453.470704:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296896 00000100:00100000:1.0:1784047453.470936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.470964:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047453.470976:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709297024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.471000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.471037:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296768 00000100:00100000:1.0:1784047453.471041:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296768 00000100:00100000:1.0:1784047453.471079:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1784047453.471089:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709296768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.471834:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709296512 00000100:00100000:2.0:1784047453.471846:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709296512 00000100:00100000:2.0:1784047453.471905:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297024 00000100:00100000:2.0:1784047453.471909:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297024 00000100:00100000:2.0:1784047453.471938:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1784047453.471947:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709296640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.472025:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709296640:12345-0@lo:400:kworker.0 Request processed in 79us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047453.472033:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1784047453.472056:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:2.0:1784047453.472062:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709296896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.472101:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709296896:12345-0@lo:400:kworker.0 Request processed in 39us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047453.472107:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:3.0:1784047453.472338:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1784047453.472351:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709296384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.472400:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709296384:12345-0@lo:400:kworker.0 Request processed in 54us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.472408:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1784047453.472681:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709296768:12345-0@lo:400:kworker.0 Request processed in 1590us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.472691:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1784047453.473300:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:2.0:1784047453.473318:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709296512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.473375:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709296512:12345-0@lo:400:kworker.0 Request processed in 63us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.476506:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1784047453.476543:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709297024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047453.476710:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709297024:12345-0@lo:400:kworker.0 Request processed in 186us (5708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047453.476721:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00080000:1.0:1784047453.479546:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047453.479557:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047453.479593:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709297152:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.479719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.479793:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 2 00000100:00100000:1.0:1784047453.479819:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709297024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.479837:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709296512:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.479852:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709296640:0@lo:400:kworker.0 00000100:00100000:0.0:1784047453.483475:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297152 00000100:00100000:0.0:1784047453.483498:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297152 00000100:00100000:0.0:1784047453.483600:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1784047453.483630:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709297152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047453.483775:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709297152:12345-0@lo:400:kworker.0 Request processed in 149us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047453.483785:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1784047453.483869:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709297152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.484156:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:2.0:1784047453.484241:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709296768:0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.484271:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709296384:0@lo:400:kworker.0 00000100:00100000:2.0:1784047453.484287:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968754 gen 2 00000100:00100000:2.0:1784047453.484311:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709296896:0@lo:400:kworker.0 00000100:00100000:1.0:1784047453.836643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047453.836703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047453.836741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047453.836780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047453.836821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047453.836872:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449600 00000100:00100000:1.0:1784047453.836886:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449600 00000100:00100000:1.0:1784047453.836971:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449472 00000100:00100000:1.0:1784047453.836975:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449472 00000100:00100000:1.0:1784047453.837006:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1286 00000100:00100000:1.0:1784047453.837017:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689449600:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047453.837118:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689449600:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 102us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.837126:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1286 00000100:00100000:1.0:1784047453.837146:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1287 00000100:00100000:1.0:1784047453.837154:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689449472:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047453.837184:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2400:x1870705689449472:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.837209:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1287 00000100:00100000:1.0:1784047453.837233:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449856 00000100:00100000:1.0:1784047453.837237:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449856 00000100:00100000:1.0:1784047453.837278:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449728 00000100:00100000:1.0:1784047453.837282:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449728 00000100:00100000:1.0:1784047453.837304:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2558 00000100:00100000:1.0:1784047453.837310:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689449856:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047453.837340:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689449856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.837347:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2558 00000100:00100000:1.0:1784047453.837360:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2559 00000100:00100000:1.0:1784047453.837366:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689449728:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047453.837562:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689449728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 195us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.837569:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2559 00000100:00080000:1.0:1784047453.837591:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047453.837596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047453.837599:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047453.837601:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047453.838895:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449344 00000100:00100000:0.0:1784047453.838910:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449344 00000100:00100000:0.0:1784047453.838987:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:0.0:1784047453.838997:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689449344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047453.839087:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689449344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 91us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047453.839095:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:3.0:1784047453.971045:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047453.971095:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709297280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047453.971201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047453.971667:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047453.971681:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709297408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047453.971737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047453.971784:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297280 00000100:00100000:2.0:1784047453.971801:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297280 00000100:00100000:2.0:1784047453.971874:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297408 00000100:00100000:2.0:1784047453.971877:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297408 00000100:00100000:2.0:1784047453.971902:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1784047453.971912:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709297280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047453.971962:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047453.972027:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709297280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047453.972035:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1784047453.972065:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:2.0:1784047453.972080:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709297408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047453.972100:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047453.972141:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709297408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047453.972148:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:2.0:1784047453.972225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709297408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047453.972574:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709297280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047453.973501:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709297536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047453.973588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047453.973667:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297536 00000100:00100000:1.0:1784047453.973675:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297536 00000100:00100000:1.0:1784047453.973722:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1784047453.973729:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709297536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047453.973776:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:1.0:1784047453.973833:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709297536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047453.973841:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1784047453.973886:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709297536:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784047454.482847:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784047455.016844:0:91640:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1784047455.506843:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047456.530915:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1784047456.531017:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047456.531595:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709297664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047456.531760:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047456.531774:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709297792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047456.531897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047456.532024:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297792 00000100:00100000:2.0:1784047456.532034:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297792 00000100:00100000:2.0:1784047456.532121:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1784047456.532135:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709297792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047456.532184:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047456.532255:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709297792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047456.532276:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00080000:1.0:1784047456.532379:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047456.532451:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709297792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047456.532652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047456.532828:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297664 00000100:00100000:1.0:1784047456.532834:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297664 00000100:00100000:1.0:1784047456.532935:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1784047456.532944:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709297664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047456.532976:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047456.533033:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709297664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047456.533041:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1784047456.533116:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709297664:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784047456.533809:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047456.887022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047456.896177:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689449984 00000100:00100000:0.0:1784047456.896212:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689449984 00000100:00100000:0.0:1784047456.896432:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1292 00000100:00100000:0.0:1784047456.896452:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:70320:x1870705689449984:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047456.896509:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047456.896663:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:70320:x1870705689449984:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 216us (9724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047456.896671:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1292 00000100:00080000:2.0:1784047456.897430:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047456.900581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047456.904708:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689450112 00000100:00100000:1.0:1784047456.904735:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689450112 00000100:00100000:1.0:1784047456.904876:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1293 00000100:00100000:1.0:1784047456.904894:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:70320:x1870705689450112:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047456.904951:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00080000:2.0:1784047456.905162:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047456.905879:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+6:70320:x1870705689450112:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 987us (5315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047456.905890:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1293 00000100:00100000:3.0:1784047456.912024:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047456.918284:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689450240 00000100:00100000:2.0:1784047456.918310:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689450240 00000100:00100000:2.0:1784047456.918459:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2090 00000100:00100000:2.0:1784047456.918472:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:70320:x1870705689450240:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047456.918509:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047456.918632:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+6:70320:x1870705689450240:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 162us (6626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047456.918641:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2090 00000100:00080000:1.0:1784047456.919547:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047456.924878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047456.926080:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689450368 00000100:00100000:1.0:1784047456.926097:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689450368 00000100:00100000:1.0:1784047456.926213:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2091 00000100:00100000:1.0:1784047456.926228:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+7:70320:x1870705689450368:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:1.0:1784047456.926272:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047456.926386:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a2569b5-a558-4441-a96a-1d77608df16b+7:70320:x1870705689450368:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 160us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047456.926395:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2091 00000100:00080000:2.0:1784047456.926632:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047456.973114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047456.973928:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689450624 00000100:00100000:3.0:1784047456.973945:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689450624 00000100:00100000:3.0:1784047456.974182:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1294 00000100:00100000:3.0:1784047456.974206:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:70337:x1870705689450624:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047456.974249:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047456.974282:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2d7 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974400:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974419:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974438:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974458:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974466:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974502:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974686:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974694:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974706:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974715:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.974722:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ec00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047456.974727:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.976649:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.976676:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:3.0:1784047456.976680:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047456.976687:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.976695:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977174:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977216:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977223:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977231:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047456.977302:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977311:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977323:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99cd001e7a00) 00010000:00010000:3.0:1784047456.977326:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047456.977329:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977336:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c774f78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.977991:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774f6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d7 expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.978009:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:3.0:1784047456.978012:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784047456.978017:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f400/0x4426598c0c774f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d7 expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047456.978046:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f400, rc 0) 00000100:00100000:3.0:1784047456.978162:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:70337:x1870705689450624:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 3967us (5059us total) trans 0 rc 301/301 00000100:00100000:3.0:1784047456.978173:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1294 00000100:00100000:3.0:1784047456.985309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047456.985489:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689450752 00000100:00100000:1.0:1784047456.985504:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689450752 00000100:00100000:1.0:1784047456.985599:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1295 00000100:00100000:1.0:1784047456.985660:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:70337:x1870705689450752:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:1.0:1784047456.985785:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.985809:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.985826:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.985847:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.985854:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.985881:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.985999:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986009:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986016:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047456.986072:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1784047456.986078:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047456.986099:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986115:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986121:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986128:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986135:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986141:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047456.986146:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986162:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986177:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:1.0:1784047456.986180:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047456.986186:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986203:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986221:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986228:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986242:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986248:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047456.986251:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986258:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986266:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccef89e700) 00010000:00010000:1.0:1784047456.986269:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047456.986272:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986290:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986312:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986318:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986324:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986329:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047456.986332:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986338:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986347:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:1.0:1784047456.986349:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047456.986352:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047456.986363:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774f8d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047456.986475:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:70337:x1870705689450752:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 819us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047456.986485:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1295 00000100:00100000:1.0:1784047457.013876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047457.014001:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689451008 00000100:00100000:2.0:1784047457.014017:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689451008 00000100:00100000:2.0:1784047457.014102:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1296 00000100:00100000:2.0:1784047457.014116:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:70340:x1870705689451008:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047457.014146:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047457.014204:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c774f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2de expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014327:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014347:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014363:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014382:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014390:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014396:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014767:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014777:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014784:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014791:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014798:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047457.014813:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014822:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014837:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:2.0:1784047457.014841:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047457.014846:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014853:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c774f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014868:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014874:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014880:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014885:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047457.014888:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014893:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014900:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccc3e94900) 00010000:00010000:2.0:1784047457.014903:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047457.014912:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014918:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c774fa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014964:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c774f94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2de expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014976:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:2.0:1784047457.014978:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047457.014982:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c774f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2de expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047457.014991:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47a00, rc 0) 00000100:00100000:2.0:1784047457.015180:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+8:70340:x1870705689451008:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1066us (1318us total) trans 0 rc 301/301 00000100:00100000:2.0:1784047457.015200:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1296 00000100:00100000:3.0:1784047457.028321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047457.028756:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689451136 00000100:00100000:1.0:1784047457.028770:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689451136 00000100:00100000:1.0:1784047457.028863:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1297 00000100:00100000:1.0:1784047457.028877:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:70340:x1870705689451136:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:1.0:1784047457.029000:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029021:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029037:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029056:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029064:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029071:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029338:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029347:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.029355:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047457.030047:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1784047457.030056:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047457.030076:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030095:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030103:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030108:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030116:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030124:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047457.030129:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030138:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030153:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:1.0:1784047457.030157:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047457.030162:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030170:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030219:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030227:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030233:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030238:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047457.030242:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030248:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030257:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccef89e700) 00010000:00010000:1.0:1784047457.030259:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047457.030262:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030267:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030286:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030292:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030298:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030310:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047457.030314:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030320:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030328:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:1.0:1784047457.030330:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047457.030334:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.030340:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fb7 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047457.031022:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+8:70340:x1870705689451136:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 2138us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047457.031036:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1297 00000100:00100000:3.0:1784047457.106068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047457.110876:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689451392 00000100:00100000:1.0:1784047457.110901:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689451392 00000100:00100000:1.0:1784047457.111076:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1298 00000100:00100000:1.0:1784047457.111094:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:70348:x1870705689451392:12345-192.168.204.40@tcp:101:md5sum.0 00010000:00010000:1.0:1784047457.111125:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047457.111157:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2e5 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.111295:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.111340:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.111356:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.111377:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.111386:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.111392:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.113583:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774fd3 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.113650:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774fd3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.113666:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774fd3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047457.113684:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1784047457.114471:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114485:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114492:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114520:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114527:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047457.114532:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114541:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114558:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:1.0:1784047457.114563:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047457.114568:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114575:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c774fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114595:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114602:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114675:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114680:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047457.114684:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114701:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114711:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff99ccef89e700) 00010000:00010000:1.0:1784047457.114713:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047457.114716:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114723:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c774fcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114826:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c774fbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2e5 expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114844:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774fd3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2e5 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047457.114853:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:1.0:1784047457.114856:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047457.114858:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28c00, rc 0) 00000100:00100000:1.0:1784047457.114983:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:70348:x1870705689451392:12345-192.168.204.40@tcp:101:md5sum.0 Request processed in 3890us (8930us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1784047457.114995:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1298 00000100:00100000:2.0:1784047457.139478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047457.139645:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689451520 00000100:00100000:0.0:1784047457.139660:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689451520 00002000:00100000:0.0:1784047457.139742:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x722:0x0] (0->32767) req@ffff99ccef504000 x1870705689451520/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:588/0 lens 488/0 e 0 to 0 dl 1784047468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784047457.139774:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef504000 with x1870705689451520 ext(0->32767) 00002000:00010000:0.0:1784047457.139781:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccef504000 00000100:00100000:0.0:1784047457.139879:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 603 00000100:00100000:0.0:1784047457.139892:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689451520:12345-192.168.204.40@tcp:3:md5sum.0 00000100:00100000:0.0:1784047457.154735:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2a2569b5-a558-4441-a96a-1d77608df16b+7:2402:x1870705689451520:12345-192.168.204.40@tcp:3:md5sum.0 Request processed in 14835us (15263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047457.154749:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 603 00002000:00100000:0.0:1784047457.154762:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x722:0x0] (0->32767) req@ffff99ccef504000 x1870705689451520/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:588/0 lens 488/440 e 0 to 0 dl 1784047468 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784047457.154773:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef504000 with x1870705689451520 ext(0->32767) 00002000:00010000:0.0:1784047457.154779:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccef504000 00000100:00100000:2.0:1784047457.175290:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047457.175338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047457.175739:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689451648 00000100:00100000:1.0:1784047457.175751:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689451648 00002000:00100000:1.0:1784047457.175806:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x722:0x0] (32768->1048575) req@ffff99ccc44f0e00 x1870705689451648/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:588/0 lens 488/0 e 0 to 0 dl 1784047468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047457.175837:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccc44f0e00 with x1870705689451648 ext(32768->1048575) 00002000:00010000:1.0:1784047457.175844:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccc44f0e00 00000100:00100000:1.0:1784047457.175869:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689451776 00000100:00100000:1.0:1784047457.175872:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689451776 00002000:00100000:1.0:1784047457.175891:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x722:0x0] (1048576->2097151) req@ffff99cce7ed4000 x1870705689451776/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:588/0 lens 488/0 e 0 to 0 dl 1784047468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047457.175900:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cce7ed4000 with x1870705689451776 ext(1048576->2097151) 00002000:00010000:1.0:1784047457.175904:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cce7ed4000 00000100:00100000:1.0:1784047457.175933:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 604 00000100:00100000:1.0:1784047457.175943:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689451648:12345-192.168.204.40@tcp:3:md5sum.0 00000100:00100000:0.0:1784047457.176229:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 605 00000100:00100000:0.0:1784047457.176250:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689451776:12345-192.168.204.40@tcp:3:md5sum.0 00000100:00100000:1.0:1784047457.181690:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689451648:12345-192.168.204.40@tcp:3:md5sum.0 Request processed in 5738us (6403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047457.181703:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 604 00002000:00100000:1.0:1784047457.181716:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x722:0x0] (32768->1048575) req@ffff99ccc44f0e00 x1870705689451648/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:588/0 lens 488/440 e 0 to 0 dl 1784047468 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047457.181726:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccc44f0e00 with x1870705689451648 ext(32768->1048575) 00002000:00010000:1.0:1784047457.181733:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ccc44f0e00 00000100:00100000:3.0:1784047457.258118:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689451776:12345-192.168.204.40@tcp:3:md5sum.0 Request processed in 81853us (82762us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1784047457.258134:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 605 00002000:00100000:3.0:1784047457.258150:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x722:0x0] (1048576->2097151) req@ffff99cce7ed4000 x1870705689451776/t0(0) o3->2a2569b5-a558-4441-a96a-1d77608df16b@192.168.204.40@tcp:588/0 lens 488/440 e 0 to 0 dl 1784047468 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047457.258162:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cce7ed4000 with x1870705689451776 ext(1048576->2097151) 00002000:00010000:3.0:1784047457.258171:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cce7ed4000 00000100:00100000:2.0:1784047457.287719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047457.288451:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452032 00000100:00100000:3.0:1784047457.288465:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452032 00000100:00100000:3.0:1784047457.288539:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 229 00000100:00100000:3.0:1784047457.288552:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:70348:x1870705689452032:12345-192.168.204.40@tcp:35:md5sum.0 00000100:00100000:0.0:1784047457.289335:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+11:70348:x1870705689452032:12345-192.168.204.40@tcp:35:md5sum.0 Request processed in 772us (1632us total) trans 115964116994 rc 0/0 00000100:00100000:0.0:1784047457.289363:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 229 00010000:00010000:3.0:1784047457.554919:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047458.578727:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047458.578992:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709298304:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709298816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579180:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709299328:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579233:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784047458.579239:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709297920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579297:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709298432:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579334:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709298944:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047458.579548:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709298176:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.579579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047458.579631:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709298688:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.579656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047458.579675:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709299200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709299456:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579830:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709298048:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579874:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709298560:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579917:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709299072:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.579939:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.579958:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709299584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047458.579980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047458.580018:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298304 00000100:00100000:3.0:1784047458.580025:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298304 00000100:00100000:3.0:1784047458.580074:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298432 00000100:00100000:3.0:1784047458.580077:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298432 00000100:00100000:3.0:1784047458.580090:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298944 00000100:00100000:3.0:1784047458.580092:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298944 00000100:00100000:3.0:1784047458.580104:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298176 00000100:00100000:3.0:1784047458.580113:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298176 00000100:00100000:3.0:1784047458.580130:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299456 00000100:00100000:3.0:1784047458.580132:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299456 00000100:00100000:3.0:1784047458.580142:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298048 00000100:00100000:3.0:1784047458.580144:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298048 00000100:00100000:3.0:1784047458.580158:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1784047458.580180:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709298304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.580232:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709298304:12345-0@lo:400:kworker.0 Request processed in 54us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047458.580239:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1784047458.580255:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1784047458.580261:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709298432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.580286:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709298432:12345-0@lo:400:kworker.0 Request processed in 25us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047458.580291:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1784047458.580303:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1784047458.580309:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709298944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.580335:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709298944:12345-0@lo:400:kworker.0 Request processed in 27us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047458.580341:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1784047458.580351:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1784047458.580356:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709298176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.580854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047458.580897:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1784047458.580907:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709299456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.580940:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709299456:12345-0@lo:400:kworker.0 Request processed in 36us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.580946:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1784047458.580961:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1784047458.580967:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709298048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.580999:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709298048:12345-0@lo:400:kworker.0 Request processed in 33us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581005:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1784047458.581024:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298816 00000100:00100000:1.0:1784047458.581028:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298816 00000100:00100000:1.0:1784047458.581062:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299328 00000100:00100000:1.0:1784047458.581065:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299328 00000100:00100000:1.0:1784047458.581257:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298688 00000100:00100000:1.0:1784047458.581262:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298688 00000100:00100000:1.0:1784047458.581296:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299200 00000100:00100000:1.0:1784047458.581299:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299200 00000100:00100000:1.0:1784047458.581322:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1784047458.581327:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709298816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.581362:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709298816:12345-0@lo:400:kworker.0 Request processed in 34us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581445:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1784047458.581459:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1784047458.581465:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709299328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.581497:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709299328:12345-0@lo:400:kworker.0 Request processed in 31us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581513:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1784047458.581525:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1784047458.581530:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709298688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.581564:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709298688:12345-0@lo:400:kworker.0 Request processed in 34us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581570:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1784047458.581581:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1784047458.581587:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709299200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.581639:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709299200:12345-0@lo:400:kworker.0 Request processed in 52us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581645:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1784047458.581668:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709298560 00000100:00100000:1.0:1784047458.581672:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709298560 00000100:00100000:1.0:1784047458.581770:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299072 00000100:00100000:1.0:1784047458.581775:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299072 00000100:00100000:1.0:1784047458.581788:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299584 00000100:00100000:1.0:1784047458.581792:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299584 00000100:00100000:1.0:1784047458.581802:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1784047458.581808:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709298560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.581845:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709298560:12345-0@lo:400:kworker.0 Request processed in 36us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581851:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1784047458.581864:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1784047458.581869:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709299072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.581897:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709299072:12345-0@lo:400:kworker.0 Request processed in 28us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581913:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1784047458.581926:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1784047458.581931:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709299584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047458.581953:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1784047458.581983:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709299584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.581988:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1784047458.582032:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709298688:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.582041:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709299200:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.582077:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709298048:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.582087:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709298560:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.582096:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709299072:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.582106:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709299584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047458.582242:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709298176:12345-0@lo:400:kworker.0 Request processed in 1885us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047458.582249:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1784047458.582280:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709297920 00000100:00100000:3.0:1784047458.582284:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709297920 00000100:00100000:3.0:1784047458.582314:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784047458.582319:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709297920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582347:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709297920:12345-0@lo:400:kworker.0 Request processed in 28us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047458.582353:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1784047458.582451:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047458.582455:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047458.582458:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047458.582460:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047458.582476:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709297920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709298432:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709298944:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582506:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709299456:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582516:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709298304:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709298816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047458.582536:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709299328:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.582642:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709298176:0@lo:400:kworker.0 00000100:00100000:1.0:1784047458.951971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047458.952008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047458.952029:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047458.952049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047458.952082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047458.952112:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452160 00000100:00100000:1.0:1784047458.952121:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452160 00000100:00100000:1.0:1784047458.952187:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:1.0:1784047458.952198:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfddcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689452160:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047458.952287:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfddcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689452160:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 90us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.952295:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:1.0:1784047458.952331:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452416 00000100:00100000:1.0:1784047458.952335:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452416 00000100:00100000:1.0:1784047458.952373:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452288 00000100:00100000:1.0:1784047458.952376:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452288 00000100:00100000:1.0:1784047458.952414:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1294 00000100:00100000:1.0:1784047458.952422:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689452416:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047458.952455:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689452416:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.952462:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1294 00000100:00100000:1.0:1784047458.952474:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1295 00000100:00100000:1.0:1784047458.952480:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:2401:x1870705689452288:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047458.952507:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:2401:x1870705689452288:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.952513:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1295 00000100:00100000:1.0:1784047458.952532:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452672 00000100:00100000:1.0:1784047458.952536:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452672 00000100:00100000:1.0:1784047458.952561:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452544 00000100:00100000:1.0:1784047458.952565:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452544 00000100:00100000:1.0:1784047458.952586:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2564 00000100:00100000:1.0:1784047458.952592:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689452672:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047458.952641:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+7:2401:x1870705689452672:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 49us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.952656:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2564 00000100:00100000:1.0:1784047458.952668:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2565 00000100:00100000:1.0:1784047458.952673:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689452544:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047458.952699:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a2569b5-a558-4441-a96a-1d77608df16b+6:2401:x1870705689452544:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047458.952704:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2565 00000100:00080000:1.0:1784047458.952735:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047458.952739:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047458.952742:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047458.952744:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047459.091048:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047459.091078:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709299712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047459.091716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047459.091756:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047459.091769:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709299840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047459.091804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047459.091845:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299712 00000100:00100000:3.0:1784047459.091854:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299712 00000100:00100000:3.0:1784047459.091908:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299840 00000100:00100000:3.0:1784047459.091912:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299840 00000100:00100000:3.0:1784047459.091933:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1784047459.091936:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709299968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047459.091942:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709299712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047459.091992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1784047459.091994:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047459.092026:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709299968 00000100:00100000:0.0:1784047459.092030:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709299968 00000100:00100000:3.0:1784047459.092043:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709299712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047459.092051:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1784047459.092058:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1784047459.092064:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709299968:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047459.092070:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1784047459.092076:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709299840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047459.092093:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000004:00000024:0.0:1784047459.092101:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:3.0:1784047459.092125:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709299840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047459.092132:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:0.0:1784047459.092132:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709299968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047459.092137:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1784047459.092186:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709299968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047459.093046:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709299840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047459.093046:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709299712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784047459.602801:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047460.628772:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047461.650938:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047461.650960:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709300096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047461.651026:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047461.651074:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300096 00000100:00100000:2.0:1784047461.651081:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300096 00000100:00100000:2.0:1784047461.651152:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:2.0:1784047461.651163:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709300096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047461.651201:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047461.651242:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709300096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047461.651249:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00080000:2.0:1784047461.651268:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047461.651301:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709300096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047461.654545:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047461.654572:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709300224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047461.654672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047461.654789:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300224 00000100:00100000:2.0:1784047461.654798:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300224 00000100:00100000:2.0:1784047461.654867:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:2.0:1784047461.654879:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709300224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047461.654911:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047461.654961:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709300224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047461.654969:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00080000:1.0:1784047461.655040:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047461.655076:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709300224:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784047461.655565:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047462.677871:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784047462.681652:0:91009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00010000:00010000:0.0:1784047463.698956:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047463.699305:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047463.699338:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709300352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047463.699415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047463.699665:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300352 00000100:00100000:0.0:1784047463.699674:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300352 00000100:00100000:0.0:1784047463.699739:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1784047463.699750:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709300352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047463.699800:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1784047463.699862:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709300352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047463.699870:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:1.0:1784047463.700014:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709300352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047463.700689:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709300864:0@lo:400:kworker.0 00000100:00100000:2.0:1784047463.700744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047463.700779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709301376:0@lo:400:kworker.0 00000100:00100000:2.0:1784047463.700813:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047463.700828:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709301888:0@lo:400:kworker.0 00000100:00100000:2.0:1784047463.700847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047463.700869:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784047463.700901:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709300480:0@lo:400:kworker.0 00000100:00100000:2.0:1784047463.700943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047463.700971:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709300992:0@lo:400:kworker.0 00000100:00100000:2.0:1784047463.700997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047463.701013:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709301504:0@lo:400:kworker.0 00000100:00100000:2.0:1784047463.701033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701189:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709300736:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701247:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709301248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701296:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709301760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701342:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784047463.701346:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709300608:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701373:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709301120:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701404:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709301632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047463.701446:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301376 00000100:00100000:1.0:1784047463.701452:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301376 00000100:00100000:1.0:1784047463.701498:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301248 00000100:00100000:1.0:1784047463.701500:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301248 00000100:00100000:1.0:1784047463.701516:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301760 00000100:00100000:1.0:1784047463.701518:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301760 00000100:00100000:1.0:1784047463.701533:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301632 00000100:00100000:1.0:1784047463.701535:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301632 00000100:00100000:1.0:1784047463.701551:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1784047463.701559:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709301376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701629:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709301376:12345-0@lo:400:kworker.0 Request processed in 70us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.701636:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1784047463.701650:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1784047463.701656:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709301248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701682:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709301248:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.701688:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1784047463.701703:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1784047463.701708:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709301760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701735:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709301760:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.701740:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1784047463.701748:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1784047463.701753:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709301632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701772:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709301632:12345-0@lo:400:kworker.0 Request processed in 19us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.701777:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1784047463.701806:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300864 00000100:00100000:1.0:1784047463.701809:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300864 00000100:00100000:1.0:1784047463.701830:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301888 00000100:00100000:1.0:1784047463.701832:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301888 00000100:00100000:1.0:1784047463.701840:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300992 00000100:00100000:1.0:1784047463.701842:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300992 00000100:00100000:1.0:1784047463.701852:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301504 00000100:00100000:1.0:1784047463.701854:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301504 00000100:00100000:1.0:1784047463.701864:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300736 00000100:00100000:1.0:1784047463.701866:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300736 00000100:00100000:1.0:1784047463.701876:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300608 00000100:00100000:1.0:1784047463.701878:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300608 00000100:00100000:1.0:1784047463.701892:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1784047463.701898:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709300864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701930:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709300864:12345-0@lo:400:kworker.0 Request processed in 32us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.701936:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1784047463.701949:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1784047463.701954:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709301888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.701988:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709301888:12345-0@lo:400:kworker.0 Request processed in 35us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.701994:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1784047463.702007:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1784047463.702013:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709300992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702039:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709300992:12345-0@lo:400:kworker.0 Request processed in 27us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.702044:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1784047463.702055:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1784047463.702060:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709301504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702099:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709301504:12345-0@lo:400:kworker.0 Request processed in 39us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.702104:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1784047463.702114:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1784047463.702119:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702144:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709300736:12345-0@lo:400:kworker.0 Request processed in 25us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.702150:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1784047463.702159:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1784047463.702164:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709300608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702187:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709300608:12345-0@lo:400:kworker.0 Request processed in 23us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.702192:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1784047463.702222:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709301120 00000100:00100000:1.0:1784047463.702226:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709301120 00000100:00100000:1.0:1784047463.702259:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1784047463.702265:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709301120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702298:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709301120:12345-0@lo:400:kworker.0 Request processed in 34us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047463.702304:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00080000:1.0:1784047463.702323:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047463.702327:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047463.702330:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047463.702332:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047463.702379:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709300608:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702390:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709301120:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702400:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709301632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702407:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709300736:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702416:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709301248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702423:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709301760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702463:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709300992:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702472:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709301504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702483:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709300864:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709301376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047463.702502:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709301888:0@lo:400:kworker.0 00000100:00100000:3.0:1784047463.703748:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709300480 00000100:00100000:3.0:1784047463.703764:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709300480 00000100:00100000:3.0:1784047463.703833:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784047463.703843:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfddca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709300480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047463.703943:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfddca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709300480:12345-0@lo:400:kworker.0 Request processed in 102us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047463.703951:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784047463.704143:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709300480:0@lo:400:kworker.0 00000100:00100000:2.0:1784047464.079757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047464.080012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047464.080052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047464.080091:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047464.080189:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452928 00000100:00100000:1.0:1784047464.080202:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452928 00000100:00100000:1.0:1784047464.080288:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1302 00000100:00100000:1.0:1784047464.080300:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+9:2400:x1870705689452928:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047464.080383:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+9:2400:x1870705689452928:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 86us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047464.080392:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1302 00000100:00080000:1.0:1784047464.080418:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047464.080739:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689452800 00000100:00100000:0.0:1784047464.080744:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689452800 00000100:00100000:0.0:1784047464.080782:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:0.0:1784047464.080790:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689452800:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047464.080829:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689452800:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.080836:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:0.0:1784047464.081255:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453056 00000100:00100000:0.0:1784047464.081260:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453056 00000100:00100000:3.0:1784047464.081333:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453184 00000100:00100000:0.0:1784047464.081333:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1303 00000100:00100000:0.0:1784047464.081346:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689453056:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047464.081348:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453184 00000100:00100000:0.0:1784047464.081400:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689453056:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 55us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.081409:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1303 00000100:00080000:0.0:1784047464.081432:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047464.081971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047464.082235:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453312 00000100:00100000:0.0:1784047464.082243:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453312 00000100:00100000:3.0:1784047464.082280:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2570 00000100:00100000:0.0:1784047464.082296:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2571 00000100:00100000:3.0:1784047464.082303:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689453184:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047464.082314:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689453312:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047464.082369:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2569b5-a558-4441-a96a-1d77608df16b+7:2400:x1870705689453312:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 61us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.082391:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2571 00000100:00100000:3.0:1784047464.083084:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a2569b5-a558-4441-a96a-1d77608df16b+6:2400:x1870705689453184:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 786us (3065us total) trans 0 rc 0/0 00000100:00080000:1.0:1784047464.083220:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047464.083227:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047464.083302:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2570 00000100:00100000:0.0:1784047464.210771:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709302016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047464.210811:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047464.210828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709302144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047464.210850:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.218142:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047464.218173:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709302272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047464.224366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.227164:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302272 00000100:00100000:2.0:1784047464.227180:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302272 00000100:00100000:0.0:1784047464.227941:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302016 00000100:00100000:0.0:1784047464.227950:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302016 00000100:00100000:0.0:1784047464.228235:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1784047464.228249:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709302016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047464.228289:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047464.228363:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709302016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (17513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.228370:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1784047464.228399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047464.228454:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709302016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047464.228661:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302144 00000100:00100000:0.0:1784047464.228673:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302144 00000100:00100000:0.0:1784047464.228701:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1784047464.228708:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709302144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047464.228724:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047464.228763:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709302144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.228769:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1784047464.228815:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709302144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047464.228849:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:0.0:1784047464.228857:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709302272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047464.228884:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:0.0:1784047464.228936:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870705709302272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.228943:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1784047464.234766:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709302272:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1784047464.701082:0:91836:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 12:44:22 (1784047462) 00010000:00010000:0.0:1784047464.726931:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047464.802718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047464.802876:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453568 00000100:00100000:3.0:1784047464.802889:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453568 00000100:00100000:3.0:1784047464.802958:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1299 00000100:00100000:3.0:1784047464.802971:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+6:70928:x1870705689453568:12345-192.168.204.40@tcp:36:mkdir.0 00000100:00100000:3.0:1784047464.803115:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66219:1870705709302400:0@lo:900:mdt00_000.0 00000100:00100000:3.0:1784047464.803171:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.803202:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc89e0240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.803225:0:66230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302400 00000100:00100000:3.0:1784047464.803229:0:66230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302400 00000100:00100000:3.0:1784047464.803258:0:66230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784047464.803265:0:66230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfddc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66219:x1870705709302400:12345-0@lo:900:mdt00_000.0 00000100:00100000:3.0:1784047464.803314:0:66230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfddc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66219:x1870705709302400:12345-0@lo:900:mdt00_000.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.803323:0:66230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784047464.803412:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66219:1870705709302400:0@lo:900:mdt00_000.0 00000100:00100000:3.0:1784047464.803489:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302528:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.803522:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.803542:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e300 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.803558:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302528 00000100:00100000:3.0:1784047464.803562:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302528 00000100:00100000:3.0:1784047464.803592:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1784047464.803599:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.803697:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302528:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.803704:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1784047464.803731:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302528:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.806098:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.806174:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.806206:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047464.806273:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302656 00000100:00100000:2.0:1784047464.806290:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302656 00000100:00100000:2.0:1784047464.806349:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1784047464.806359:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784047464.806454:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302656:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047464.806463:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1784047464.809391:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.809508:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302784:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.809574:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.809677:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047464.809725:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302784 00000100:00100000:0.0:1784047464.809733:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302784 00000100:00100000:0.0:1784047464.809821:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1784047464.809832:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784047464.809958:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302784:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (384us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047464.809967:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1784047464.811073:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302784:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1784047464.811176:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.811186:0:66219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.811198:0:66219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047464.811217:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302912:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1784047464.811263:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.811300:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3483a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047464.811905:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709302912 00000100:00100000:0.0:1784047464.811914:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709302912 00000100:00100000:0.0:1784047464.811975:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1784047464.811987:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66219:x1870705709302912:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784047464.812018:0:23872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047464.812039:0:23872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c774fe1 expref: -99 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.812082:0:23872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.812093:0:23872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.812125:0:23872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.812140:0:23872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 8 pid: 67153 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047464.812153:0:23872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23872:1870705709303040:192.168.204.40@tcp:104: 00000100:00100000:0.0:1784047464.812236:0:23872:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00445f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047464.816460:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047464.816563:0:23872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23872:1870705709303040:192.168.204.40@tcp:104: 00010000:00010000:1.0:1784047464.816598:0:23872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.816632:0:23872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:1.0:1784047464.816635:0:23872:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047464.816639:0:23872:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.816702:0:23872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd200, rc 0) 00000100:00100000:1.0:1784047464.816776:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66219:x1870705709302912:12345-0@lo:101:mdt00_000.0 Request processed in 4782us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047464.816786:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1784047464.816994:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3c6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709302912:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784047464.817012:0:66219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.817023:0:66219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047464.817332:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453696 00000100:00100000:3.0:1784047464.817340:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453696 00010000:00010000:3.0:1784047464.817375:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 9 pid: 67153 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047464.817413:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2542 00000100:00100000:3.0:1784047464.817423:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+9:2401:x1870705689453696:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047464.817438:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047464.817446:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 9 pid: 67153 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.817459:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 9 pid: 67153 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.817494:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c774f63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2d0 expref: 9 pid: 67153 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.817507:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:3.0:1784047464.817511:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 6 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.817519:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 6 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.817527:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 6 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.817558:0:26194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 6 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047464.817572:0:26194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26194:1870705709303168:0@lo:105: 00000100:00100000:3.0:1784047464.817634:0:26194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.817669:0:26194:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:1.0:1784047464.817749:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784047464.817762:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303168 00000100:00100000:1.0:1784047464.817765:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303168 00000100:00100000:1.0:1784047464.817977:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1784047464.817985:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:26194:x1870705709303168:12345-0@lo:105: 00010000:00010000:1.0:1784047464.817995:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.818005:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.818013:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.818019:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.818027:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.818034:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.818071:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99ccf6c47000) 00000100:00100000:1.0:1784047464.818116:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:26194:x1870705709303168:12345-0@lo:105: Request processed in 133us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047464.818123:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784047464.818416:0:26194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26194:1870705709303168:0@lo:105: 00010000:00010000:3.0:1784047464.818432:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047464.818477:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a2569b5-a558-4441-a96a-1d77608df16b+8:2401:x1870705689453696:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 1055us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.818484:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2542 00010000:00010000:3.0:1784047464.819486:0:66219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.819512:0:66219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047464.819538:0:66219:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784047464.819585:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.819594:0:66219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.819624:0:66219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047464.819646:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303296:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1784047464.819690:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.819719:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.819740:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303296 00000100:00100000:3.0:1784047464.819746:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303296 00000100:00100000:3.0:1784047464.819789:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1784047464.819798:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66219:x1870705709303296:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784047464.819826:0:83733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047464.819842:0:83733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c774fef expref: -99 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.819865:0:83733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c774fef expref: 8 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.819879:0:83733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774fef expref: 8 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.819894:0:83733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99cd001e7400) 00010000:00010000:3.0:1784047464.819897:0:83733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047464.819900:0:83733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7ec00, rc 0) 00000100:00100000:3.0:1784047464.819938:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303296:12345-0@lo:101:mdt00_000.0 Request processed in 142us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.819944:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1784047464.819984:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303296:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784047464.819999:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.820009:0:66219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047464.820023:0:66219:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1784047464.821462:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303424:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.821527:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047464.821569:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e300 going to sleep for 11 seconds 00000100:00100000:2.0:1784047464.822923:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303424 00000100:00100000:2.0:1784047464.822939:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303424 00000100:00100000:2.0:1784047464.823004:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1784047464.823016:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784047464.823968:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303424:12345-0@lo:1000:mdt00_000.0 Request processed in 951us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047464.823979:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:1.0:1784047464.824170:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303424:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047464.825533:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303552:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047464.825599:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047464.825644:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.828617:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303552 00000100:00100000:3.0:1784047464.828636:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303552 00000100:00100000:3.0:1784047464.828699:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:3.0:1784047464.828710:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.828877:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303552:12345-0@lo:1000:mdt00_000.0 Request processed in 168us (3277us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047464.828886:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1784047464.828913:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303552:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047464.829147:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047464.829191:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047464.829211:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.829216:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303680 00000100:00100000:3.0:1784047464.829228:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303680 00000100:00100000:3.0:1784047464.829267:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1784047464.829274:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.829343:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303680:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (151us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047464.829349:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1784047464.829497:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047464.829544:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303808:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047464.829568:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047464.829592:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.830681:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303808 00000100:00100000:3.0:1784047464.830691:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303808 00000100:00100000:3.0:1784047464.830742:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:3.0:1784047464.830751:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.830982:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303808:12345-0@lo:1000:mdt00_000.0 Request processed in 232us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.830990:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:0.0:1784047464.831065:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303808:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784047464.831227:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303936:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784047464.831265:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047464.831396:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00445cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.831469:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709303936 00000100:00100000:3.0:1784047464.831474:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709303936 00000100:00100000:3.0:1784047464.831509:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1784047464.831516:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.831713:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709303936:12345-0@lo:1000:mdt00_000.0 Request processed in 196us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.831721:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1784047464.831849:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709303936:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784047464.831899:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709304064:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784047464.831926:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047464.831989:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00445cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047464.832023:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304064 00000100:00100000:3.0:1784047464.832028:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304064 00000100:00100000:3.0:1784047464.832181:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1784047464.832189:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709304064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047464.832254:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66219:x1870705709304064:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.832261:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:2.0:1784047464.832376:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef508e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66219:1870705709304064:0@lo:1000:mdt00_000.0 00000040:00080000:2.0:1784047464.832977:0:66219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].2, 1000 off35920 00000040:00080000:2.0:1784047464.833053:0:66219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].2, 1152 off36272 00000004:00080000:2.0:1784047464.833060:0:66219:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99ccc3483a80 with version 9 00000004:00080000:2.0:1784047464.833078:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 9 rpc_version 9 00000020:00100000:2.0:1784047464.833134:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784047464.833143:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99cbcec15f80 x1870705709304320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047464.833164:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec15f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709304320:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784047464.833212:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.833820:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a240 going to sleep for 11 seconds 00000100:00100000:0.0:1784047464.833917:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304320 00000100:00100000:0.0:1784047464.833925:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304320 00000100:00100000:0.0:1784047464.833972:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1784047464.833981:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75668:x1870705709304320:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784047464.836192:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75668:x1870705709304320:12345-0@lo:1000:osp_up0-1.0 Request processed in 2196us (2964us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1784047464.836208:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:2.0:1784047464.836410:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec15f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709304320:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784047464.836596:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836635:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836651:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047464.836673:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3d52e26 reply state 0000000085511dd7 transno 77309411439 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836684:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836705:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:0.0:1784047464.836707:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047464.836710:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784047464.836716:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00080000:0.0:1784047464.836726:0:66219:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784047464.836735:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836744:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836752:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836861:0:66219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784047464.836868:0:66219:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784047464.836874:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.836882:0:66219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047464.837067:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:70928:x1870705689453568:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 34094us (34361us total) trans 77309411439 rc 0/0 00010000:00010000:2.0:1784047464.837077:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784047464.837078:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1299 00010000:00010000:2.0:1784047464.837086:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.837095:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47000 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:2.0:1784047464.837101:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047464.837111:0:6507:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.837152:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.837160:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047464.837194:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.837202:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47000/0x4426598c0c774fe1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c774fe8 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047464.837219:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709304448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047464.837221:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047464.837223:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047464.837224:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047464.837284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.837382:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304448 00000100:00100000:2.0:1784047464.837389:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304448 00000100:00100000:2.0:1784047464.837452:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1784047464.837462:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1870705709304448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047464.837477:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047464.837497:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c774fe8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774fe1 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.837511:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400500) 00010000:00010000:2.0:1784047464.837519:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047464.837552:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3647:x1870705709304448:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047464.837558:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1784047464.837591:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709304448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047464.849838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047464.850012:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453824 00000100:00100000:2.0:1784047464.850024:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453824 00000100:00100000:2.0:1784047464.850110:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1300 00000100:00100000:2.0:1784047464.850124:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+8:70929:x1870705689453824:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047464.850152:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047464.850182:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46400/0x4426598c0c775004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2ec expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.850272:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c77500b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.850287:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c77500b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.850300:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c77500b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047464.850374:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047464.850378:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047464.850401:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c77500b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.850428:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46400/0x4426598c0c775004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2ec expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.850448:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c77500b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2ec expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.850457:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94200) 00010000:00010000:2.0:1784047464.850460:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047464.850464:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46000, rc 0) 00000100:00100000:2.0:1784047464.850539:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689453824:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 416us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047464.850548:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1300 00000100:00100000:2.0:1784047464.857990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047464.858894:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689453952 00000100:00100000:0.0:1784047464.858905:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689453952 00000100:00100000:0.0:1784047464.858965:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1301 00000100:00100000:0.0:1784047464.858977:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689453952:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047464.858999:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047464.859020:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c775012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2f3 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859114:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859130:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859143:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859155:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859166:0:66220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c774fef expref: 7 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859174:0:66220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.859208:0:66220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c774fef expref: 7 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047464.859226:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66220:1870705709304576:0@lo:104: 00000100:00100000:0.0:1784047464.859296:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047464.859331:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00445000 going to sleep for 11 seconds 00000100:00100000:2.0:1784047464.859499:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304576 00000100:00100000:2.0:1784047464.859503:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304576 00000100:00100000:2.0:1784047464.859541:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784047464.859548:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66220:x1870705709304576:12345-0@lo:104: 00010000:00010000:2.0:1784047464.859560:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.859624:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784047464.859630:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66220:x1870705709304576:12345-0@lo:104: Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047464.859643:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:2.0:1784047464.859663:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047464.859668:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.859677:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ee00 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:2.0:1784047464.859683:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047464.859693:0:16468:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.859718:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.859723:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047464.859740:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.859746:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebd7ee00/0x4426598c0c774fef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c774ff6 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.859776:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047464.859779:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047464.859781:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047464.859796:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709304704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047464.859824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.859855:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304704 00000100:00100000:2.0:1784047464.859864:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304704 00010000:00010000:2.0:1784047464.859881:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x4426598c0c774fef expref: 8 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047464.859904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1784047464.859910:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3648:x1870705709304704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047464.859919:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784047464.859996:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66220:1870705709304576:0@lo:104: 00010000:00010000:2.0:1784047464.860012:0:66220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784047464.861532:0:91009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:2.0:1784047464.861598:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7ec00/0x4426598c0c774ff6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c774fef expref: 7 pid: 83733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.861634:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99cd001e7400) 00010000:00010000:2.0:1784047464.861639:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.861648:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.861654:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.861676:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047464.861732:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709304704:12345-0@lo:103:ldlm_bl.0 Request processed in 1820us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047464.861740:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1784047464.862345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709304704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047464.862374:0:66220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.862383:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047464.862489:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66220:1870705709304832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784047464.862533:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047464.862567:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc935a540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047464.862874:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304832 00000100:00100000:0.0:1784047464.862882:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304832 00000100:00100000:0.0:1784047464.862925:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1784047464.862934:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66220:x1870705709304832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047464.863014:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66220:x1870705709304832:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.863022:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1784047464.863063:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66220:1870705709304832:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784047464.863331:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c775027 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863345:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c775027 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863354:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c775027 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047464.863377:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c775027 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863391:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863399:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863405:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863423:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863428:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047464.863432:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863439:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863450:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94200) 00010000:00010000:0.0:1784047464.863453:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047464.863457:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863464:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd000/0x4426598c0c775019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863477:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863482:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863488:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863492:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbce00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047464.863494:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863509:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863518:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99cd001e7400) 00010000:00010000:0.0:1784047464.863521:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047464.863524:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863530:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbce00/0x4426598c0c775020 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863568:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c775012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2f3 expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863583:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c775027 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2f3 expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047464.863591:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648e500) 00010000:00010000:0.0:1784047464.863593:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047464.863595:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc400, rc 0) 00000100:00100000:0.0:1784047464.863671:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+10:70929:x1870705689453952:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 4697us (5689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047464.863679:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1301 00000100:00100000:1.0:1784047464.882603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047464.882716:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689454080 00000100:00100000:3.0:1784047464.882726:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689454080 00000100:00100000:3.0:1784047464.882807:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1302 00000100:00100000:3.0:1784047464.882820:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ba0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+8:70929:x1870705689454080:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047464.882846:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047464.882872:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c77502e lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae2fa expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.882941:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f200/0x4426598c0c775035 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.882956:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f200/0x4426598c0c775035 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.882967:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f200/0x4426598c0c775035 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047464.883022:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1784047464.883026:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784047464.883076:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c77502e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2fa expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.883276:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f200/0x4426598c0c775035 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2fa expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.883287:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:3.0:1784047464.883290:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784047464.883294:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f200, rc 0) 00000100:00100000:3.0:1784047464.883405:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ba0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689454080:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 587us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.883433:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1302 00000100:00100000:2.0:1784047464.892731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047464.892920:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689454208 00000100:00100000:3.0:1784047464.892934:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689454208 00000100:00100000:3.0:1784047464.892999:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1303 00000100:00100000:3.0:1784047464.893010:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689454208:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047464.893034:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047464.893066:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c77503c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae301 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893140:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893156:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893168:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893183:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893191:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893198:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893241:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893259:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893265:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893272:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893279:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047464.893284:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893293:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893307:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:3.0:1784047464.893310:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047464.893315:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893321:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775043 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893331:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893337:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893343:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893354:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047464.893358:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893364:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893372:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99cd001e7900) 00010000:00010000:3.0:1784047464.893375:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047464.893378:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893384:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77504a lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893417:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c77503c lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae301 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893428:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:3.0:1784047464.893430:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047464.893434:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c77503c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae301 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.893443:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7e200, rc 0) 00000100:00100000:3.0:1784047464.893501:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689454208:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 493us (781us total) trans 0 rc 301/301 00000100:00100000:3.0:1784047464.893509:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1303 00000100:00100000:0.0:1784047464.910441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047464.910729:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689454336 00000100:00100000:2.0:1784047464.910739:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689454336 00000100:00100000:2.0:1784047464.910938:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1304 00000100:00100000:2.0:1784047464.910949:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689454336:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047464.910969:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047464.910991:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47000/0x4426598c0c775051 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae308 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911072:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911089:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911103:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911119:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911134:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911142:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911183:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911191:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911198:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911206:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911212:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047464.911217:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911224:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911236:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:2.0:1784047464.911239:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047464.911244:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911251:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775058 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911270:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911276:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911940:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911946:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047464.911949:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911956:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911965:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99ccd8400200) 00010000:00010000:2.0:1784047464.911968:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047464.911971:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.911978:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c77505f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.912022:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47000/0x4426598c0c775051 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae308 expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.912033:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:2.0:1784047464.912035:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047464.912060:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47000/0x4426598c0c775051 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae308 expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047464.912071:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47000, rc 0) 00000100:00100000:2.0:1784047464.912144:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689454336:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1196us (1712us total) trans 0 rc 301/301 00000100:00100000:2.0:1784047464.912152:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1304 00000100:00100000:1.0:1784047464.919290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047464.919892:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689454464 00000100:00100000:3.0:1784047464.919912:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689454464 00000100:00100000:3.0:1784047464.920064:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1305 00000100:00100000:3.0:1784047464.920076:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+9:70929:x1870705689454464:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047464.920096:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047464.920123:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae30f expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.920204:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77506d lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.920219:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77506d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.920232:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77506d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047464.920276:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1784047464.920280:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047464.920298:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77506d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.920325:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae30f expref: 11 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.920344:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77506d lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae30f expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.920353:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:3.0:1784047464.920356:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784047464.920359:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f800, rc 0) 00000100:00100000:3.0:1784047464.920426:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2569b5-a558-4441-a96a-1d77608df16b+10:70929:x1870705689454464:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 352us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047464.920433:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1305 00000100:00100000:2.0:1784047464.929191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047464.929294:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689454720 00000100:00100000:1.0:1784047464.929305:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689454720 00000100:00100000:1.0:1784047464.929371:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1306 00000100:00100000:1.0:1784047464.929382:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+10:70929:x1870705689454720:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047464.929404:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047464.929429:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccef9ce600/0x4426598c0c775074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae316 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047464.929539:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1784047464.929700:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccef9ce600/0x4426598c0c775074 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae316 expref: 12 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.929714:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccef89ea00) 00010000:00010000:1.0:1784047464.929717:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784047464.929722:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccef9ce600/0x4426598c0c775074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae316 expref: 12 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047464.929775:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce600, rc 0) 00000100:00100000:1.0:1784047464.930176:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:70929:x1870705689454720:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 457us (655us total) trans 77309411440 rc 301/301 00000100:00100000:1.0:1784047464.930188:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1306 00000100:00100000:3.0:1784047464.934316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047464.934387:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689454976 00000100:00100000:3.0:1784047464.934400:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689454976 00000100:00100000:3.0:1784047464.934476:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1307 00000100:00100000:3.0:1784047464.934489:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+11:70929:x1870705689454976:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:3.0:1784047464.935892:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047464.935948:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c77506d lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae30f expref: 11 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.935973:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:3.0:1784047464.935979:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047464.937572:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.937681:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.937700:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.937830:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.937839:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.937848:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939798:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939822:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939838:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047464.939861:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004177f20c reply state 00000000baeb5df8 transno 77309411441 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939873:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939882:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99cd001e7d00) 00010000:00010000:3.0:1784047464.939885:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047464.939890:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784047464.939898:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1784047464.939910:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939917:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939924:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939931:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939939:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047464.939955:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939965:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939982:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:3.0:1784047464.939985:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047464.939990:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.939998:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775082 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047464.940013:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004177f20c reply state 00000000baeb5df8 transno 77309411441 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.940022:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047464.940029:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99cd001e7900) 00010000:00010000:3.0:1784047464.940031:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047464.940034:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784047464.940335:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2569b5-a558-4441-a96a-1d77608df16b+12:70929:x1870705689454976:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 5841us (6036us total) trans 77309411441 rc 0/0 00000100:00100000:3.0:1784047464.940346:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1307 00000100:00100000:2.0:1784047464.943434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047464.943515:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689455232 00000100:00100000:0.0:1784047464.943530:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689455232 00000100:00100000:0.0:1784047464.943596:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 230 00000100:00100000:0.0:1784047464.943624:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+12:70929:x1870705689455232:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1784047464.944060:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2569b5-a558-4441-a96a-1d77608df16b+13:70929:x1870705689455232:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 453us (634us total) trans 77309411442 rc 0/0 00000100:00100000:0.0:1784047464.944069:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 230 00000100:00100000:2.0:1784047465.037552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047465.040099:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689455360 00000100:00100000:3.0:1784047465.040118:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689455360 00000100:00100000:3.0:1784047465.040199:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 722 00000100:00100000:3.0:1784047465.040211:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d42aef96-772a-4ce2-a768-bea713505b5b+10:2400:x1870705689455360:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047465.040230:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047465.040269:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24be00/0x4426598c0c774d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2b4 expref: 10 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047465.040289:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047465.040353:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d42aef96-772a-4ce2-a768-bea713505b5b+9:2400:x1870705689455360:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 144us (2812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047465.040361:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 722 00000100:00100000:3.0:1784047465.040489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047465.040582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047465.040635:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689455616 00000100:00100000:3.0:1784047465.040640:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689455616 00000100:00100000:3.0:1784047465.040666:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689455488 00000100:00100000:3.0:1784047465.040669:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689455488 00000100:00100000:3.0:1784047465.040692:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 723 00000100:00100000:3.0:1784047465.040700:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d42aef96-772a-4ce2-a768-bea713505b5b+10:2401:x1870705689455616:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047465.040708:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047465.040719:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418a00/0x4426598c0c774d48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2bb expref: 10 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047465.040730:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047465.040758:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d42aef96-772a-4ce2-a768-bea713505b5b+9:2401:x1870705689455616:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 59us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047465.040992:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 724 00000100:00100000:2.0:1784047465.041002:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d42aef96-772a-4ce2-a768-bea713505b5b+9:2399:x1870705689455488:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784047465.041010:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047465.041020:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1e00/0x4426598c0c774d4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2c2 expref: 9 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047465.041030:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047465.041069:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d42aef96-772a-4ce2-a768-bea713505b5b+8:2399:x1870705689455488:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 68us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047465.041076:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 724 00000100:00100000:3.0:1784047465.042934:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 723 00000100:00100000:2.0:1784047465.044098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047465.044163:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689456000 00000100:00100000:3.0:1784047465.044173:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689456000 00000100:00100000:3.0:1784047465.044233:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4980 00000100:00100000:3.0:1784047465.044244:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+7:2398:x1870705689456000:12345-192.168.204.40@tcp:9:umount.0 00000020:00000080:3.0:1784047465.044291:0:13594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774974 00000020:00010000:3.0:1784047465.044316:0:13594:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cce419c800: total 0 00000100:00080000:3.0:1784047465.044320:0:13594:0:(import.c:65:import_set_state_nolock()) ffff99cce419d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047465.046078:0:13594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968753 00000100:00100000:3.0:1784047465.046435:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a2569b5-a558-4441-a96a-1d77608df16b+5:2398:x1870705689456000:12345-192.168.204.40@tcp:9:umount.0 Request processed in 2187us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047465.046447:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4980 00000020:00010000:1.0:1784047465.051102:0:15071:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cce419c800: total 0 00010000:00010000:1.0:1784047465.051210:0:15071:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cce419c800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784047465.051292:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000526af617/0x4426598c0c774ab6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae28a expref: 4 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047465.051334:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baf73ba4/0x4426598c0c774ac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae298 expref: 3 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047465.051348:0:15071:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cce419c800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1784047465.051361:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047465.051363:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047465.051365:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047465.056152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047465.056381:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689456256 00000100:00100000:0.0:1784047465.056393:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689456256 00000100:00100000:0.0:1784047465.056488:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4981 00000100:00100000:0.0:1784047465.056500:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+6:2398:x1870705689456256:12345-192.168.204.40@tcp:9:umount.0 00000020:00000080:0.0:1784047465.056536:0:8824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77496d 00000020:00010000:0.0:1784047465.056548:0:8824:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cce419e000: total 0 00000100:00080000:0.0:1784047465.056553:0:8824:0:(import.c:65:import_set_state_nolock()) ffff99cce4198800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047465.056692:0:8824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968754 00000100:00100000:0.0:1784047465.059143:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2569b5-a558-4441-a96a-1d77608df16b+4:2398:x1870705689456256:12345-192.168.204.40@tcp:9:umount.0 Request processed in 2634us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047465.059158:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4981 00000020:00010000:2.0:1784047465.059564:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cce419e000: total 0 00010000:00010000:2.0:1784047465.059979:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cce419e000, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1784047465.060017:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1784047465.060023:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb atime from disk: 0 -> 1784047405 00002000:00010000:2.0:1784047465.060026:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x722:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1784047465.060090:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c774abd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae291 expref: 3 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047465.060119:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cce419e000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1784047465.060134:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047465.060136:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047465.060138:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047465.070282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047465.071707:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689456768 00000100:00100000:3.0:1784047465.071722:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689456768 00000100:00100000:3.0:1784047465.075312:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1308 00000100:00100000:3.0:1784047465.075335:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+10:2398:x1870705689456768:12345-192.168.204.40@tcp:39:umount.0 00000020:00000080:3.0:1784047465.075383:0:68026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bc0 00000020:00010000:3.0:1784047465.075403:0:68026:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cbd0b6f800: total 0 00000100:00080000:3.0:1784047465.075408:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99cce4927800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047465.075429:0:68026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116995 00000100:00100000:3.0:1784047465.075633:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a2569b5-a558-4441-a96a-1d77608df16b+8:2398:x1870705689456768:12345-192.168.204.40@tcp:39:umount.0 Request processed in 306us (5360us total) trans 115964116996 rc 0/0 00000100:00100000:3.0:1784047465.075642:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1308 00000020:00010000:0.0:1784047465.076576:0:16469:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cbd0b6f800: total 0 00010000:00010000:0.0:1784047465.076582:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047465.076677:0:16469:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cbd0b6f800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784047465.076716:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94200) 00010000:00010000:0.0:1784047465.076720:0:16469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047465.076731:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c77500b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2ec expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.076771:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:0.0:1784047465.076774:0:16469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047465.076779:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c774fd3 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2e5 expref: 6 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.076821:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648e500) 00010000:00010000:0.0:1784047465.076824:0:16469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047465.076828:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c775027 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2f3 expref: 5 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.076847:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff99ccc37b6f00) 00010000:00010000:0.0:1784047465.076849:0:16469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1784047465.076853:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7f000/0x4426598c0c774daa lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae283 expref: 4 pid: 91042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.076866:0:16469:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cbd0b6f800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1784047465.076880:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047465.076882:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047465.076884:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047465.089203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047465.089496:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457024 00000100:00100000:1.0:1784047465.089505:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457024 00000100:00100000:1.0:1784047465.089572:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1309 00000100:00100000:1.0:1784047465.089584:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+13:2398:x1870705689457024:12345-192.168.204.40@tcp:39:umount.0 00000020:00000080:1.0:1784047465.089664:0:67153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c76f92c 00000020:00010000:1.0:1784047465.089680:0:67153:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cce4921800: total 0 00000100:00080000:1.0:1784047465.089685:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99cd00cfd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047465.089730:0:67153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411442 00010000:00010000:0.0:1784047465.089874:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089885:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089892:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089898:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047465.089903:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047465.089904:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2569b5-a558-4441-a96a-1d77608df16b+11:2398:x1870705689457024:12345-192.168.204.40@tcp:39:umount.0 Request processed in 323us (714us total) trans 77309411443 rc 0/0 00010000:00010000:0.0:1784047465.089910:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047465.089925:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1309 00010000:00010000:0.0:1784047465.089935:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:0.0:1784047465.089937:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047465.089942:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089948:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbc200/0x4426598c0c774ffd lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089977:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089985:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089992:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.089997:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047465.090000:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090006:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090014:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99cd001e7900) 00010000:00010000:0.0:1784047465.090017:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047465.090019:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1784047465.090022:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cce4921800: total 0 00010000:00010000:0.0:1784047465.090025:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f600/0x4426598c0c775089 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090067:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090072:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047465.090084:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cce4921800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784047465.090093:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090098:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047465.090101:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090106:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047465.090109:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ef00) 00010000:00010000:2.0:1784047465.090112:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1784047465.090114:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99cd001e7d00) 00010000:00010000:0.0:1784047465.090116:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047465.090117:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f200/0x4426598c0c775035 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2fa expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090119:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047465.090125:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fa00/0x4426598c0c775090 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047465.090144:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cce4921800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1784047465.090156:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047465.090158:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047465.090159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047465.155015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047465.155161:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457280 00000100:00100000:3.0:1784047465.155175:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457280 00000100:00100000:3.0:1784047465.155244:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:3.0:1784047465.155255:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+7:2398:x1870705689457280:12345-192.168.204.40@tcp:251:umount.0 00000020:00000080:3.0:1784047465.155302:0:91015:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c76 00000020:00010000:3.0:1784047465.155310:0:91015:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccd897e000: total 0 00000100:00080000:3.0:1784047465.155315:0:91015:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784047465.156086:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aef96-772a-4ce2-a768-bea713505b5b+3:2398:x1870705689457280:12345-192.168.204.40@tcp:251:umount.0 Request processed in 829us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047465.156097:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000020:00010000:2.0:1784047465.156731:0:16468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccd897e000: total 0 00010000:00010000:2.0:1784047465.156799:0:16468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccd897e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784047465.156833:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419600/0x4426598c0c774d56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae2c9 expref: 2 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047465.156849:0:16468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccd897e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784047465.156857:0:16468:0:(genops.c:906:class_export_put()) final put ffff99ccd897e000/d42aef96-772a-4ce2-a768-bea713505b5b 00010000:00010000:2.0:1784047465.156871:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047465.156874:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047465.156882:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784047465.157213:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd897e000/d42aef96-772a-4ce2-a768-bea713505b5b for MGS 00000020:00000080:3.0:1784047465.157256:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897f800 for MGS 00010000:00010000:0.0:1784047465.754576:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047466.539838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.539928:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457408 00000100:00100000:1.0:1784047466.539938:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457408 00000100:00100000:1.0:1784047466.539989:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1784047466.539999:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1870705689457408:12345-192.168.204.40@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784047466.540042:0:91016:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp t0 exp 0000000000000000 cur 3564 last 0 00000020:00000080:1.0:1784047466.540071:0:91016:0:(genops.c:1406:class_connect()) connect: client 4f88e784-1ed8-4645-9d2f-1081095d1f30, cookie 0x4426598c0c775097 00000100:00080000:1.0:1784047466.540116:0:91016:0:(import.c:65:import_set_state_nolock()) ffff99ccc6dab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047466.540193:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+5:2398:x1870705689457408:12345-192.168.204.40@tcp:250:mount.lustre.0 Request processed in 193us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.540201:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:0.0:1784047466.542485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.542567:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457536 00000100:00100000:1.0:1784047466.542576:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457536 00000100:00100000:1.0:1784047466.542661:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:1.0:1784047466.542672:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+5:70951:x1870705689457536:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784047466.542686:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047466.542705:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cf600/0x4426598c0c77509e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae32b expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.542735:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cf600/0x4426598c0c77509e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae32b expref: 6 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.542747:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cf600/0x4426598c0c77509e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae32b expref: 6 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.542756:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf600, rc 0) 00000100:00100000:1.0:1784047466.542821:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70951:x1870705689457536:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.542828:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:3.0:1784047466.547426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.547540:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457664 00000100:00100000:1.0:1784047466.547550:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457664 00000100:00100000:1.0:1784047466.547700:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:1.0:1784047466.547712:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70951:x1870705689457664:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784047466.547832:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70951:x1870705689457664:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 122us (417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047466.547841:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1784047466.552758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.552903:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457792 00000100:00100000:1.0:1784047466.552913:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457792 00000100:00100000:1.0:1784047466.552970:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:1.0:1784047466.552981:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70951:x1870705689457792:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784047466.552999:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047466.553029:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce000/0x4426598c0c7750a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae332 expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.553069:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce000/0x4426598c0c7750a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae332 expref: 7 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.553081:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce000/0x4426598c0c7750a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae332 expref: 7 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.553090:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce000, rc 0) 00000100:00100000:1.0:1784047466.553161:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+7:70951:x1870705689457792:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 181us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.553184:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:0.0:1784047466.558351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047466.558469:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689457920 00000100:00100000:2.0:1784047466.558480:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689457920 00000100:00100000:2.0:1784047466.558532:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:2.0:1784047466.558543:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+7:70951:x1870705689457920:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784047466.558742:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70951:x1870705689457920:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 200us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.558750:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:2.0:1784047466.576804:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.576947:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458048 00000100:00100000:1.0:1784047466.576956:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458048 00000100:00100000:1.0:1784047466.577071:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:1.0:1784047466.577082:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70951:x1870705689458048:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784047466.577239:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70951:x1870705689458048:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 158us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.577247:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:0.0:1784047466.585397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047466.585634:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458176 00000100:00100000:2.0:1784047466.585646:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458176 00000100:00100000:2.0:1784047466.585720:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 89 00000100:00100000:2.0:1784047466.585731:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce5879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70969:x1870705689458176:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784047466.585892:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce5879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70969:x1870705689458176:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 163us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.585900:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 89 00000100:00100000:0.0:1784047466.613143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047466.619433:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458304 00000100:00100000:3.0:1784047466.619451:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458304 00000100:00100000:2.0:1784047466.623741:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:2.0:1784047466.623757:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce587bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70969:x1870705689458304:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784047466.623946:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce587bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70969:x1870705689458304:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 191us (10812us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.623955:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:3.0:1784047466.629719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.630859:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458432 00000100:00100000:1.0:1784047466.630871:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458432 00000100:00100000:1.0:1784047466.633485:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:1.0:1784047466.633509:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70969:x1870705689458432:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784047466.633732:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70969:x1870705689458432:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 232us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.633742:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:0.0:1784047466.655965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.656474:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458560 00000100:00100000:1.0:1784047466.656490:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458560 00000100:00100000:1.0:1784047466.656804:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:1.0:1784047466.656818:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70951:x1870705689458560:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784047466.656902:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047466.656934:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cfc00/0x4426598c0c7750ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae363 expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.656979:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cfc00/0x4426598c0c7750ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae363 expref: 9 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.657646:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cfc00/0x4426598c0c7750ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae363 expref: 9 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047466.657658:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfc00, rc 0) 00000100:00100000:1.0:1784047466.657969:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70951:x1870705689458560:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 1152us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.657980:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:1.0:1784047466.664815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047466.667574:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458688 00000100:00100000:2.0:1784047466.667590:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458688 00000100:00100000:2.0:1784047466.667685:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:2.0:1784047466.667697:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70951:x1870705689458688:12345-192.168.204.40@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784047466.667743:0:91015:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784047466.667761:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784047466.667764:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784047466.667767:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784047466.667770:0:91015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784047466.667772:0:91015:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 121 00000100:00100000:2.0:1784047466.672110:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70951:x1870705689458688:12345-192.168.204.40@tcp:256:mount.lustre.0 Request processed in 4401us (7297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.672126:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:3.0:1784047466.685283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.685412:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458816 00000100:00100000:1.0:1784047466.685431:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458816 00000100:00100000:2.0:1784047466.691207:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:2.0:1784047466.691308:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70951:x1870705689458816:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784047466.691327:0:91013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047466.691349:0:91013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46200/0x4426598c0c7750b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae36a expref: -99 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047466.691382:0:91013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46200/0x4426598c0c7750b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae36a expref: 10 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047466.691395:0:91013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46200/0x4426598c0c7750b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae36a expref: 10 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047466.691406:0:91013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46200, rc 0) 00000100:00100000:2.0:1784047466.692053:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70951:x1870705689458816:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 757us (6777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.692062:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:1.0:1784047466.698743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047466.698887:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689458944 00000100:00100000:0.0:1784047466.698905:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689458944 00000100:00100000:0.0:1784047466.699078:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:0.0:1784047466.699091:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70951:x1870705689458944:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784047466.699312:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70951:x1870705689458944:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 222us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.699321:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:3.0:1784047466.702799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047466.703586:0:91013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459072 00000100:00100000:2.0:1784047466.703598:0:91013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459072 00000100:00100000:3.0:1784047466.704555:0:91013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1784047466.704568:0:91013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70951:x1870705689459072:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784047466.706341:0:91013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70951:x1870705689459072:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 1765us (3541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047466.706356:0:91013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1784047466.711131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047466.711250:0:91015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459200 00000100:00100000:2.0:1784047466.711266:0:91015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459200 00000100:00100000:2.0:1784047466.711407:0:91015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:2.0:1784047466.711419:0:91015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70975:x1870705689459200:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784047466.711660:0:91015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70975:x1870705689459200:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 242us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.711669:0:91015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:1.0:1784047466.716872:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047466.716986:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459328 00000100:00100000:0.0:1784047466.716995:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459328 00000100:00100000:0.0:1784047466.717073:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:0.0:1784047466.717083:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70975:x1870705689459328:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784047466.717251:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70975:x1870705689459328:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 168us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.717259:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:3.0:1784047466.730601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047466.732771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047466.750200:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459456 00000100:00100000:0.0:1784047466.750230:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459456 00000100:00100000:0.0:1784047466.750312:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459712 00000100:00100000:0.0:1784047466.750317:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459712 00000100:00100000:0.0:1784047466.750355:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1310 00000100:00100000:0.0:1784047466.750365:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689459456:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784047466.750407:0:66219:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3565 last 0 00000100:00100000:2.0:1784047466.750653:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1311 00000100:00100000:2.0:1784047466.750661:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689459712:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784047466.750677:0:67153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3565 last 0 00000020:00000080:0.0:1784047466.751163:0:66219:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c7750ba 00000004:00100000:0.0:1784047466.751194:0:66219:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1784047466.753629:0:67153:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c7750c1 00000004:00100000:2.0:1784047466.753665:0:67153:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784047466.753803:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccff381800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047466.753975:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689459712:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 3310us (21206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.753996:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1311 00000100:00080000:0.0:1784047466.754911:0:66219:0:(import.c:65:import_set_state_nolock()) ffff99cbcae21000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047466.754975:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689459456:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 4608us (24382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.754984:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1310 00000100:00100000:1.0:1784047466.768928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047466.768973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047466.769080:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459840 00000100:00100000:3.0:1784047466.769091:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459840 00000100:00100000:3.0:1784047466.769170:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459584 00000100:00100000:3.0:1784047466.769174:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459584 00000100:00100000:3.0:1784047466.769200:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1312 00000100:00100000:3.0:1784047466.769210:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:0:x1870705689459840:12345-192.168.204.40@tcp:41:mount.lustre.0 00000100:00100000:0.0:1784047466.769254:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1313 00000004:00000024:3.0:1784047466.769260:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1784047466.769269:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:0:x1870705689459584:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784047466.769292:0:68026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444986880 avail 1298747392 00000100:00100000:3.0:1784047466.769352:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:0:x1870705689459840:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 137us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047466.769360:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1312 00000100:00080000:1.0:1784047466.769576:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047466.769580:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047466.771670:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047466.771696:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709304960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047466.771764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047466.771819:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709304960 00000100:00100000:2.0:1784047466.771826:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709304960 00000100:00100000:2.0:1784047466.771882:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:2.0:1784047466.771893:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709304960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047466.771923:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1784047466.772137:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047466.772285:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709304960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.772306:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:2.0:1784047466.772335:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709305088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047466.772365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047466.772426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709304960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047466.772551:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305088 00000100:00100000:1.0:1784047466.772555:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305088 00000100:00100000:1.0:1784047466.772591:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1784047466.772598:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709305088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047466.772631:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047466.772665:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709305088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047466.772671:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00080000:1.0:1784047466.772686:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047466.772777:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709305088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047466.773726:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:0:x1870705689459584:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 4454us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.773739:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1313 00010000:00010000:1.0:1784047466.774083:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047466.780875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047466.782133:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689459968 00000100:00100000:0.0:1784047466.782148:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689459968 00000100:00100000:0.0:1784047466.782394:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1314 00000100:00100000:0.0:1784047466.782405:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689459968:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784047466.782436:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444986880 avail 1298747392 00000100:00100000:0.0:1784047466.782520:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689459968:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 117us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.782529:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1314 00000100:00100000:1.0:1784047466.789137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047466.789785:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460096 00000100:00100000:2.0:1784047466.789872:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460096 00000100:00100000:2.0:1784047466.789942:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1315 00000100:00100000:2.0:1784047466.789953:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689460096:12345-192.168.204.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784047466.790061:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689460096:12345-192.168.204.40@tcp:40:mount.lustre.0 Request processed in 110us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.790069:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1315 00000100:00100000:3.0:1784047466.796536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047466.796601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047466.796681:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047466.796806:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460224 00000100:00100000:0.0:1784047466.796817:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460224 00000100:00100000:1.0:1784047466.796837:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460352 00000100:00100000:1.0:1784047466.796840:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460352 00000100:00100000:0.0:1784047466.796871:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4982 00000100:00100000:0.0:1784047466.796880:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2398:x1870705689460224:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784047466.796914:0:26196:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3565 last 0 00000020:00000080:0.0:1784047466.796947:0:26196:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c7750c8 00002000:00100000:0.0:1784047466.796960:0:26196:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccd897e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047466.796991:0:26196:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784047466.797111:0:26196:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784047466.797148:0:26196:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047466.797229:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689460224:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 348us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.797237:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4982 00000100:00100000:0.0:1784047466.797257:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4983 00000100:00100000:0.0:1784047466.797261:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2398:x1870705689460352:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784047466.797281:0:26196:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3565 last 0 00000020:00000080:0.0:1784047466.797299:0:26196:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c7750cf 00002000:00100000:0.0:1784047466.797304:0:26196:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccd8978800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047466.797444:0:26196:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784047466.797491:0:26196:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047466.797506:0:26196:0:(import.c:65:import_set_state_nolock()) ffff99cbc6537800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047466.797529:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689460352:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 266us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.797536:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4983 00000100:00100000:2.0:1784047466.797595:0:66230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460480 00000100:00100000:2.0:1784047466.797599:0:66230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460480 00000100:00100000:2.0:1784047466.797656:0:66230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:2.0:1784047466.797663:0:66230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689460480:12345-192.168.204.40@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784047466.797695:0:66230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689460480:12345-192.168.204.40@tcp:900:mount.lustre.0 Request processed in 33us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047466.797702:0:66230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1784047466.803624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047466.804351:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460608 00000100:00100000:0.0:1784047466.804362:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460608 00000100:00100000:0.0:1784047466.804466:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 231 00000100:00100000:0.0:1784047466.804478:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689460608:12345-192.168.204.40@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784047466.804589:0:66222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784047466.805249:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:70951:x1870705689460608:12345-192.168.204.40@tcp:33:mount.lustre.0 Request processed in 770us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047466.805277:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 231 00010000:00010000:0.0:1784047467.794875:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047468.789639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047468.789712:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460736 00000100:00100000:2.0:1784047468.789725:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460736 00000100:00100000:2.0:1784047468.790012:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1316 00000100:00100000:2.0:1784047468.790025:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689460736:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047468.790046:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047468.790087:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7750d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae39b expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047468.790165:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c7750dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047468.790181:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c7750dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047468.790195:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c7750dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047468.790246:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047468.790250:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047468.790271:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c7750dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047468.790298:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7750d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047468.790318:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c7750dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047468.790327:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400200) 00010000:00010000:2.0:1784047468.790330:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047468.790333:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46000, rc 0) 00000100:00100000:2.0:1784047468.790406:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:71019:x1870705689460736:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 383us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.791117:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1316 00000100:00080000:1.0:1784047468.794257:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047468.798714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047468.799020:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460864 00000100:00100000:0.0:1784047468.799036:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460864 00000100:00100000:0.0:1784047468.799114:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1317 00000100:00100000:0.0:1784047468.799127:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:71019:x1870705689460864:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047468.799173:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444986880 avail 1298747392 00000100:00100000:0.0:1784047468.799255:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:71019:x1870705689460864:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 129us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047468.799263:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1317 00000100:00100000:0.0:1784047468.807034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047468.807139:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689460992 00000100:00100000:2.0:1784047468.807162:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689460992 00000100:00100000:2.0:1784047468.807256:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1318 00000100:00100000:2.0:1784047468.807268:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689460992:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047468.807314:0:67153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1784047468.807378:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689460992:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.807386:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1318 00000100:00080000:1.0:1784047468.807565:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047468.816084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047468.816870:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461120 00000100:00100000:0.0:1784047468.816881:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461120 00000100:00100000:0.0:1784047468.816981:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2100 00000100:00100000:0.0:1784047468.816993:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689461120:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047468.817038:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047468.817130:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689461120:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 138us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047468.817138:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2100 00000100:00080000:1.0:1784047468.817336:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047468.819413:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709305472:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709305216:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.819661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709305728:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.819707:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709306240:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.819822:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709306752:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.819878:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784047468.819885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709305344:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.819931:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709305856:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.819958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.819990:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709306368:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.820135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047468.820155:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709305984:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.820329:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305728 00000100:00100000:0.0:1784047468.820336:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305728 00000100:00100000:0.0:1784047468.820388:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306240 00000100:00100000:0.0:1784047468.820391:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306240 00000100:00100000:0.0:1784047468.820404:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306752 00000100:00100000:0.0:1784047468.820406:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306752 00000100:00100000:3.0:1784047468.820537:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709306880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047468.820598:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305344 00000100:00100000:3.0:1784047468.820602:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305344 00000100:00100000:3.0:1784047468.820648:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305472 00000100:00100000:3.0:1784047468.820652:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305472 00000100:00100000:3.0:1784047468.820671:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1784047468.820679:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709305728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.820825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.820870:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709305728:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.820900:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305856 00000100:00100000:2.0:1784047468.820918:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305856 00000100:00100000:2.0:1784047468.820948:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306368 00000100:00100000:2.0:1784047468.820951:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306368 00000100:00100000:2.0:1784047468.820982:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1784047468.820989:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709305856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.821029:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709305856:12345-0@lo:400:kworker.0 Request processed in 40us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.821036:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1784047468.821052:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1784047468.821057:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709306368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.821084:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709306368:12345-0@lo:400:kworker.0 Request processed in 27us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.821090:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00010000:00010000:2.0:1784047468.821106:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047468.821123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047468.821149:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306880 00000100:00100000:2.0:1784047468.821152:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306880 00000100:00100000:2.0:1784047468.821172:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:2.0:1784047468.821177:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709306880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047468.821194:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1784047468.821226:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709306880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.821232:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:2.0:1784047468.821261:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709306880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047468.821281:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:2.0:1784047468.821287:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:2.0:1784047468.821304:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709305856:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.821325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709306368:0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.821358:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1784047468.821366:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709306240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.821401:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709306240:12345-0@lo:400:kworker.0 Request processed in 37us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.821408:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1784047468.821848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047468.821879:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709306496:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.821912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047468.821934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784047468.821941:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709305600:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.821964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047468.821988:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709306112:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.822010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047468.822030:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709306624:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.822052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047468.822084:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305984 00000100:00100000:1.0:1784047468.822090:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305984 00000100:00100000:1.0:1784047468.822124:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306496 00000100:00100000:1.0:1784047468.822127:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306496 00000100:00100000:1.0:1784047468.822143:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306112 00000100:00100000:1.0:1784047468.822157:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306112 00000100:00100000:1.0:1784047468.822182:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709306624 00000100:00100000:1.0:1784047468.822185:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709306624 00000100:00100000:1.0:1784047468.822206:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1784047468.822213:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709305984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.822256:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709305984:12345-0@lo:400:kworker.0 Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047468.822263:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1784047468.822279:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1784047468.822285:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709306496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.822314:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709306496:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047468.822321:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1784047468.822333:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1784047468.822340:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709306112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.822370:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709306112:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047468.822377:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1784047468.822388:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1784047468.822395:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709306624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.822561:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305600 00000100:00100000:0.0:1784047468.822567:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305600 00000100:00100000:2.0:1784047468.823570:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1784047468.823587:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709305344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047468.823669:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709305344:12345-0@lo:400:kworker.0 Request processed in 88us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047468.823676:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1784047468.823894:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709305728:12345-0@lo:400:kworker.0 Request processed in 52us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047468.823903:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1784047468.823977:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709306624:12345-0@lo:400:kworker.0 Request processed in 1571us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047468.823986:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00080000:1.0:1784047468.824057:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047468.824063:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047468.824066:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047468.824068:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047468.824147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709306112:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.824162:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709306624:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.824174:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709305984:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.824186:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709306496:0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.824235:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:1.0:1784047468.824244:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047468.824292:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709305472:12345-0@lo:400:kworker.0 Request processed in 45us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047468.824299:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1784047468.827865:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1784047468.827891:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709306752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.827998:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709306752:12345-0@lo:400:kworker.0 Request processed in 120us (8147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047468.828006:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1784047468.828026:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1784047468.828034:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709305600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828068:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709305600:12345-0@lo:400:kworker.0 Request processed in 36us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047468.828075:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1784047468.828104:0:91020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709305216 00000100:00100000:0.0:1784047468.828112:0:91020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709305216 00000100:00100000:0.0:1784047468.828159:0:91020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784047468.828166:0:91020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709305216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828198:0:91020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709305216:12345-0@lo:400:kworker.0 Request processed in 32us (8598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047468.828204:0:91020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784047468.828382:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709305600:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828396:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709305472:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828464:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709305344:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828474:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709305216:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828485:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709306240:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828494:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709306752:0@lo:400:kworker.0 00000100:00100000:0.0:1784047468.828599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047468.828656:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461248 00000100:00100000:0.0:1784047468.828660:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461248 00000100:00100000:0.0:1784047468.828696:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2101 00000100:00100000:0.0:1784047468.828703:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689461248:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047468.828726:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047468.828776:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:71019:x1870705689461248:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047468.828783:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2101 00000100:00080000:0.0:1784047468.828805:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047469.331011:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047469.331058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709307008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047469.331314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047469.331387:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307008 00000100:00100000:0.0:1784047469.331398:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307008 00000100:00100000:0.0:1784047469.331461:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1784047469.331473:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709307008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047469.331508:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047469.331564:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709307008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047469.331573:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1784047469.331661:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709307008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047469.332126:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047469.332141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709307136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047469.332259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047469.332413:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307136 00000100:00100000:1.0:1784047469.332652:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307136 00000100:00100000:1.0:1784047469.332694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1784047469.332703:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709307136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047469.332723:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047469.332776:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709307136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047469.332784:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1784047469.332888:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709307136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047469.338289:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709307264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047469.338401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047469.338477:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307264 00000100:00100000:2.0:1784047469.338488:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307264 00000100:00100000:2.0:1784047469.338561:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1784047469.338575:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709307264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047469.338653:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444986880 avail 1298747392 00000100:00100000:2.0:1784047469.338710:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709307264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047469.338742:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1784047469.338811:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709307264:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784047469.842937:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047469.953017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047469.954157:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461376 00000100:00100000:0.0:1784047469.954175:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461376 00000100:00100000:0.0:1784047469.954266:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1319 00000100:00100000:0.0:1784047469.954280:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689461376:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:0.0:1784047469.954317:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047469.954347:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd400/0x4426598c0c7750e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3a2 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954440:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954460:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954476:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954497:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954506:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954514:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954596:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7750f9 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954628:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7750f9 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954637:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7750f9 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047469.954684:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7750f9 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954709:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954716:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954724:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954730:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954738:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047469.954742:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954751:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954766:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400200) 00010000:00010000:0.0:1784047469.954770:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047469.954776:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954784:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbca00/0x4426598c0c7750eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954800:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954806:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954819:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954824:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047469.954827:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954834:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954843:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99ccc648e800) 00010000:00010000:0.0:1784047469.954846:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047469.954850:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954857:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd800/0x4426598c0c7750f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954917:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd400/0x4426598c0c7750e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3a2 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954936:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7750f9 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3a2 expref: 8 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.954953:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccc648ea00) 00010000:00010000:0.0:1784047469.954956:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047469.954959:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbde00, rc 0) 00000100:00100000:0.0:1784047469.955047:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689461376:12345-192.168.204.40@tcp:101:cp.0 Request processed in 767us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047469.955066:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1319 00000100:00100000:0.0:1784047469.963338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047469.963586:0:66230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461504 00000100:00100000:3.0:1784047469.963601:0:66230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461504 00000100:00100000:3.0:1784047469.964589:0:66230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1784047469.964627:0:66230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c846d7a-6357-4e9c-a620-e35737ede709+6:71053:x1870705689461504:12345-192.168.204.40@tcp:900:cp.0 00000100:00100000:3.0:1784047469.964930:0:66230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c846d7a-6357-4e9c-a620-e35737ede709+6:71053:x1870705689461504:12345-192.168.204.40@tcp:900:cp.0 Request processed in 325us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047469.964940:0:66230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:0.0:1784047469.971873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047469.972399:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461632 00000100:00100000:3.0:1784047469.972412:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461632 00000100:00100000:3.0:1784047469.972558:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1320 00000100:00100000:3.0:1784047469.972573:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:71053:x1870705689461632:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:3.0:1784047469.972602:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047469.972692:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f400/0x4426598c0c775100 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3a9 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.972780:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775107 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.972798:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775107 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.972814:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775107 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047469.972876:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1784047469.972882:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784047469.972960:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f400/0x4426598c0c775100 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3a9 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.972982:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775107 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3a9 expref: 7 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.972991:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:3.0:1784047469.972995:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784047469.972998:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7e200, rc 0) 00000100:00100000:3.0:1784047469.973083:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689461632:12345-192.168.204.40@tcp:101:cp.0 Request processed in 513us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047469.973091:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1320 00000100:00100000:3.0:1784047469.979058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047469.979730:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461760 00000100:00100000:0.0:1784047469.979745:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461760 00000100:00100000:0.0:1784047469.979823:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1321 00000100:00100000:0.0:1784047469.979836:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689461760:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:0.0:1784047469.979864:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047469.979895:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd400/0x4426598c0c77510e lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3b0 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980021:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980041:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980057:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980077:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980084:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980090:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980199:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbdc00/0x4426598c0c775123 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980225:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbdc00/0x4426598c0c775123 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980233:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbdc00/0x4426598c0c775123 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047469.980283:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1784047469.980288:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047469.980319:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbdc00/0x4426598c0c775123 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980335:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980343:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980350:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980358:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980365:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047469.980370:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980379:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980394:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:0.0:1784047469.980402:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047469.980409:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980417:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd800/0x4426598c0c775115 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980436:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980443:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980448:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980453:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047469.980456:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980461:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980468:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99ccc648e800) 00010000:00010000:0.0:1784047469.980470:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047469.980473:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980479:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbca00/0x4426598c0c77511c lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980840:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbd400/0x4426598c0c77510e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3b0 expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980870:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbdc00/0x4426598c0c775123 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3b0 expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047469.980879:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:0.0:1784047469.980881:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784047469.980883:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbdc00, rc 0) 00000100:00100000:0.0:1784047469.980985:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689461760:12345-192.168.204.40@tcp:101:cp.0 Request processed in 1150us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047469.980994:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1321 00000100:00100000:1.0:1784047469.989272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047469.989343:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689461888 00000100:00100000:2.0:1784047469.989359:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689461888 00000100:00100000:2.0:1784047469.989445:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1322 00000100:00100000:2.0:1784047469.989459:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689461888:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:2.0:1784047469.989488:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047469.989518:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46800/0x4426598c0c77512a lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3b7 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989664:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989683:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989698:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989716:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989723:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989729:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989797:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989805:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989812:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989818:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989825:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047469.989830:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989838:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989854:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:2.0:1784047469.989856:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047469.989862:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989869:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775131 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989887:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989894:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989907:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989913:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047469.989916:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989922:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989931:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff99ccd8400700) 00010000:00010000:2.0:1784047469.989933:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047469.989936:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989942:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46e00/0x4426598c0c775138 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.989998:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46800/0x4426598c0c77512a lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3b7 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.990010:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:2.0:1784047469.990022:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047469.990027:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46800/0x4426598c0c77512a lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3b7 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047469.990039:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46800, rc 0) 00000100:00100000:2.0:1784047469.990124:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689461888:12345-192.168.204.40@tcp:101:cp.0 Request processed in 667us (868us total) trans 0 rc 301/301 00000100:00100000:2.0:1784047469.990140:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1322 00000100:00100000:2.0:1784047469.995272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047469.995529:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462016 00000100:00100000:3.0:1784047469.995544:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462016 00000100:00100000:3.0:1784047469.995669:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1323 00000100:00100000:3.0:1784047469.995702:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689462016:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:3.0:1784047469.995734:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047469.995763:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f400/0x4426598c0c77513f lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3be expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.995857:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.995877:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.995893:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.995911:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.995918:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.995926:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996001:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996010:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996029:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996048:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996056:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047469.996061:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996070:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996087:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:3.0:1784047469.996091:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047469.996096:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996104:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f800/0x4426598c0c775146 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996123:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996129:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996135:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996140:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047469.996142:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996160:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996170:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff99cd001e7700) 00010000:00010000:3.0:1784047469.996172:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047469.996175:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996181:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7fc00/0x4426598c0c77514d lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996226:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f400/0x4426598c0c77513f lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3be expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996238:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:3.0:1784047469.996240:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047469.996245:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7f400/0x4426598c0c77513f lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3be expref: 9 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047469.996255:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f400, rc 0) 00000100:00100000:3.0:1784047469.996344:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689462016:12345-192.168.204.40@tcp:101:cp.0 Request processed in 646us (1089us total) trans 0 rc 301/301 00000100:00100000:3.0:1784047469.996352:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1323 00000100:00100000:3.0:1784047470.003096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047470.003178:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462144 00000100:00100000:0.0:1784047470.003190:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462144 00000100:00100000:0.0:1784047470.003300:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:0.0:1784047470.003313:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689462144:12345-192.168.204.40@tcp:700:cp.0 00000020:02000000:0.0:1784047470.003348:0:66229:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00080000:2.0:1784047470.007942:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047470.017077:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0c846d7a-6357-4e9c-a620-e35737ede709+8:71053:x1870705689462144:12345-192.168.204.40@tcp:700:cp.0 Request processed in 13749us (13979us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047470.017097:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00010000:00010000:0.0:1784047470.867069:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784047470.869519:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00100000:0.0:1784047470.869535:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:0.0:1784047470.869539:0:9510:0:(genops.c:906:class_export_put()) final put ffff99cce419c800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:1.0:1784047470.869672:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce419c800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0001 00000020:00000080:1.0:1784047470.869732:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce419d800 for lustre-OST0001 00000001:00100000:0.0:1784047470.873434:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00100000:0.0:1784047470.873453:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:0.0:1784047470.873458:0:8425:0:(genops.c:906:class_export_put()) final put ffff99cce419e000/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00000080:2.0:1784047470.873529:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce419e000/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-OST0000 00000020:00000080:2.0:1784047470.873590:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce4198800 for lustre-OST0000 00000001:00100000:2.0:1784047470.874066:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00100000:2.0:1784047470.874074:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:2.0:1784047470.874082:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411443 is committed 00000020:00000080:2.0:1784047470.874094:0:75662:0:(genops.c:906:class_export_put()) final put ffff99cce4921800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00080000:2.0:1784047470.874116:0:75662:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99ccc1377780 refcount 2 committed 0 result 0 batchid 73014444090 00000020:00080000:2.0:1784047470.874120:0:75662:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ccc358f700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99ccc3483a80 00000020:00080000:2.0:1784047470.874124:0:75662:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].2 00000020:00080000:2.0:1784047470.874126:0:75662:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ccc358fb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cd00d45400 00000020:00080000:2.0:1784047470.874129:0:75662:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].2 00000020:00080000:0.0:1784047470.874209:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444090 committed batchid 73014444089 00000001:00100000:2.0:1784047470.874210:0:91009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00100000:2.0:1784047470.874218:0:91009:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2569b5-a558-4441-a96a-1d77608df16b 00000001:00080000:2.0:1784047470.874224:0:91009:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00000020:00000080:2.0:1784047470.874229:0:91009:0:(genops.c:906:class_export_put()) final put ffff99cbd0b6f800/2a2569b5-a558-4441-a96a-1d77608df16b 00000020:00080000:0.0:1784047470.874297:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000020:00000080:1.0:1784047470.874418:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce4921800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-MDT0001 00000020:00000080:1.0:1784047470.874472:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbd0b6f800/2a2569b5-a558-4441-a96a-1d77608df16b for lustre-MDT0000 00000020:00000080:1.0:1784047470.874509:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cd00cfd000 for lustre-MDT0001 00000020:00000080:1.0:1784047470.874514:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cce4927800 for lustre-MDT0000 00000100:00100000:2.0:1784047471.891256:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709307392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047471.891351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047471.893117:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709307520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784047471.893283:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047471.893457:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307392 00000100:00100000:3.0:1784047471.893469:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307392 00000100:00100000:3.0:1784047471.893550:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1784047471.893564:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709307392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047471.893685:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047471.896046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047471.898311:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307520 00000100:00100000:0.0:1784047471.898332:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307520 00000100:00100000:0.0:1784047471.898458:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:0.0:1784047471.898473:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709307520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047471.898521:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047471.898667:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709307520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047471.898675:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:0.0:1784047471.899079:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709307520:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047471.899309:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047471.899315:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047471.900308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709307392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6740us (8949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047471.900322:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1784047471.900673:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709307392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047472.266499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047472.266558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047472.266597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047472.266750:0:91016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462272 00000100:00100000:3.0:1784047472.266773:0:91016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462272 00000100:00100000:3.0:1784047472.266847:0:91016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:3.0:1784047472.266861:0:91016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689462272:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047472.266996:0:91016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfec4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689462272:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 136us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047472.267005:0:91016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:1.0:1784047472.267975:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462528 00000100:00100000:1.0:1784047472.267989:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462528 00000100:00100000:1.0:1784047472.268071:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1310 00000100:00100000:1.0:1784047472.268082:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689462528:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047472.268261:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689462528:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 180us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047472.268269:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1310 00000100:00100000:1.0:1784047472.268298:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462784 00000100:00100000:1.0:1784047472.268302:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462784 00000100:00100000:1.0:1784047472.268334:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2576 00000100:00100000:1.0:1784047472.268341:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689462784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047472.268371:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689462784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047472.268378:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2576 00000100:00080000:3.0:1784047472.269929:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047472.269946:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047472.270030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047472.270181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047472.270548:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462400 00000100:00100000:3.0:1784047472.270559:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462400 00000100:00100000:3.0:1784047472.270752:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1311 00000100:00100000:3.0:1784047472.270832:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689462400:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047472.270935:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689462400:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 171us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047472.270944:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1311 00000100:00100000:3.0:1784047472.270983:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462656 00000100:00100000:3.0:1784047472.270987:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462656 00000100:00100000:3.0:1784047472.271024:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2577 00000100:00100000:3.0:1784047472.271031:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689462656:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047472.271063:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689462656:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047472.271079:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2577 00000100:00080000:3.0:1784047472.271097:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047472.271101:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784047472.914865:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784047473.122853:0:92030:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784047473.122940:0:92030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.122980:0:92030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.122989:0:92030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.122997:0:92030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.124367:0:92030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784047473.124384:0:92030:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784047473.124434:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047473.124440:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784047473.124449:0:92030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784047473.124486:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99cbc7654800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784047473.124739:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709307648:0@lo:39:umount.0 00010000:00010000:3.0:1784047473.124978:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047473.124991:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047473.125005:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a800 already unused, calling callback (ffffffffc1465c20) 00000100:00100000:1.0:1784047473.125006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1784047473.125014:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047473.125077:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307648 00000100:00100000:2.0:1784047473.125087:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307648 00000100:00100000:2.0:1784047473.125157:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1784047473.125169:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709307648:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784047473.125211:0:66220:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774d72 00000100:00080000:2.0:1784047473.125224:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99cbc7652800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784047473.125344:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870705709307648:12345-0@lo:39:umount.0 Request processed in 177us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047473.125353:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000020:00000080:2.0:1784047473.125365:0:66220:0:(genops.c:906:class_export_put()) final put ffff99cbc7653000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1784047473.125425:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047473.125450:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047473.125460:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047473.125467:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047473.125470:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784047473.125473:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:00000080:3.0:1784047473.125533:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7653000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784047473.125598:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7652800 for lustre-MDT0000 00000100:00080000:1.0:1784047473.125919:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7654800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784047473.125937:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709307648:0@lo:39:umount.0 00000100:00080000:2.0:1784047473.126001:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047473.126005:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784047473.126032:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784047473.127018:0:92030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127034:0:92030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127041:0:92030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127048:0:92030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127073:0:92030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047473.127079:0:92030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127086:0:92030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127093:0:92030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127100:0:92030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127113:0:92030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047473.127121:0:92030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127128:0:92030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127145:0:92030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127151:0:92030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127167:0:92030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784047473.127173:0:92030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127181:0:92030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127187:0:92030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127193:0:92030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.127204:0:92030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1784047473.127207:0:92030:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784047473.127249:0:92030:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784047473.127254:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784047473.127258:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784047473.127265:0:92030:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1784047473.129022:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047473.129041:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129085:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccff419000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047473.129091:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129104:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047473.129112:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047473.129119:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047473.129122:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1784047473.129125:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1784047473.129181:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129189:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047473.129225:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129232:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff419000/0x4426598c0c774b7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774b81 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129250:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047473.129254:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129261:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec3a0200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047473.129263:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129276:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047473.129282:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047473.129288:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047473.129290:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784047473.129292:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784047473.129311:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129317:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047473.129335:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129342:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0200/0x4426598c0c774c7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c84 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129352:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047473.129356:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129362:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047473.129365:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129371:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047473.129387:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047473.129392:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784047473.129394:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784047473.129397:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784047473.129430:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129436:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047473.129442:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129447:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24a200/0x4426598c0c774c45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c4c expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129456:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047473.129460:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129465:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047473.129468:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129474:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047473.129480:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047473.129495:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784047473.129497:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784047473.129499:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784047473.129517:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129523:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047473.129529:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129535:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c774b6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774b73 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.129544:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047473.129546:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047473.129548:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047473.129557:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.129943:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.129975:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.129997:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047473.130005:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047473.130012:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047473.130018:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c774c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c774c5a expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047473.130028:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.130029:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.130031:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047473.130078:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709308160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047473.130172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047473.130272:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709307776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047473.130310:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709308032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047473.130556:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709307904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047473.130583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:2.0:1784047473.131376:0:92030:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1784047473.132346:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1784047473.132360:0:92030:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbcae22800 0c846d7a-6357-4e9c-a620-e35737ede709 192.168.204.40@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047473.132367:0:92030:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbc7653800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047473.132389:0:92030:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbd0b6d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047473.132394:0:92030:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd897a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047473.132399:0:92030:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cbd0b6d800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116995 stale:0 00000020:00080000:2.0:1784047473.132405:0:92030:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99cd00100000) has exports, disconnecting them 00000020:00080000:2.0:1784047473.132411:0:92030:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.40@tcp (ffff99cbcae22800), last request at 1784047472 00000020:00000080:2.0:1784047473.132422:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7750ba 00000020:00010000:2.0:1784047473.132434:0:92030:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cbcae22800: total 0 00000100:00080000:2.0:1784047473.132439:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99cbcae21000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047473.132469:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99cbcae22800): rc 0 00000020:00080000:2.0:1784047473.132472:0:92030:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbc7653800), last request at 1784047443 00000020:00000080:2.0:1784047473.132476:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774d6b 00000100:00080000:2.0:1784047473.132479:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99cbc7656000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784047473.132491:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc7653800): rc 0 00000020:00000080:2.0:1784047473.132494:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbc7653800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784047473.132507:0:92030:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbd0b6d000), last request at 1784047468 00000020:00000080:2.0:1784047473.132510:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774d64 00000100:00080000:2.0:1784047473.132514:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99cbd0b6e800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047473.132534:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7653800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047473.132586:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7656000 for lustre-MDT0000 00000020:00080000:2.0:1784047473.132602:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbd0b6d000): rc 0 00000020:00000080:2.0:1784047473.132626:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbd0b6d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784047473.132634:0:92030:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd897a000), last request at 1784047468 00000020:00000080:2.0:1784047473.132638:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774d5d 00000100:00080000:2.0:1784047473.132648:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99ccd897c800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047473.132663:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbd0b6d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047473.132696:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbd0b6e800 for lustre-MDT0000 00000020:00080000:2.0:1784047473.132733:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd897a000): rc 0 00000020:00000080:2.0:1784047473.132735:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccd897a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784047473.132742:0:92030:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cbd0b6d800), last request at 1784047437 00000020:00000080:2.0:1784047473.132746:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bc7 00000100:00080000:2.0:1784047473.132756:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99ccff3d4800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047473.132770:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd897a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047473.132794:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897c800 for lustre-MDT0000 00000020:00080000:2.0:1784047473.132804:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbd0b6d800): rc 0 00000020:00000080:2.0:1784047473.132806:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbd0b6d800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1784047473.132818:0:92030:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc9141527ae0 00000020:00000080:2.0:1784047473.132830:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbd0b6d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047473.132859:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccff3d4800 for lustre-MDT0000 00000100:00080000:2.0:1784047473.132882:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047473.132897:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:1.0:1784047473.134365:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cbcae22800: total 0 00010000:00010000:1.0:1784047473.134466:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cbcae22800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784047473.134517:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c7750dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 3 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.134557:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7750f9 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3a2 expref: 2 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047473.134598:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cbcae22800, canceled 2 locks, left on hash table 0. 00000100:00080000:2.0:1784047473.135288:0:92030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784047473.135328:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d79000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784047473.135758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047473.135814:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308160 00000100:00100000:0.0:1784047473.135826:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308160 00010000:00010000:0.0:1784047473.135960:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.135969:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.135976:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047473.143263:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047473.143275:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968754 gen 3 00000004:00080000:2.0:1784047473.143296:0:92030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784047473.143362:0:92030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784047473.143404:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99cbc6ea5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784047473.143418:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047473.143420:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 3 00000004:00080000:2.0:1784047473.143432:0:92030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784047473.143493:0:92030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784047473.143507:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784047473.143558:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cd00100000) has no exports 00000100:00100000:3.0:1784047473.144173:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307904 00000100:00100000:3.0:1784047473.144183:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307904 00000100:00100000:3.0:1784047473.144274:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308032 00000100:00100000:3.0:1784047473.144278:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308032 00000100:00100000:3.0:1784047473.144330:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1784047473.144341:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709308160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047473.144361:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047473.144386:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff29400/0x4426598c0c774b73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774b6c expref: 26 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047473.144404:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047473.144496:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+25:3645:x1870705709308160:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (14325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.144505:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1784047473.144527:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1784047473.144533:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709307904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047473.144544:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047473.144552:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1c00/0x4426598c0c774c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774c7d expref: 24 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047473.144561:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047473.144591:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709307904:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (14006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.144596:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1784047473.144643:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1784047473.144649:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+22:3648:x1870705709308032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047473.144657:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047473.144667:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418c00/0x4426598c0c774c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774c45 expref: 22 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047473.144676:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047473.144712:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+21:3648:x1870705709308032:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (8956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.144719:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1784047473.144770:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709308032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047473.144813:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709308160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047473.144840:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709307904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047473.146709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.146823:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709308288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047473.146906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.146968:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709308416:0@lo:39:umount.0 00000100:00100000:2.0:1784047473.147005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.147029:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709308544:0@lo:9:umount.0 00000100:00100000:2.0:1784047473.147057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.147076:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709308672:0@lo:9:umount.0 00000100:00100000:2.0:1784047473.147180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.147220:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308416 00000100:00100000:2.0:1784047473.147228:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308416 00000100:00100000:2.0:1784047473.147283:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:2.0:1784047473.147292:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709308416:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784047473.147332:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c06 00000100:00080000:2.0:1784047473.147343:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccec98e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784047473.147370:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411443 00000100:00100000:2.0:1784047473.147546:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3644:x1870705709308416:12345-0@lo:39:umount.0 Request processed in 254us (539us total) trans 77309411444 rc 0/0 00000100:00100000:2.0:1784047473.147556:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00010000:00010000:2.0:1784047473.147586:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047473.147648:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d79000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784047473.147658:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709308416:0@lo:39:umount.0 00000100:00100000:3.0:1784047473.147738:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709307776 00000100:00100000:3.0:1784047473.147744:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709307776 00000100:00100000:3.0:1784047473.147793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308288 00000100:00100000:3.0:1784047473.147797:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308288 00000100:00100000:3.0:1784047473.147823:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1784047473.147831:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+22:3646:x1870705709307776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047473.147845:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047473.147870:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419200/0x4426598c0c774b81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774b7a expref: 22 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047473.147897:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047473.147938:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+21:3646:x1870705709307776:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.147945:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1784047473.147960:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1784047473.147966:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+20:3646:x1870705709308288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047473.147974:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047473.147984:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff28400/0x4426598c0c774c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774c53 expref: 20 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047473.147994:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047473.148030:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+19:3646:x1870705709308288:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.148037:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1784047473.148059:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308544 00000100:00100000:3.0:1784047473.148063:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308544 00000100:00100000:3.0:1784047473.148509:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308672 00000100:00100000:3.0:1784047473.148515:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308672 00000100:00100000:3.0:1784047473.148547:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4984 00000100:00100000:3.0:1784047473.148553:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709308544:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784047473.148576:0:13594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c22 00000100:00080000:3.0:1784047473.148583:0:13594:0:(import.c:65:import_set_state_nolock()) ffff99ccc6daa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047473.148675:0:13594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968754 00000100:00100000:3.0:1784047473.148835:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709308544:12345-0@lo:9:umount.0 Request processed in 281us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.148843:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4984 00000100:00100000:3.0:1784047473.148858:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4985 00000100:00100000:3.0:1784047473.148866:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709308672:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784047473.148879:0:13594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c30 00000100:00080000:3.0:1784047473.148895:0:13594:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e53800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047473.148923:0:13594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968753 00000100:00100000:3.0:1784047473.149003:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709308672:12345-0@lo:9:umount.0 Request processed in 137us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047473.149009:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4985 00000100:00080000:3.0:1784047473.149029:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047473.149034:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047473.149071:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709307776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047473.149084:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709308288:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1784047473.149281:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6ea5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784047473.149335:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:0.0:1784047473.151064:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.151076:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047473.151083:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784047473.152350:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cd00100000) has no exports 00000004:00080000:3.0:1784047473.154802:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047473.154829:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709308544:0@lo:9:umount.0 00000100:00080000:3.0:1784047473.154919:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccc6da9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784047473.154935:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784047473.154936:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784047473.154940:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709308672:0@lo:9:umount.0 00000020:00000080:1.0:1784047473.164699:0:6506:0:(genops.c:906:class_export_put()) final put ffff99cbcae22800/0c846d7a-6357-4e9c-a620-e35737ede709 00010000:00010000:1.0:1784047473.164731:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047473.164734:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047473.164737:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784047473.164742:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcae22800/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-MDT0000 00000020:00000080:3.0:1784047473.168057:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcae21000 for lustre-MDT0000 00000020:00000080:2.0:1784047473.201948:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bdc 00000020:00000080:2.0:1784047473.201975:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccfddd1000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784047473.202095:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784047473.203364:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047473.203388:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047473.203418:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99cbc76c8000) has no exports 00000020:00000080:2.0:1784047473.204147:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bd5 00000020:00000080:2.0:1784047473.204159:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cd0032c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047473.204233:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784047473.204519:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd0032c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784047473.205327:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047473.205346:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784047473.205351:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccf2d79800/lustre-QMT0000_UUID 00000020:00000080:3.0:1784047473.205355:0:92030:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d79800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784047473.205361:0:92030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1784047473.205582:0:92030:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccc559aa20 - data ffff99ccf3363870/ffff99ccec74a000 00000020:01000000:2.0:1784047473.205806:0:92030:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc74e5ae0 - data ffff99ccf7ac0360/ffff99cce3e80c00 00000100:00080000:2.0:1784047473.263872:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047473.263896:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784047473.263917:0:92030:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99ccff10dc00 x1870705709308416/t77309411444(77309411444) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047483 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047473.263955:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784047473.273531:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047473.273543:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968754 gen 4 00000004:00080000:2.0:1784047473.273579:0:92030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047473.273582:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047473.275469:0:91027:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047473.275482:0:91027:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:1.0:1784047473.275506:0:91027:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:2.0:1784047473.276664:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047473.276673:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 4 00000004:00080000:2.0:1784047473.276696:0:92030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047473.276699:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047473.277097:0:91029:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047473.277103:0:91029:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:1.0:1784047473.277121:0:91029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1784047473.288297:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774b96 00000020:00000080:0.0:1784047473.288315:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbcaee0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047473.288697:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784047473.290153:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bab 00000020:00000080:0.0:1784047473.290168:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccc3566800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047473.290189:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784047473.290197:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047473.290211:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784047473.290217:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99cbc9898000) has no exports 00000004:01000000:0.0:1784047473.290439:0:92030:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784047473.290451:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c29 00000020:00000080:0.0:1784047473.290456:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccebebf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047473.290461:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784047473.290465:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047473.290474:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784047473.290477:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99cceff399c0) has no exports 00000020:00000080:0.0:1784047473.290486:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c1b 00000020:00000080:0.0:1784047473.290490:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccc6dad000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784047473.291140:0:92030:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784047473.291147:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784047473.291152:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968753 gen 5 00000004:00080000:0.0:1784047473.291160:0:92030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047473.291163:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047473.291210:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047473.291221:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047473.291231:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c0d 00000020:00000080:0.0:1784047473.291259:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccc6dab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047473.291264:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784047473.291268:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047473.291273:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784047473.291276:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99cd00104d40) has no exports 00000020:00000080:0.0:1784047473.291280:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bff 00000020:00000080:0.0:1784047473.291284:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbc753c800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784047473.291662:0:92030:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784047473.291666:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784047473.291668:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968754 gen 5 00000004:00080000:0.0:1784047473.291672:0:92030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784047473.291674:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047473.291705:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047473.291711:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784047473.291735:0:92030:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784047473.291742:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bf1 00000020:00000080:0.0:1784047473.291746:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccc3564800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784047473.291751:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784047473.291754:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047473.291759:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784047473.291762:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99cbc76ccd40) has no exports 00000020:00000080:0.0:1784047473.291766:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bea 00000020:00000080:0.0:1784047473.291769:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccf2d7f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047473.293157:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3566800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1784047473.293175:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebebf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784047473.293180:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047473.293188:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6da9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784047473.293196:0:81515:0:(genops.c:906:class_export_put()) final put ffff99ccc6dac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047473.293198:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1784047473.293202:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047473.293320:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784047473.293325:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc753c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047473.293336:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc6ea5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784047473.293350:0:81515:0:(genops.c:906:class_export_put()) final put ffff99ccc355a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047473.293352:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc355a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1784047473.293357:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047473.293391:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3564800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784047473.293396:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d7f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784047473.296427:0:92030:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784047473.296441:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784047473.296448:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784047473.296461:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784047473.296628:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047473.296651:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047473.296706:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047473.296711:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047473.296720:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbcaee1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047473.296726:0:92030:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784047473.296739:0:92030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047473.296921:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bb2 00000020:00000080:1.0:1784047473.296934:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccc3567800/lustre-MDD0000_UUID 00000020:01000000:1.0:1784047473.296941:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784047473.296945:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047473.296952:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784047473.296957:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cd00103380) has no exports 00000020:00000080:1.0:1784047473.296985:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047473.297011:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784047473.297016:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774bb9 00000020:00000080:1.0:1784047473.297023:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccc3565800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784047473.297032:0:92030:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccec31a000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784047473.297037:0:92030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccec31a000 3 00000020:01000004:1.0:1784047473.297040:0:92030:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccec31a000 from lustre-MDT0000 00000020:00000080:1.0:1784047473.297067:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047473.297071:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784047473.297074:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbcaee0000/lustre-MDT0000_UUID 00000020:00000080:1.0:1784047473.297077:0:92030:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784047473.297086:0:92030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784047473.297124:0:92030:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784047473.297129:0:92030:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784047473.297133:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784047473.297136:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047473.297139:0:92030:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784047473.297151:0:92030:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccc6daf000 4f88e784-1ed8-4645-9d2f-1081095d1f30 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047473.297158:0:92030:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccf7576000 6e36843b-2016-43fe-8842-da5818d68597 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047473.297164:0:92030:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff99cbc989cd40) has exports, disconnecting them 00000020:00080000:1.0:1784047473.297169:0:92030:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.40@tcp (ffff99ccc6daf000), last request at 1784047466 00000020:00000080:1.0:1784047473.297188:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775097 00000020:00010000:1.0:1784047473.297193:0:92030:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccc6daf000: total 2 00000100:00080000:1.0:1784047473.297198:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99ccc6dab000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047473.297210:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccc6daf000): rc 0 00000020:00080000:1.0:1784047473.297214:0:92030:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ccf7576000), last request at 1784047437 00000020:00000080:1.0:1784047473.297221:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774b57 00000020:00010000:1.0:1784047473.297224:0:92030:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccf7576000: total 2 00000100:00080000:1.0:1784047473.297231:0:92030:0:(import.c:65:import_set_state_nolock()) ffff99ccc5024800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047473.297283:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccf7576000): rc 0 00000020:00080000:1.0:1784047473.297287:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99cbc989cd40) has no exports 00000020:00010000:2.0:1784047473.297404:0:15071:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccc6daf000: total 2 00010000:00010000:2.0:1784047473.297458:0:15071:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccc6daf000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1784047473.297492:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cf600/0x4426598c0c77509e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae32b expref: 5 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297512:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46200/0x4426598c0c7750b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae36a expref: 4 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297525:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cfc00/0x4426598c0c7750ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae363 expref: 3 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297536:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce000/0x4426598c0c7750a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae332 expref: 2 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297543:0:15071:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccc6daf000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1784047473.297783:0:15071:0:(genops.c:906:class_export_put()) final put ffff99ccc6daf000/4f88e784-1ed8-4645-9d2f-1081095d1f30 00000020:00010000:2.0:1784047473.297789:0:15071:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccf7576000: total 3 00010000:00010000:2.0:1784047473.297792:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047473.297808:0:15071:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccf7576000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784047473.297824:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1800/0x4426598c0c774ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774c99 expref: 14 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297839:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24b600/0x4426598c0c774d1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774d17 expref: 13 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297862:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff419400/0x4426598c0c774cae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774ca7 expref: 12 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297874:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0a00/0x4426598c0c774d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774d09 expref: 11 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297895:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24ac00/0x4426598c0c774d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774d33 expref: 10 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297905:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff28600/0x4426598c0c774cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774cc3 expref: 9 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297916:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0c00/0x4426598c0c774d2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774d25 expref: 8 pid: 91013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.297930:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff29e00/0x4426598c0c774cbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774cb5 expref: 7 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.298260:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a1a00/0x4426598c0c774cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774cd1 expref: 6 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.298275:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24b400/0x4426598c0c774ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774cdf expref: 5 pid: 91020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.298285:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418200/0x4426598c0c774cf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774ced expref: 4 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.298297:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccff418400/0x4426598c0c774d02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774cfb expref: 3 pid: 91016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.298318:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec3a0800/0x4426598c0c774c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c774c8b expref: 2 pid: 91015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047473.298328:0:15071:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccf7576000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784047473.298348:0:15071:0:(genops.c:906:class_export_put()) final put ffff99ccf7576000/6e36843b-2016-43fe-8842-da5818d68597 00010000:00010000:2.0:1784047473.298352:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047473.298354:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047473.298356:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784047473.298372:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d79000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784047473.298381:0:81515:0:(genops.c:906:class_export_put()) final put ffff99ccc355a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047473.298384:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc355a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1784047473.298391:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047473.298437:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3567800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1784047473.298440:0:81515:0:(genops.c:906:class_export_put()) final put ffff99cbcaee5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1784047473.298442:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784047473.298446:0:81515:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1784047473.298469:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc3565800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047473.298474:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6daf000/4f88e784-1ed8-4645-9d2f-1081095d1f30 for MGS 00000020:00000080:2.0:1784047473.299471:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7576000/6e36843b-2016-43fe-8842-da5818d68597 for MGS 00000020:00000080:2.0:1784047473.299514:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6dab000 for MGS 00000020:00000080:2.0:1784047473.299517:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5024800 for MGS 00000100:00100000:2.0:1784047473.300012:0:91016:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ccecaa6c00:91016] 2 exiting: rc = 0 00000100:00100000:1.0:1784047473.300876:0:91020:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99cd00baf800:91020] 3 exiting: rc = 0 00010000:00010000:1.0:1784047473.301058:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047473.301712:0:91013:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ccff2fb400:91013] 0 exiting: rc = 1 00000100:00100000:1.0:1784047473.302709:0:91015:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ccff2fb000:91015] 1 exiting: rc = 0 00000100:00100000:2.0:1784047473.303084:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303096:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303105:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303112:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303118:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303142:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303151:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303158:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303166:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303173:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303179:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303187:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303193:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303198:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303204:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303212:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303218:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303224:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303231:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303239:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303246:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303254:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303261:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303270:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303278:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303286:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303293:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303300:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303307:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303314:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303321:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303328:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303337:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303348:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303358:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303363:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303371:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303377:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303383:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303388:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303404:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303410:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303416:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303422:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303428:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303434:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303442:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303448:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303453:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303459:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303465:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303471:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303477:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303482:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303488:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303494:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303498:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303504:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303508:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303514:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303519:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303525:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303530:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047473.303534:0:92030:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784047473.305734:0:92030:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc781a120 - data ffff99ccf7859510/ffff99ccff0d5800 00000020:01000000:2.0:1784047473.305904:0:92030:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc5a32900 - data ffff99ccf79cd6c0/ffff99cbd0549400 00000020:00000080:2.0:1784047473.306469:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774b50 00000020:00000080:2.0:1784047473.306480:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbc912d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784047473.306502:0:92030:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccec31a000 from MGS, refs=2 00000020:01000004:2.0:1784047473.306507:0:92030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccec31a000 2 00000020:01000004:2.0:1784047473.306511:0:92030:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccec31a000 from MGS 00000020:00000080:2.0:1784047473.306536:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047473.306545:0:92030:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784047473.306548:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbc9128000/MGS 00000020:00000080:2.0:1784047473.306563:0:92030:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc9128000/MGS for MGS 00000020:01000000:2.0:1784047473.306571:0:92030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784047473.306694:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784047473.306699:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047473.306711:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784047473.306720:0:92030:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ccebeb8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047473.306726:0:92030:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99cceff3b380) has exports, disconnecting them 00000020:00080000:2.0:1784047473.306732:0:92030:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ccebeb8000), last request at 1784047437 00000020:00000080:2.0:1784047473.306737:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774c68 00000020:00080000:2.0:1784047473.306748:0:92030:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccebeb8000): rc 0 00000020:00000080:2.0:1784047473.306753:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccebeb8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784047473.307469:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc912d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047473.307481:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccebeb8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1784047473.312766:0:92030:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784047473.312789:0:92030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784047473.312795:0:92030:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784047473.312806:0:92030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784047473.312858:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7654800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784047473.313061:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047473.313079:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784047473.313086:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbc64cd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784047473.313092:0:92030:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc64cd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784047473.313099:0:92030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1784047473.313218:0:92030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccec31a000 1 00000020:00000080:1.0:1784047473.313227:0:92030:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c774b42 00000020:00000080:1.0:1784047473.313236:0:92030:0:(genops.c:906:class_export_put()) final put ffff99cbc9129800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1784047473.313245:0:92030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1784047473.313253:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc9129800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047473.313263:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047473.313269:0:92030:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784047473.313275:0:92030:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99ccc4ac3380) has no exports 00000020:00000080:1.0:1784047473.457488:0:92030:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047473.457510:0:92030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784047473.457517:0:92030:0:(genops.c:906:class_export_put()) final put ffff99ccf7570000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047473.457524:0:92030:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf7570000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784047473.457540:0:92030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784047473.458176:0:92030:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ccf7571000 00000020:02000400:1.0:1784047473.458283:0:92030:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1784047473.938988:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709309056:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939159:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709309568:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939228:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784047473.939234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709309184:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939274:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709309696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939333:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709308928:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939377:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709309440:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939424:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784047473.939429:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709308800:0@lo:400:kworker.0 00000400:00000100:1.0:1784047473.939452:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709308800 offset 0 length 224: 4 00000100:00100000:1.0:1784047473.939479:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709309312:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939518:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709309824:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047473.939578:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309056 00000100:00100000:1.0:1784047473.939588:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309056 00000100:00100000:1.0:1784047473.939692:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309184 00000100:00100000:1.0:1784047473.939696:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309184 00000100:00100000:1.0:1784047473.939706:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709308928 00000100:00100000:1.0:1784047473.939728:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709308928 00000100:00100000:1.0:1784047473.939742:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309312 00000100:00100000:1.0:1784047473.939744:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309312 00000100:00100000:1.0:1784047473.939761:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309824 00000100:00100000:1.0:1784047473.939764:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309824 00000100:00100000:1.0:1784047473.939777:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1784047473.939787:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709309056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939855:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709309056:12345-0@lo:400:kworker.0 Request processed in 68us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047473.939863:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1784047473.939899:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1784047473.939905:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709309312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.939940:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709309312:12345-0@lo:400:kworker.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047473.939947:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1784047473.939959:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1784047473.939963:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870705709309184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047473.939969:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047473.939996:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870705709309184:12345-0@lo:400:kworker.0 Request processed in 31us (737us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047473.940002:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1784047473.940014:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1784047473.940019:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709308928:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047473.940024:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047473.940046:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709308928:12345-0@lo:400:kworker.0 Request processed in 26us (687us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047473.940051:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1784047473.940072:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1784047473.940076:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709309824:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047473.940082:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047473.940108:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870705709309824:12345-0@lo:400:kworker.0 Request processed in 30us (566us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047473.940114:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1784047473.940137:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309568 00000100:00100000:1.0:1784047473.940141:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309568 00000100:00100000:1.0:1784047473.940179:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309696 00000100:00100000:1.0:1784047473.940182:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309696 00000100:00100000:1.0:1784047473.940205:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1784047473.940212:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709309568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.940246:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709309568:12345-0@lo:400:kworker.0 Request processed in 35us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047473.940253:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1784047473.940266:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1784047473.940272:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709309696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.940302:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709309696:12345-0@lo:400:kworker.0 Request processed in 31us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047473.940309:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1784047473.940341:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309440 00000100:00100000:1.0:1784047473.940345:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309440 00000100:00100000:1.0:1784047473.940372:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1784047473.940376:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1870705709309440:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047473.940382:0:8442:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047473.940407:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1870705709309440:12345-0@lo:400:kworker.0 Request processed in 30us (1004us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047473.940413:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00080000:1.0:1784047473.940449:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047473.940454:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047473.940457:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047473.940518:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709309312:0@lo:400:kworker.0 00000100:00080000:1.0:1784047473.940536:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047473.940543:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047473.940549:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047473.940556:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047473.940562:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3541 00000100:00080000:1.0:1784047473.940569:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047473.940633:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b97100 x1870705709309952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047473.940659:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709309824:0@lo:400:kworker.0 00000100:00080000:1.0:1784047473.940672:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047473.940676:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047473.940679:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047473.940682:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047473.940685:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3541 00000100:00080000:1.0:1784047473.940689:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047473.940705:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b94380 x1870705709310080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047473.940715:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709308928:0@lo:400:kworker.0 00000100:00080000:1.0:1784047473.940729:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047473.940739:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047473.940742:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047473.940748:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047473.940751:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3541 00000100:00080000:1.0:1784047473.940755:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047473.940769:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b96d80 x1870705709310208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047473.940780:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709309440:0@lo:400:kworker.0 00000100:00080000:1.0:1784047473.940831:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047473.940835:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047473.940838:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047473.940841:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047473.940846:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3541 00000100:00080000:1.0:1784047473.940850:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047473.940864:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b95180 x1870705709310336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047473.940888:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709309184:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.940905:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709309696:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.940916:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709309056:0@lo:400:kworker.0 00000100:00100000:1.0:1784047473.940927:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709309568:0@lo:400:kworker.0 00000100:00100000:2.0:1784047473.941025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709309952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047473.941073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.941101:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709310080:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047473.941124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.941139:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709310208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047473.941163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.941179:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709310336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784047473.941200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047473.941232:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709310208 00000100:00100000:2.0:1784047473.941238:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709310208 00000100:00100000:2.0:1784047473.941270:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1784047473.941276:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709310208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1784047473.941298:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047473.941342:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709310208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 64us (177us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047473.941361:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1784047473.941388:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709309952 00000100:00100000:2.0:1784047473.941392:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709309952 00000100:00100000:2.0:1784047473.941409:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709310080 00000100:00100000:2.0:1784047473.941412:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709310080 00000100:00100000:2.0:1784047473.941423:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709310336 00000100:00100000:2.0:1784047473.941425:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709310336 00000100:00100000:2.0:1784047473.941435:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1784047473.941440:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709309952:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1784047473.941450:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047473.941479:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709309952:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 37us (405us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047473.941485:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1784047473.941496:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1784047473.941500:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709310080:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1784047473.941509:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047473.941533:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709310080:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31us (409us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047473.941539:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1784047473.941549:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1784047473.941553:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709310336:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784047473.941561:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047473.941582:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709310336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (381us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047473.941588:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:2.0:1784047473.941651:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047473.941657:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047473.941660:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709309952:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1784047473.941669:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047473.941672:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047473.941675:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709310080:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1784047473.941682:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047473.941686:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047473.941689:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709310208:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1784047473.941696:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047473.941699:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047473.941701:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709310336:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1784047473.942573:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047474.968320:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047475.987729:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784047476.505684:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784047476.505708:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411444 is committed 00000020:00000080:2.0:1784047476.505716:0:75662:0:(genops.c:906:class_export_put()) final put ffff99ccec98c800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1784047476.505746:0:75662:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444090 batchid updated 00000020:00000080:0.0:1784047476.505936:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccec98c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784047476.506035:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec98e000 for lustre-MDT0001 00000020:00080000:1.0:1784047476.506144:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:1.0:1784047476.506248:0:75682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99cd00445000 with version 10 00000020:00080000:1.0:1784047476.506272:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444090 cancel update log [0x2000090a1:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1784047476.506387:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444090 cancel update log [0x2400088d0:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1784047476.506396:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:3.0:1784047476.506465:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 10 rpc_version 10 00000020:00100000:3.0:1784047476.506524:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784047476.506538:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99ccff10dc00 x1870705709310592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047476.506576:0:75668:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99ccff10dc00 x1870705709310592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047476.506587:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00100000:2.0:1784047477.011067:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047477.011108:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709310720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047477.011184:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047477.011213:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709310848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047477.011218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047477.011264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047477.011294:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709310720 00000100:00100000:2.0:1784047477.011303:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709310720 00000100:00100000:3.0:1784047477.011309:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709310848 00000100:00100000:3.0:1784047477.011312:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709310848 00000100:00100000:2.0:1784047477.011375:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:2.0:1784047477.011387:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709310720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047477.011436:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047477.011491:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709310720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047477.011499:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:2.0:1784047477.011553:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709310720:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784047477.011779:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047477.012081:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1784047477.012092:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709310848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047477.012116:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047477.012173:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709310848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047477.012180:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1784047477.012471:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709310848:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047477.012932:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047477.012939:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047477.384409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047477.384471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:1.0:1784047477.384790:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689462912 offset 0 length 224: 4 00000100:00100000:1.0:1784047477.384825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047477.384862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047477.384917:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463040 00000100:00100000:0.0:1784047477.384931:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463040 00000100:00100000:0.0:1784047477.385003:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463168 00000100:00100000:0.0:1784047477.385017:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463168 00000100:00100000:0.0:1784047477.385073:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1314 00000100:00100000:0.0:1784047477.385088:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:2401:x1870705689463168:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047477.385221:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:2401:x1870705689463168:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 136us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047477.385230:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1314 00000100:00100000:0.0:1784047477.385251:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1331 00000100:00100000:0.0:1784047477.385256:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1870705689463040:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:0.0:1784047477.385263:0:66219:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:0.0:1784047477.385288:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1870705689463040:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (897us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047477.385294:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1331 00000100:00080000:0.0:1784047477.385451:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047477.386418:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463296 00000100:00100000:3.0:1784047477.386432:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463296 00000100:00100000:3.0:1784047477.386544:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463424 00000100:00100000:3.0:1784047477.386548:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463424 00000100:00100000:2.0:1784047477.386633:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2580 00000100:00100000:2.0:1784047477.386647:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689463296:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047477.386723:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689463296:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 80us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047477.386732:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2580 00000100:00080000:1.0:1784047477.387689:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047477.387697:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047477.388501:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2581 00000100:00100000:3.0:1784047477.388516:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689463424:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047477.389300:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689463424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 783us (4431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047477.389314:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2581 00000100:00100000:1.0:1784047477.419720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047477.420229:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463552 00000100:00100000:2.0:1784047477.420244:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463552 00000100:00100000:2.0:1784047477.420314:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1332 00000100:00100000:2.0:1784047477.420326:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689463552:12345-192.168.204.40@tcp:38:ptlrpcd_01_00.0 00010000:00020000:2.0:1784047477.420356:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047477.423642:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689463552:12345-192.168.204.40@tcp:38:ptlrpcd_01_00.0 Request processed in 3295us (3916us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047477.423664:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1332 00000100:00100000:3.0:1784047477.522760:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:1.0:1784047478.039293:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047478.547843:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000001:00100000:3.0:1784047478.550691:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047478.550703:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccc5e52000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784047478.550820:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047478.550826:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccc6dae800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047478.551052:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e52000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784047478.551480:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc6dae800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784047478.551517:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5e53800 for lustre-OST0001 00000020:00000080:2.0:1784047478.551522:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc6daa800 for lustre-OST0000 00000100:00080000:0.0:1784047479.059197:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047479.059204:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047479.059214:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047479.059225:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3572 00000100:00080000:0.0:1784047479.059231:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1784047479.059238:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1784047479.059238:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047479.059265:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709310976:0@lo:400:kworker.0 00000100:00100000:0.0:1784047479.059266:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9f9f80 x1870705709311104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047479.059316:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047479.059321:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047479.059322:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047479.059327:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3572 00000400:00000100:1.0:1784047479.059332:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709310976 offset 0 length 224: 4 00000100:00080000:0.0:1784047479.059332:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047479.059340:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047479.059377:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9f9180 x1870705709311360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047479.059399:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1784047479.059401:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047479.059406:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047479.059409:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784047479.059412:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709311488:0@lo:400:kworker.0 00000100:00080000:0.0:1784047479.059415:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3572 00000100:00080000:0.0:1784047479.059420:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047479.059425:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047479.059441:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9f8700 x1870705709311616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047479.059461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047479.059481:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047479.059486:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1784047479.059489:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709311232:0@lo:400:kworker.0 00000100:00080000:0.0:1784047479.059489:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047479.059497:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3572 00000100:00080000:0.0:1784047479.059501:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047479.059505:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047479.059518:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9fb800 x1870705709312000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047479.059532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047479.059573:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311488 00000100:00100000:1.0:1784047479.059581:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311488 00000100:00100000:1.0:1784047479.059675:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311232 00000100:00100000:1.0:1784047479.059679:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311232 00000100:00100000:1.0:1784047479.059705:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1784047479.059715:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709311488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047479.059769:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709311488:12345-0@lo:400:kworker.0 Request processed in 54us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047479.059788:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1784047479.059806:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1784047479.059813:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709311232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047479.059839:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709311232:12345-0@lo:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047479.059844:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1784047479.059855:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709311744:0@lo:400:kworker.0 00000100:00080000:1.0:1784047479.059868:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047479.059904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047479.059916:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709311488:0@lo:400:kworker.0 00000100:00100000:1.0:1784047479.059934:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709311232:0@lo:400:kworker.0 00000100:00100000:0.0:1784047479.059935:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047479.059946:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709311872:0@lo:400:kworker.0 00000100:00100000:0.0:1784047479.059979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047479.059991:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311744 00000100:00100000:1.0:1784047479.059997:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311744 00000100:00100000:0.0:1784047479.060022:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311872 00000100:00100000:0.0:1784047479.060028:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311872 00000100:00100000:1.0:1784047479.060048:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1784047479.060058:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709311744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047479.060076:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1784047479.060086:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709311872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047479.060105:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709311744:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047479.060113:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1784047479.060136:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709311872:12345-0@lo:400:kworker.0 Request processed in 51us (155us total) trans 0 rc 0/0 00000100:00080000:1.0:1784047479.060141:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047479.060145:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047479.060145:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1784047479.060167:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709311872:0@lo:400:kworker.0 00000100:00100000:1.0:1784047479.060179:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709311744:0@lo:400:kworker.0 00000100:00100000:2.0:1784047479.060498:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709311104:0@lo:38:kworker.0 00000100:00100000:2.0:1784047479.060547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047479.060577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709311360:0@lo:38:kworker.0 00000100:00100000:2.0:1784047479.060602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047479.060654:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709311616:0@lo:38:kworker.0 00000100:00100000:2.0:1784047479.060684:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047479.060706:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709312000:0@lo:38:kworker.0 00000100:00100000:2.0:1784047479.060729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047479.060782:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311104 00000100:00100000:2.0:1784047479.060786:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311104 00000100:00100000:2.0:1784047479.060813:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311360 00000100:00100000:2.0:1784047479.060816:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311360 00000100:00100000:2.0:1784047479.060824:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312000 00000100:00100000:2.0:1784047479.060826:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312000 00000100:00100000:2.0:1784047479.060836:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1784047479.060842:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709311104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047479.060864:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047479.060900:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709311104:12345-0@lo:38:kworker.0 Request processed in 56us (351us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047479.060907:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1784047479.060920:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1784047479.060924:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709311360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047479.060933:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047479.060957:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709311360:12345-0@lo:38:kworker.0 Request processed in 31us (354us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047479.060963:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1784047479.060985:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1784047479.060989:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709312000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047479.060999:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047479.061024:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709312000:12345-0@lo:38:kworker.0 Request processed in 34us (295us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047479.061029:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1784047479.061048:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709311616 00000100:00100000:2.0:1784047479.061052:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709311616 00000100:00100000:2.0:1784047479.061072:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1784047479.061077:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709311616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047479.061086:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047479.061111:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709311616:12345-0@lo:38:kworker.0 Request processed in 32us (426us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047479.061116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00080000:2.0:1784047479.061151:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047479.061156:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047479.061159:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709311104:0@lo:38:kworker.0 00000100:00080000:2.0:1784047479.061167:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047479.061170:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047479.061173:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709311360:0@lo:38:kworker.0 00000100:00080000:2.0:1784047479.061180:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047479.061183:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047479.061186:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709311616:0@lo:38:kworker.0 00000100:00080000:2.0:1784047479.061191:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047479.061194:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047479.061203:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709312000:0@lo:38:kworker.0 00010000:00010000:3.0:1784047479.061592:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047479.571975:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047480.082870:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047480.594751:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:2.0:1784047481.106790:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047481.618691:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00100000:2.0:1784047482.130815:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709312128:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784047482.130836:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047482.130885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047482.131030:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312128 00000100:00100000:0.0:1784047482.131039:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312128 00000100:00100000:0.0:1784047482.131118:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:0.0:1784047482.131128:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709312128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047482.131157:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047482.131206:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709312128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047482.131214:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00080000:1.0:1784047482.131398:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047482.131414:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709312256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047482.131447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047482.131523:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312256 00000100:00100000:0.0:1784047482.131528:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312256 00000100:00100000:2.0:1784047482.131657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709312128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047482.131865:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:0.0:1784047482.131873:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709312256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047482.131893:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047482.131942:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709312256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047482.131949:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:3.0:1784047482.132023:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709312256:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047482.132952:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:2.0:1784047482.500855:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689463680 offset 0 length 224: 4 00000100:00100000:1.0:1784047482.505584:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047482.505733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047482.512963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047482.512997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047482.513047:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689464192 00000100:00100000:1.0:1784047482.513057:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689464192 00000100:00100000:1.0:1784047482.513133:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689464064 00000100:00100000:1.0:1784047482.513136:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689464064 00000100:00100000:1.0:1784047482.513163:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2584 00000100:00100000:1.0:1784047482.513184:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689464192:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047482.513258:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689464192:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047482.513271:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2584 00000100:00100000:1.0:1784047482.513290:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2585 00000100:00100000:1.0:1784047482.513297:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689464064:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047482.513332:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689464064:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047482.513339:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2585 00000100:00080000:1.0:1784047482.513359:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047482.513362:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047482.516630:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463808 00000100:00100000:2.0:1784047482.516647:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463808 00000100:00100000:2.0:1784047482.516701:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689463936 00000100:00100000:2.0:1784047482.516714:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689463936 00000100:00100000:1.0:1784047482.516736:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1336 00000100:00100000:1.0:1784047482.516746:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689463808:12345-192.168.204.40@tcp:38:kworker.0 00000100:00100000:2.0:1784047482.516760:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1317 00000100:00100000:2.0:1784047482.516767:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689463936:12345-192.168.204.40@tcp:400:kworker.0 00010000:00020000:1.0:1784047482.516784:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047482.516851:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689463808:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 105us (11278us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047482.516860:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1336 00000100:00080000:0.0:1784047482.517411:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047482.518251:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689463936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1477us (12511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047482.518262:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1317 00000100:00100000:3.0:1784047482.647113:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:1.0:1784047483.156502:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047483.666825:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047484.180450:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047484.184546:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709312384:0@lo:400:kworker.0 00000400:00000100:1.0:1784047484.184685:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709312384 offset 0 length 224: 4 00000100:00080000:2.0:1784047484.184901:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047484.184909:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047484.184915:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047484.184922:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3577 00000100:00080000:2.0:1784047484.184929:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047484.184951:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047484.184998:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb82680 x1870705709312512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047484.185126:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709312640:0@lo:400:kworker.0 00000100:00100000:3.0:1784047484.185204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047484.185278:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312640 00000100:00100000:3.0:1784047484.185290:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312640 00000100:00100000:3.0:1784047484.185378:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1784047484.185393:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047484.185468:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709312640:12345-0@lo:400:kworker.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047484.185477:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1784047484.185561:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709312640:0@lo:400:kworker.0 00000100:00100000:0.0:1784047484.187304:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709312512:0@lo:38:kworker.0 00000100:00100000:0.0:1784047484.187404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047484.187482:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047484.188167:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312512 00000100:00100000:3.0:1784047484.188181:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312512 00000100:00100000:3.0:1784047484.188244:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1784047484.188255:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709312512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047484.188285:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047484.188367:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709312512:12345-0@lo:38:kworker.0 Request processed in 112us (962us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047484.188375:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00080000:0.0:1784047484.188815:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047484.188843:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047484.188848:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709312512:0@lo:38:kworker.0 00000100:00080000:2.0:1784047484.190232:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047484.190245:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047484.190251:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047484.190259:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3577 00000100:00080000:2.0:1784047484.190266:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047484.190274:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047484.190334:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb81880 x1870705709312768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047484.190413:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709312768:0@lo:38:kworker.0 00000100:00100000:0.0:1784047484.190500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047484.192862:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047484.192871:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047484.192876:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047484.192885:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3577 00000100:00080000:2.0:1784047484.192893:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047484.192907:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047484.192939:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb80000 x1870705709313024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047484.193029:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709312896:0@lo:400:kworker.0 00000100:00100000:3.0:1784047484.193113:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312768 00000100:00100000:1.0:1784047484.193123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047484.193125:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312768 00000100:00100000:1.0:1784047484.193196:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709312896 00000100:00100000:1.0:1784047484.193200:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709312896 00000100:00100000:1.0:1784047484.193293:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1784047484.193304:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709312896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047484.193331:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1784047484.193338:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709312768:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047484.193363:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047484.193371:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709312896:12345-0@lo:400:kworker.0 Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047484.193379:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1784047484.193447:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709312896:0@lo:400:kworker.0 00000100:00080000:1.0:1784047484.193500:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047484.196363:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709313024:0@lo:38:kworker.0 00000100:00100000:0.0:1784047484.196482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047484.197347:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047484.197353:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047484.197359:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047484.197367:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3577 00000100:00080000:2.0:1784047484.197375:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047484.197385:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047484.197414:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfeb82a00 x1870705709313408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047484.197486:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047484.197505:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709313152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047484.197564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047484.198315:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313152 00000100:00100000:2.0:1784047484.198326:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313152 00000100:00100000:2.0:1784047484.198418:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:2.0:1784047484.198432:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709313152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047484.198516:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709313152:12345-0@lo:400:kworker.0 Request processed in 89us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047484.198525:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00080000:2.0:1784047484.198553:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047484.198625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709313152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047484.198664:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709313280:0@lo:400:kworker.0 00000100:00100000:2.0:1784047484.199848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047484.199957:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313280 00000100:00100000:2.0:1784047484.199966:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313280 00000100:00100000:2.0:1784047484.200030:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:2.0:1784047484.200042:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709313280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047484.200113:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709313280:12345-0@lo:400:kworker.0 Request processed in 73us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047484.200121:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:3.0:1784047484.200338:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709312768:12345-0@lo:38:kworker.0 Request processed in 6996us (9835us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047484.200369:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00080000:3.0:1784047484.200431:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047484.200474:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709313280:0@lo:400:kworker.0 00000100:00100000:1.0:1784047484.200710:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313024 00000100:00100000:1.0:1784047484.200727:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313024 00000100:00100000:1.0:1784047484.200772:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1784047484.200781:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709313024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047484.200810:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047484.200859:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709313024:12345-0@lo:38:kworker.0 Request processed in 78us (4377us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047484.200875:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00080000:0.0:1784047484.204343:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047484.204361:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047484.204367:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709312768:0@lo:38:kworker.0 00000100:00100000:0.0:1784047484.204425:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709313408:0@lo:38:kworker.0 00000100:00100000:0.0:1784047484.204525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047484.204707:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047484.204712:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047484.204725:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709313024:0@lo:38:kworker.0 00000100:00100000:3.0:1784047484.207922:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313408 00000100:00100000:3.0:1784047484.207948:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313408 00000100:00100000:3.0:1784047484.208304:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1784047484.208318:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709313408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047484.208351:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047484.208480:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709313408:12345-0@lo:38:kworker.0 Request processed in 162us (3955us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047484.208490:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:0.0:1784047484.208591:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047484.208599:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047484.208604:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709313408:0@lo:38:kworker.0 00000100:00100000:0.0:1784047484.692077:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047485.202914:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047485.715146:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047486.228263:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047486.611808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:1.0:1784047486.611995:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689464320 offset 0 length 224: 4 00000100:00100000:3.0:1784047486.613190:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689464448 00000100:00100000:3.0:1784047486.613208:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689464448 00000100:00100000:3.0:1784047486.613288:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1340 00000100:00100000:3.0:1784047486.613299:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689464448:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047486.613330:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047486.613779:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689464448:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 478us (1983us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047486.613789:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1340 00000100:00100000:1.0:1784047486.618807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047486.618862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047486.618907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047486.618981:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689464704 00000100:00100000:0.0:1784047486.618996:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689464704 00000100:00100000:0.0:1784047486.619082:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689464832 00000100:00100000:0.0:1784047486.619086:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689464832 00000100:00100000:0.0:1784047486.619117:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2588 00000100:00100000:0.0:1784047486.619128:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689464704:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047486.619233:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689464704:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 104us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047486.619244:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2588 00000100:00080000:1.0:1784047486.619248:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047486.619255:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047486.619276:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2589 00000100:00100000:0.0:1784047486.619286:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689464832:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047486.619318:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689464832:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047486.619327:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2589 00000100:00100000:3.0:1784047486.619496:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689464576 00000100:00100000:3.0:1784047486.619501:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689464576 00000100:00100000:3.0:1784047486.619555:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1320 00000100:00100000:3.0:1784047486.619563:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2398:x1870705689464576:12345-192.168.204.40@tcp:38:kworker.0 00010000:02000400:3.0:1784047486.619598:0:67153:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0001: Client 0c846d7a-6357-4e9c-a620-e35737ede709 (at 192.168.204.40@tcp) reconnecting 00000100:00080000:0.0:1784047486.620138:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784047486.639936:0:67153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp ffff99ccff387000 cur 3584 last 1784047486 00000004:00100000:2.0:1784047486.641756:0:67153:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.204.40@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1784047486.641799:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccff381800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1784047486.641815:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccff381800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047486.642163:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2398:x1870705689464576:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 22598us (23372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047486.642194:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1320 00000100:00100000:1.0:1784047486.657140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047486.657276:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689462144 00000100:00100000:3.0:1784047486.657287:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689462144 00000100:00100000:3.0:1784047486.657354:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1784047486.657366:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689462144:12345-192.168.204.40@tcp:700:cp.0 00000100:00080000:3.0:1784047486.657447:0:66229:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99cbc9c3e300 x1870705709313536/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047486.657459:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:3.0:1784047486.743531:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:0.0:1784047487.250725:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047487.250863:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709313664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047487.250945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047487.251025:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313664 00000100:00100000:3.0:1784047487.251033:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313664 00000100:00100000:3.0:1784047487.251090:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:3.0:1784047487.251099:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709313664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047487.251130:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047487.251177:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709313664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047487.251185:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00080000:0.0:1784047487.251194:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047487.251234:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709313664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047487.251394:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709313792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047487.251424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047487.251500:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313792 00000100:00100000:2.0:1784047487.251505:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313792 00000100:00100000:2.0:1784047487.251548:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1784047487.251555:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709313792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047487.251573:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047487.251638:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709313792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047487.251645:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00080000:3.0:1784047487.251842:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047487.251878:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709313792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047487.700000:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:3.0:1784047487.762688:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:2.0:1784047488.275380:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047488.726855:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:3.0:1784047488.786721:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00080000:0.0:1784047489.299069:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047489.299077:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047489.299081:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047489.299089:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3582 00000100:00080000:0.0:1784047489.299096:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784047489.299104:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047489.299129:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9f9f80 x1870705709314048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047489.299175:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047489.299179:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047489.299181:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047489.299184:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3582 00000100:00080000:0.0:1784047489.299187:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784047489.299209:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047489.299223:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9f8a80 x1870705709314304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047489.299238:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047489.299242:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047489.299243:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047489.299247:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3582 00000100:00080000:0.0:1784047489.299250:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784047489.299253:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00000400:1.0:1784047489.299759:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047473/real 1784047473] req@ffff99cce7ed7100 x1870705709308800/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047489.299860:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99cce7ed7100 x1870705709308800/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047489.299870:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784047489.299873:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784047489.299877:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784047489.299879:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784047489.299883:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cce7ed7100 x1870705709308800/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047489.299894:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccef9f8380 x1870705709310976/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047495 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047489.299904:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccc44f1c00 x1870705709312384/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784047489.299913:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784047489.299916:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784047489.299917:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784047489.299919:0:3648:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1784047489.299968:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:0:1870705709313920:0@lo:400:kworker.0 00000100:00100000:1.0:1784047489.299976:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709308800:0@lo:400:kworker.0 00000100:00100000:1.0:1784047489.300045:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709314432:0@lo:400:kworker.0 00000100:00100000:1.0:1784047489.300111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047489.300144:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047489.300150:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709314176:0@lo:400:kworker.0 00000100:00100000:1.0:1784047489.300172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047489.300201:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314432 00000100:00100000:1.0:1784047489.300208:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314432 00000100:00100000:3.0:1784047489.300453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709312384:0@lo:400:kworker.0 00000100:00100000:3.0:1784047489.300462:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709310976:0@lo:400:kworker.0 00000100:00100000:0.0:1784047489.300601:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef9faa00 x1870705709314560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047489.300632:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709314048:0@lo:38:kworker.0 00000100:00080000:0.0:1784047489.300655:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047489.300659:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047489.300661:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047489.300665:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3582 00000100:00100000:2.0:1784047489.300667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047489.300669:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784047489.300674:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047489.300685:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709314304:0@lo:38:kworker.0 00000100:00100000:0.0:1784047489.300688:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbcec17480 x1870705709314944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047489.300703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047489.300704:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047489.300706:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784047489.300708:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047489.300711:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3535 00000100:00080000:0.0:1784047489.300715:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047489.300721:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709314560:0@lo:38:kworker.0 00000100:00100000:0.0:1784047489.300725:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbcec16a00 x1870705709315072/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047489.300757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047489.300775:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709314944:0@lo:38:kworker.0 00000100:00100000:2.0:1784047489.300963:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047489.300972:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047489.300978:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709315072:0@lo:250:kworker.0 00000400:00000100:2.0:1784047489.300995:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709315072 offset 0 length 520: 4 00000100:00100000:2.0:1784047489.301029:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314176 00000100:00100000:2.0:1784047489.301033:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314176 00000100:00100000:2.0:1784047489.301058:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314048 00000100:00100000:2.0:1784047489.301061:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314048 00000100:00100000:2.0:1784047489.301070:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314304 00000100:00100000:2.0:1784047489.301079:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314304 00000100:00100000:2.0:1784047489.301090:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314944 00000100:00100000:2.0:1784047489.301092:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314944 00000100:00100000:2.0:1784047489.301103:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1784047489.301111:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709314432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047489.301173:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709314432:12345-0@lo:400:kworker.0 Request processed in 62us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047489.301181:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1784047489.301200:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1784047489.301206:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709314176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047489.301234:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709314176:12345-0@lo:400:kworker.0 Request processed in 29us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047489.301234:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709314432:0@lo:400:kworker.0 00000100:00100000:2.0:1784047489.301240:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1784047489.301252:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1784047489.301256:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709314048:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784047489.301256:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709314176:0@lo:400:kworker.0 00000100:00080000:0.0:1784047489.301931:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047489.301951:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1784047489.301959:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709314304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047489.301982:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047489.302031:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709314304:12345-0@lo:38:kworker.0 Request processed in 72us (1326us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047489.302035:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709314688:0@lo:400:kworker.0 00000100:00100000:0.0:1784047489.302038:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1784047489.302055:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1784047489.302059:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709314944:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047489.302068:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047489.302072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047489.302148:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709314816:0@lo:400:kworker.0 00010000:00020000:2.0:1784047489.302209:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047489.305514:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709314944:12345-0@lo:38:kworker.0 Request processed in 3439us (4537us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047489.305533:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1784047489.305601:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314688 00000100:00100000:0.0:1784047489.305623:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314688 00000100:00100000:0.0:1784047489.305700:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1784047489.305709:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709314688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047489.305787:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709314688:12345-0@lo:400:kworker.0 Request processed in 79us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047489.305794:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00080000:0.0:1784047489.305812:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047489.312879:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709314688:0@lo:400:kworker.0 00000100:00080000:0.0:1784047489.314404:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047489.314415:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047489.314419:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709314944:0@lo:38:kworker.0 00000100:00080000:0.0:1784047489.314434:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047489.314437:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047489.314440:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709314304:0@lo:38:kworker.0 00000100:00100000:3.0:1784047489.316486:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314560 00000100:00100000:3.0:1784047489.316503:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314560 00000100:00100000:3.0:1784047489.316589:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:3.0:1784047489.316599:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709314560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047489.316653:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047489.316746:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709314560:12345-0@lo:38:kworker.0 Request processed in 147us (15987us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047489.316754:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00080000:0.0:1784047489.317364:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047489.317371:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047489.317375:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709314560:0@lo:38:kworker.0 00000100:00100000:1.0:1784047489.318960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047489.319158:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709314816 00000100:00100000:0.0:1784047489.319168:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709314816 00000100:00100000:0.0:1784047489.319540:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1784047489.319553:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709314816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047489.319676:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709314816:12345-0@lo:400:kworker.0 Request processed in 125us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047489.319685:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00080000:1.0:1784047489.319737:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047489.319793:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709314816:0@lo:400:kworker.0 00000100:00100000:2.0:1784047489.321538:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709314048:12345-0@lo:38:kworker.0 Request processed in 20272us (20862us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047489.321553:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:2.0:1784047489.321642:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047489.321648:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047489.321652:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709314048:0@lo:38:kworker.0 00000100:00100000:3.0:1784047489.751468:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047489.811991:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047490.322794:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047490.770708:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047490.834760:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047491.348076:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047491.721028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:1.0:1784047491.721065:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689465088 offset 0 length 224: 4 00000100:00100000:3.0:1784047491.721208:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465344 00000100:00100000:3.0:1784047491.721232:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465344 00000100:00080000:1.0:1784047491.721922:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047491.722175:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1323 00000100:00100000:3.0:1784047491.722193:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:2399:x1870705689465344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047491.728154:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:2399:x1870705689465344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 5951us (7122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047491.728170:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1323 00000100:00100000:2.0:1784047491.734255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047491.734418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047491.734471:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465216 00000100:00100000:2.0:1784047491.734481:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465216 00000100:00100000:2.0:1784047491.734559:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1344 00000100:00100000:2.0:1784047491.734569:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689465216:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047491.734593:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047491.734682:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689465216:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 112us (435us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047491.734690:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1344 00000100:00100000:2.0:1784047491.735987:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465472 00000100:00100000:2.0:1784047491.735996:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465472 00000100:00100000:2.0:1784047491.736061:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4986 00000100:00100000:2.0:1784047491.736069:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689465472:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:2.0:1784047491.736095:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7750c8 00000100:00080000:2.0:1784047491.736103:0:8431:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784047491.736146:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968754 00000100:00100000:2.0:1784047491.736302:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+2:2398:x1870705689465472:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 232us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047491.736310:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4986 00010000:00010000:2.0:1784047491.736330:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047491.740467:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047491.740553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047491.741774:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465600 00000100:00100000:1.0:1784047491.741786:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465600 00000100:00100000:1.0:1784047491.741871:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4987 00000100:00100000:1.0:1784047491.741882:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689465600:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:1.0:1784047491.741917:0:26185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7750cf 00000100:00080000:1.0:1784047491.741927:0:26185:0:(import.c:65:import_set_state_nolock()) ffff99cbc6537800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047491.741980:0:26185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968753 00000100:00100000:1.0:1784047491.742147:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+2:2398:x1870705689465600:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 266us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047491.742166:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4987 00010000:00010000:1.0:1784047491.742187:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047491.742787:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047491.794727:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:1.0:1784047491.859748:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00100000:0.0:1784047492.372836:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047492.372861:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709315200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047492.372929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047492.373002:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315200 00000100:00100000:0.0:1784047492.373010:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315200 00000100:00100000:0.0:1784047492.373065:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:0.0:1784047492.373075:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709315200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047492.373118:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047492.373163:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709315200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047492.373170:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00010000:00010000:0.0:1784047492.373190:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047492.373197:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047492.373232:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709315200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047492.377455:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709315328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047492.377547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047492.377693:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315328 00000100:00100000:2.0:1784047492.377706:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315328 00000100:00100000:2.0:1784047492.377784:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1784047492.377820:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709315328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047492.377857:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047492.377904:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709315328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047492.377912:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00080000:0.0:1784047492.378247:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047492.378309:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709315328:0@lo:13:osp-pre-1-1.0 00000020:01000004:3.0:1784047492.399038:0:92453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784047492.399044:0:92453:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784047492.399046:0:92453:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784047492.399158:0:92453:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ccc832f800 00000020:01000004:3.0:1784047492.399175:0:92453:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784047492.399188:0:92453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784047492.399363:0:92453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cceff38000) 00000020:00000080:3.0:1784047492.399385:0:92453:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784047492.485844:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784047492.486889:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1784047492.492410:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.494536:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784047492.495024:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.495354:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.495579:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.495831:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784047492.496020:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784047492.496474:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.496718:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.496986:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784047492.497858:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784047492.498365:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784047492.498593:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784047492.499398:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784047492.499640:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784047492.499930:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784047492.500160:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784047492.500466:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784047492.500715:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784047492.501114:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784047492.501368:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.501951:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.502181:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.502491:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.502711:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.503172:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.503459:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.503703:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.504012:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.504195:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.504464:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.505134:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.505404:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.505645:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.506415:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.506838:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.507444:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.507811:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.508372:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.508637:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.508925:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.509368:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784047492.509570:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.509951:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784047492.510204:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784047492.515865:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784047492.516420:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784047492.516664:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784047492.517401:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784047492.517630:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1784047492.517926:0:92453:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1784047492.520929:0:92453:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784047492.521164:0:92453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784047492.521174:0:92453:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784047492.521186:0:92453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c77515b 00000020:01000004:3.0:1784047492.521194:0:92453:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784047492.521204:0:92453:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784047492.521210:0:92453:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccc832f800 from MGS 00000020:01000004:3.0:1784047492.521214:0:92453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784047492.521224:0:92453:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cceff3cd40) 00000020:00000080:3.0:1784047492.521237:0:92453:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1784047492.521309:0:92453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccc832f800 from MGS, refs=2 00080000:01000000:3.0:1784047492.521326:0:92453:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784047492.521332:0:92453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775169 00010000:00010000:3.0:1784047492.521445:0:92453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1784047492.529869:0:92453:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784047492.530949:0:92457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784047492.531009:0:92453:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784047492.531063:0:92453:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784047492.531861:0:92453:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784047492.532117:0:92453:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784047492.532402:0:92453:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784047492.532409:0:92453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784047492.534633:0:92453:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784047492.534643:0:92453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784047492.535371:0:92453:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784047492.535378:0:92453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784047492.536480:0:92453:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784047492.536503:0:92453:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784047492.536505:0:92453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784047492.536509:0:92453:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1784047492.536514:0:92453:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 70, was 0): CONNECTING 00000100:00100000:1.0:1784047492.536531:0:92453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1784047492.819146:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:1.0:1784047492.883914:0:66228:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:1.0:1784047492.883945:0:66228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:0.0:1784047492.884409:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047493.394866:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047493.768196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047493.768253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047493.770727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047493.770785:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465856 00000100:00100000:1.0:1784047493.770796:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465856 00000100:00100000:1.0:1784047493.770841:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465984 00000100:00100000:1.0:1784047493.770845:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465984 00000100:00100000:1.0:1784047493.770892:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1324 00000100:00100000:1.0:1784047493.770905:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:2400:x1870705689465984:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047493.770988:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:2400:x1870705689465984:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047493.770996:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1324 00000100:00100000:1.0:1784047493.771014:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1345 00000100:00100000:1.0:1784047493.771019:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689465856:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:1.0:1784047493.771043:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047493.771071:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689465856:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 51us (2818us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047493.771094:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1345 00000100:00100000:0.0:1784047493.771572:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689465728 00000100:00100000:0.0:1784047493.771578:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689465728 00000100:00100000:0.0:1784047493.771653:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1784047493.771659:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1870705689465728:12345-192.168.204.40@tcp:250:kworker.0 00010000:00080000:0.0:1784047493.771676:0:92458:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp t0 exp 0000000000000000 cur 3592 last 0 00000020:00000080:0.0:1784047493.771707:0:92458:0:(genops.c:1406:class_connect()) connect: client 4f88e784-1ed8-4645-9d2f-1081095d1f30, cookie 0x4426598c0c775170 00000100:00080000:0.0:1784047493.771837:0:92458:0:(import.c:65:import_set_state_nolock()) ffff99ccf7598000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047493.771874:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+5:2398:x1870705689465728:12345-192.168.204.40@tcp:250:kworker.0 Request processed in 214us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047493.771882:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00080000:0.0:1784047493.771929:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047493.842749:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047493.906744:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00080000:1.0:1784047494.420749:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047494.420762:0:81515:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784047494.420767:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047494.420772:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047494.420776:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047494.420785:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3587 00000100:00080000:1.0:1784047494.420791:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047494.420800:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00010000:00010000:3.0:1784047494.420848:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047494.420852:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030c380 x1870705709315456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047494.420920:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047494.420925:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047494.420926:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047494.420930:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3587 00000100:00080000:1.0:1784047494.420932:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047494.420936:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047494.420950:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030ea00 x1870705709315712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047494.420966:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047494.420969:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047494.420971:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047494.420974:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3587 00000100:00080000:1.0:1784047494.420992:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047494.420997:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047494.421011:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030ca80 x1870705709315968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047494.421045:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047494.421049:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047494.421051:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047494.421055:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3587 00000100:00080000:1.0:1784047494.421057:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047494.421061:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047494.421074:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce7ed7100 x1870705709316352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047494.421108:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709316224:0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.421187:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047494.421226:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047494.421231:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709316096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.421251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047494.421285:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316224 00000100:00100000:1.0:1784047494.421293:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316224 00000100:00100000:1.0:1784047494.421349:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316096 00000100:00100000:1.0:1784047494.421353:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316096 00000100:00100000:1.0:1784047494.421381:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1784047494.421392:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709316224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.421467:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709316224:12345-0@lo:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047494.421475:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1784047494.421510:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1784047494.421517:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709316096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.421546:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709316096:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047494.421553:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00080000:1.0:1784047494.421577:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047494.421582:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047494.421640:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709316096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.421654:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709316224:0@lo:400:kworker.0 00000100:00100000:3.0:1784047494.421789:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709315584:0@lo:400:kworker.0 00000100:00100000:0.0:1784047494.421789:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709315840:0@lo:400:kworker.0 00000100:00100000:2.0:1784047494.421893:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709315456:0@lo:38:kworker.0 00000100:00100000:0.0:1784047494.423890:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047494.424042:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315840 00000100:00100000:1.0:1784047494.424051:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315840 00000100:00100000:1.0:1784047494.424116:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1784047494.424126:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709315840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.424197:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709315840:12345-0@lo:400:kworker.0 Request processed in 72us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047494.424203:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00080000:0.0:1784047494.424301:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047494.424339:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709315840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047494.428038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047494.428191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047494.428266:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709315712:0@lo:38:kworker.0 00000100:00100000:2.0:1784047494.428313:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047494.428361:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315584 00000100:00100000:1.0:1784047494.428371:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315584 00000100:00100000:1.0:1784047494.428439:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315456 00000100:00100000:1.0:1784047494.428442:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315456 00000100:00100000:1.0:1784047494.428461:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1784047494.428470:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709315584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047494.428535:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709315584:12345-0@lo:400:kworker.0 Request processed in 66us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047494.428543:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1784047494.428560:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1784047494.428564:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709315456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047494.428589:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047494.428632:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709315456:12345-0@lo:38:kworker.0 Request processed in 67us (442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047494.428639:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00080000:0.0:1784047494.428891:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047494.429007:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709315968:0@lo:38:kworker.0 00000100:00100000:2.0:1784047494.429036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047494.429061:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709316352:0@lo:38:kworker.0 00000100:00100000:2.0:1784047494.429084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047494.429124:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047494.429130:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047494.429134:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709315456:0@lo:38:kworker.0 00000100:00100000:2.0:1784047494.429166:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315712 00000100:00100000:2.0:1784047494.429169:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315712 00000100:00100000:2.0:1784047494.429184:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316352 00000100:00100000:2.0:1784047494.429186:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316352 00000100:00100000:2.0:1784047494.429198:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1784047494.429203:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709315712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047494.429216:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047494.429245:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709315712:12345-0@lo:38:kworker.0 Request processed in 40us (930us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047494.429251:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1784047494.429262:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1784047494.429266:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709316352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047494.429274:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047494.429292:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709316352:12345-0@lo:38:kworker.0 Request processed in 24us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047494.429298:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00080000:2.0:1784047494.429318:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047494.429338:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047494.429341:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709315712:0@lo:38:kworker.0 00000100:00080000:2.0:1784047494.429351:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047494.429354:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047494.429357:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709316352:0@lo:38:kworker.0 00000100:00100000:2.0:1784047494.429396:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709315584:0@lo:400:kworker.0 00000100:00100000:0.0:1784047494.429593:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709315968 00000100:00100000:0.0:1784047494.429598:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709315968 00000100:00100000:0.0:1784047494.429644:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1784047494.429658:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709315968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047494.429669:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047494.429716:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709315968:12345-0@lo:38:kworker.0 Request processed in 65us (678us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047494.429722:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00080000:2.0:1784047494.430210:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047494.430215:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047494.430219:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709315968:0@lo:38:kworker.0 00000100:00100000:3.0:1784047494.869100:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047494.931112:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00100000:1.0:1784047495.174653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047495.174755:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466112 00000100:00100000:0.0:1784047495.174767:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466112 00000100:00100000:0.0:1784047495.174843:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:0.0:1784047495.174862:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+5:70965:x1870705689466112:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047495.174883:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047495.174910:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3c5 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047495.174943:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 6 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047495.174956:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 6 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047495.174985:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbda00, rc 0) 00000100:00100000:0.0:1784047495.175056:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689466112:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 195us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047495.175063:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:2.0:1784047495.189663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047495.189773:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466240 00000100:00100000:3.0:1784047495.189783:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466240 00000100:00100000:3.0:1784047495.189840:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:3.0:1784047495.189858:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689466240:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784047495.189937:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689466240:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 88us (284us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047495.189945:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:3.0:1784047495.211826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047495.212539:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466368 00000100:00100000:2.0:1784047495.212552:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466368 00000100:00100000:2.0:1784047495.212649:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:2.0:1784047495.212662:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689466368:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047495.212681:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047495.212710:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3cc expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047495.212740:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 7 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047495.212754:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 7 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047495.212764:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46e00, rc 0) 00000100:00100000:2.0:1784047495.212858:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+7:70965:x1870705689466368:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 189us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047495.212882:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:1.0:1784047495.223694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047495.224338:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466496 00000100:00100000:0.0:1784047495.224355:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466496 00000100:00100000:0.0:1784047495.224428:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:0.0:1784047495.224439:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+7:70965:x1870705689466496:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784047495.226866:0:92463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784047495.227874:0:92461:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 121 20000000:01000000:0.0:1784047495.230634:0:92464:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784047495.230642:0:92464:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1784047495.230645:0:92464:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784047495.230648:0:92464:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784047495.232243:0:92464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784047495.236882:0:92461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784047495.236980:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689466496:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 12535us (13304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047495.236999:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:0.0:1784047495.250244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047495.250328:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466624 00000100:00100000:3.0:1784047495.250340:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466624 00000100:00100000:3.0:1784047495.250405:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:3.0:1784047495.250416:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689466624:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047495.250650:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689466624:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 235us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047495.250681:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:3.0:1784047495.255935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047495.256130:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466752 00000100:00100000:1.0:1784047495.256140:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466752 00000100:00100000:1.0:1784047495.256190:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1784047495.256200:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689466752:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047495.256218:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047495.256242:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c775185 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3d3 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047495.256269:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c775185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3d3 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047495.256282:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c775185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3d3 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047495.256292:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfa00, rc 0) 00000100:00100000:1.0:1784047495.256348:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689466752:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 149us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047495.256372:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1784047495.258371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047495.258472:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689466880 00000100:00100000:2.0:1784047495.258481:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689466880 00000100:00100000:2.0:1784047495.258552:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:2.0:1784047495.258566:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689466880:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047495.258785:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689466880:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 223us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047495.258793:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:0.0:1784047495.271911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047495.272003:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467008 00000100:00100000:3.0:1784047495.272016:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467008 00000100:00100000:3.0:1784047495.272072:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1784047495.272082:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689467008:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047495.272226:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689467008:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047495.272234:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1784047495.290072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047495.293956:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467136 00000100:00100000:1.0:1784047495.293972:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467136 00000100:00100000:1.0:1784047495.294050:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1784047495.294062:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689467136:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047495.294079:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047495.294100:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3da expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047495.294131:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 10 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047495.294144:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 10 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047495.294153:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce400, rc 0) 00000100:00100000:1.0:1784047495.294229:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689467136:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 170us (4167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047495.294237:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1784047495.305913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047495.306491:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467264 00000100:00100000:2.0:1784047495.306502:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467264 00000100:00100000:2.0:1784047495.306569:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:2.0:1784047495.306581:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689467264:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047495.306787:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689467264:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 208us (895us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784047495.306796:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00010000:00010000:2.0:1784047495.442983:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047495.890725:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047495.954777:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:1.0:1784047496.467213:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047496.773166:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047496.773224:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467648 00000100:00100000:0.0:1784047496.773225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047496.773247:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467648 00000100:00100000:0.0:1784047496.773338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047496.773407:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467520 00000100:00100000:0.0:1784047496.773417:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467520 00000100:00100000:0.0:1784047496.773475:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1349 00000100:00100000:0.0:1784047496.773485:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689467520:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:0.0:1784047496.773513:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047496.773587:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689467520:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 101us (249us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047496.773664:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1327 00000100:00100000:2.0:1784047496.773691:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:2402:x1870705689467648:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047496.773781:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467392 00000100:00100000:3.0:1784047496.773789:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467392 00000100:00100000:2.0:1784047496.773793:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:2402:x1870705689467648:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 116us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047496.773836:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:3.0:1784047496.773845:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689467392:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047496.773889:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689467392:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 45us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047496.773896:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1784047496.775833:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1349 00000100:00080000:1.0:1784047496.777739:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047496.778397:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1327 00000100:00100000:3.0:1784047496.914740:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047496.978766:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:0.0:1784047497.490818:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047497.491065:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709316480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047497.491164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047497.491225:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316480 00000100:00100000:2.0:1784047497.491234:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316480 00000100:00100000:2.0:1784047497.491289:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1784047497.491303:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709316480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047497.491334:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047497.491377:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709316480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047497.491385:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1784047497.491471:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709316480:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047497.492672:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1784047497.493504:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:1.0:1784047497.493511:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccd897e000/0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:1.0:1784047497.493535:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd897e000/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-OST0000 00000020:00000080:1.0:1784047497.493596:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897f800 for lustre-OST0000 00000100:00100000:2.0:1784047497.493888:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709316608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047497.493953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047497.494068:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316608 00000100:00100000:0.0:1784047497.494076:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316608 00000100:00100000:0.0:1784047497.494181:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:0.0:1784047497.494190:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709316608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047497.494217:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047497.494271:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709316608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047497.494279:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1784047497.494413:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709316608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784047497.496231:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1784047497.496468:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:3.0:1784047497.496474:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccd8978800/0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:1.0:1784047497.496694:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd8978800/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-OST0001 00000020:00000080:1.0:1784047497.496740:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc6537800 for lustre-OST0001 00000100:00100000:3.0:1784047497.938757:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047498.002749:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047498.515261:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047498.966690:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:1.0:1784047499.028574:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00080000:1.0:1784047499.539790:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047499.539800:0:81515:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784047499.539803:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047499.539807:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047499.539812:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047499.539821:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3592 00000100:00080000:1.0:1784047499.539826:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047499.539834:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047499.539873:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edf480 x1870705709316736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047499.539945:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047499.539949:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047499.539951:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047499.539955:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3592 00000100:00080000:1.0:1784047499.539957:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047499.539961:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047499.539974:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edc700 x1870705709316992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047499.539990:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047499.539993:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047499.540012:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047499.540016:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3592 00000100:00080000:1.0:1784047499.540018:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047499.540022:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047499.540039:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edc000 x1870705709317248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047499.540070:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047499.540073:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047499.540075:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047499.540078:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3592 00000100:00080000:1.0:1784047499.540080:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784047499.540084:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047499.540095:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edfb80 x1870705709317632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047499.541953:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709316864:0@lo:400:kworker.0 00000100:00100000:1.0:1784047499.542046:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709317376:0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.542047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.542094:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047499.542099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.542105:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709317120:0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.542190:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709317504:0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.542199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.542236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.542256:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316864 00000100:00100000:2.0:1784047499.542265:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316864 00000100:00100000:3.0:1784047499.542296:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709317120 00000100:00100000:3.0:1784047499.542302:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709317120 00000100:00100000:2.0:1784047499.542334:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1784047499.542343:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1784047499.542358:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709317120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.542358:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709316864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.542445:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709316864:12345-0@lo:400:kworker.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.542453:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1784047499.542525:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709317376 00000100:00100000:1.0:1784047499.542529:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709317376 00000100:00100000:0.0:1784047499.542579:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047489/real 1784047489] req@ffff99cbcec16a00 x1870705709315072/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047499.542602:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cbcec16a00 x1870705709315072/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047499.542632:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709316736:0@lo:38:kworker.0 00000100:00100000:0.0:1784047499.542665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.542685:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709316992:0@lo:38:kworker.0 00000100:00100000:0.0:1784047499.542709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.542726:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709317248:0@lo:38:kworker.0 00000100:00100000:0.0:1784047499.542751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.542771:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709317632:0@lo:38:kworker.0 00000100:00100000:0.0:1784047499.542793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047499.542823:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047499.542837:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1784047499.542843:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709315072:0@lo:250:kworker.0 00000100:00100000:0.0:1784047499.542872:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316736 00000100:00100000:0.0:1784047499.542876:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316736 00000100:00100000:0.0:1784047499.542889:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709316992 00000100:00100000:0.0:1784047499.542892:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709316992 00000100:00100000:0.0:1784047499.542898:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709317632 00000100:00100000:0.0:1784047499.542900:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709317632 00000100:00100000:0.0:1784047499.542910:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1784047499.542914:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709316736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047499.542934:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047499.542970:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709316736:12345-0@lo:38:kworker.0 Request processed in 54us (304us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047499.542976:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1784047499.542990:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1784047499.542993:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709316992:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047499.543002:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047499.543026:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709316992:12345-0@lo:38:kworker.0 Request processed in 31us (316us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047499.543032:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1784047499.543045:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1784047499.543049:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709317632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047499.543059:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047499.543083:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709317632:12345-0@lo:38:kworker.0 Request processed in 32us (289us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047499.543099:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00010000:00010000:0.0:1784047499.543256:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047499.543353:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709317504 00000100:00100000:1.0:1784047499.543357:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709317504 00000100:00100000:1.0:1784047499.543403:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1784047499.543411:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709317376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047499.543453:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709317376:12345-0@lo:400:kworker.0 Request processed in 44us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047499.543459:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1784047499.543472:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1784047499.543485:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709317504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047499.543526:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709317504:12345-0@lo:400:kworker.0 Request processed in 41us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047499.543532:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1784047499.543583:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709317504:0@lo:400:kworker.0 00000100:00080000:0.0:1784047499.543667:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047499.543708:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047499.543712:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709316736:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.543755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709317376:0@lo:400:kworker.0 00000100:00080000:0.0:1784047499.543788:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047499.543793:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047499.543795:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709316992:0@lo:38:kworker.0 00000100:00080000:0.0:1784047499.543805:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047499.543808:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047499.543811:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709317632:0@lo:38:kworker.0 00000100:00080000:1.0:1784047499.543891:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047499.543899:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784047499.543902:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047499.543909:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3587 10000000:01000000:0.0:1784047499.543938:0:92453:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1784047499.543956:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784047499.543978:0:81515:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 10000000:00010000:0.0:1784047499.543991:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784047499.544003:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 10000000:01000000:0.0:1784047499.544039:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1784047499.544054:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edd880 x1870705709317760/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784047499.544138:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.544198:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24a400/0x4426598c0c774d25 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774d2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.544380:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.544397:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:1.0:1784047499.544411:0:3644:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff99cbc9edd880 x1870705709317760/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784047499.544544:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.544552:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.544558:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff419e00/0x4426598c0c774c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774c92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.544569:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.544575:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.544579:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.544583:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.544586:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c774ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774cae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.544594:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.544601:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.544692:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.544723:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.544728:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0400/0x4426598c0c774cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774cd8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.544927:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.544945:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.544950:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.544953:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.544957:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cceff28800/0x4426598c0c774cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774ce6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.544969:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545002:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545009:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.545012:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545028:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418600/0x4426598c0c774cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774d02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545037:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545046:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545064:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.545068:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545071:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24ba00/0x4426598c0c774d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774d10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545195:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545220:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545226:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.545230:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545239:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff419a00/0x4426598c0c774d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774d3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545276:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545475:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545480:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.545484:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545489:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cceff29c00/0x4426598c0c774c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545501:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545508:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545513:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.545522:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545526:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418800/0x4426598c0c774cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774cbc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545536:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545543:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545548:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047499.545550:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545553:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccff418e00/0x4426598c0c774cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774cca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545561:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545567:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545572:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047499.545574:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545577:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec24bc00/0x4426598c0c774ced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774cf4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.545585:0:92453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.545590:0:92453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.545635:0:92453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047499.545639:0:92453:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047499.545643:0:92453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccec3a0e00/0x4426598c0c774d17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c774d1e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047499.551563:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709317120:12345-0@lo:400:kworker.0 Request processed in 9201us (9357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.551581:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1784047499.551666:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709317248 00000100:00100000:3.0:1784047499.551677:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709317248 00000100:00100000:3.0:1784047499.551723:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1784047499.551729:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709317248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047499.551752:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047499.551809:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709317248:12345-0@lo:38:kworker.0 Request processed in 79us (9057us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047499.551815:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00080000:3.0:1784047499.551870:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047499.551874:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047499.551878:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047499.556420:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709317120:0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.556471:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709316864:0@lo:400:kworker.0 00000100:00080000:0.0:1784047499.577980:0:92453:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 71, was 0): CONNECTING 00000100:00080000:0.0:1784047499.577992:0:92453:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1784047499.582769:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047499.582800:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00080000:3.0:1784047499.582889:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047499.582896:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784047499.582899:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047499.582905:0:81515:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3597 00000100:00080000:3.0:1784047499.582913:0:81515:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784047499.582922:0:81515:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047499.582973:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e8e00 x1870705709317888/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047499.583700:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:0:1870705709317760:0@lo:250:kworker.0 00000100:00080000:1.0:1784047499.588098:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047499.588112:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047499.588117:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709317248:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.588150:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709317888:0@lo:250:kworker.0 00000100:00100000:1.0:1784047499.588230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.588364:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709317888 00000100:00100000:2.0:1784047499.588371:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709317888 00000100:00100000:2.0:1784047499.588439:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784047499.588448:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3644:x1870705709317888:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1784047499.588483:0:92459:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6e36843b-2016-43fe-8842-da5818d68597@0@lo t0 exp 0000000000000000 cur 3597 last 0 00000020:00000080:2.0:1784047499.588511:0:92459:0:(genops.c:1406:class_connect()) connect: client 6e36843b-2016-43fe-8842-da5818d68597, cookie 0x4426598c0c775193 00000100:00080000:2.0:1784047499.588661:0:92459:0:(import.c:65:import_set_state_nolock()) ffff99ccd8436000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047499.588723:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+5:3644:x1870705709317888:12345-0@lo:250:kworker.0 Request processed in 273us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.588731:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784047499.588755:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 28 00000100:00080000:1.0:1784047499.588763:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:1.0:1784047499.589066:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784047499.589070:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784047499.589074:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784047499.589077:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784047499.589114:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784047499.589128:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709317888:0@lo:250:kworker.0 00000020:01000000:0.0:1784047499.589221:0:81515:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.140@tcp 10000000:01000000:0.0:1784047499.589242:0:81515:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784047499.589246:0:81515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784047499.589248:0:81515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784047499.589249:0:81515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047499.589250:0:81515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047499.589251:0:81515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047499.589252:0:81515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047499.589253:0:81515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784047499.589255:0:81515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047499.589256:0:81515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784047499.589309:0:81515:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784047499.589317:0:81515:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1784047499.589318:0:81515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784047499.589320:0:81515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784047499.589321:0:81515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047499.589322:0:81515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047499.589323:0:81515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047499.589324:0:81515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047499.589325:0:81515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784047499.589326:0:81515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047499.589327:0:81515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784047499.589339:0:81515:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784047499.589344:0:81515:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1784047499.589346:0:81515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784047499.589348:0:81515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784047499.589348:0:81515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047499.589356:0:81515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047499.589357:0:81515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047499.589358:0:81515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047499.589359:0:81515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047499.589360:0:81515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047499.589361:0:81515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784047499.589400:0:81515:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00080000:2.0:1784047499.589408:0:92453:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1784047499.589421:0:92453:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:0.0:1784047499.589432:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709318144:0@lo:253:kworker.0 00000020:01000004:2.0:1784047499.589460:0:92453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784047499.589466:0:92453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:0.0:1784047499.589482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.589519:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047499.589525:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709318016:0@lo:253:kworker.0 00000100:00100000:0.0:1784047499.589552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.589576:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709318272:0@lo:253:kworker.0 00000100:00100000:0.0:1784047499.589642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.589683:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318144 00000100:00100000:0.0:1784047499.589689:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318144 00000100:00100000:0.0:1784047499.589715:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318016 00000100:00100000:0.0:1784047499.589718:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318016 00000100:00100000:0.0:1784047499.589745:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318272 00000040:01000000:2.0:1784047499.589748:0:92453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000100:00100000:0.0:1784047499.589749:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318272 00000100:00100000:0.0:1784047499.589767:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000020:01000004:2.0:1784047499.589777:0:92453:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000100:00100000:0.0:1784047499.589778:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:3646:x1870705709318144:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784047499.589802:0:92458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784047499.589815:0:92458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1784047499.589892:0:92453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000100:00100000:0.0:1784047499.589896:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1784047499.589897:0:92453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047499.589901:0:92453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047499.589903:0:92453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047499.589905:0:92453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047499.589908:0:92453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1784047499.589908:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+7:3646:x1870705709318016:12345-0@lo:253:kworker.0 00000020:01000004:2.0:1784047499.589912:0:92453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047499.589914:0:92453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047499.589917:0:92453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047499.589918:0:92453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784047499.589921:0:92453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784047499.589923:0:92453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784047499.589925:0:92453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047499.589926:0:92453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 20000000:01000000:0.0:1784047499.589928:0:92459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:2.0:1784047499.589934:0:92453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047499.589936:0:92453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047499.589938:0:92453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047499.589939:0:92453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047499.589940:0:92453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047499.589942:0:92453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047499.589943:0:92453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784047499.589958:0:92453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784047499.589969:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784047499.590004:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.590030:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc109c300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.592213:0:92461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1784047499.592229:0:92461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1784047499.594084:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318400 00000100:00100000:0.0:1784047499.594096:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318400 00000100:00100000:2.0:1784047499.594412:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784047499.594429:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709318272:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784047499.594468:0:92466:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784047499.600448:0:92459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784047499.600573:0:92458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784047499.600712:0:92458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784047499.600793:0:92463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047499.600798:0:92463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047499.600819:0:92463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.600839:0:92463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.600848:0:92463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.600890:0:92463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.600903:0:92463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 9 pid: 92461 timeout: 3697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047499.600916:0:92463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92463:1870705709318528:192.168.204.40@tcp:104: 00000100:00100000:2.0:1784047499.601247:0:92463:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc109c840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047499.609728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047499.609769:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467776 00000100:00100000:1.0:1784047499.609778:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467776 00000100:00100000:3.0:1784047499.609816:0:92463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92463:1870705709318528:192.168.204.40@tcp:104: 00010000:00010000:1.0:1784047499.609823:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 10 pid: 92461 timeout: 3697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.609850:0:92463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047499.609870:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2544 00000100:00100000:1.0:1784047499.609886:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689467776:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784047499.609904:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047499.609913:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 10 pid: 92461 timeout: 3697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.609925:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 10 pid: 92461 timeout: 3697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.609944:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbda00/0x4426598c0c775177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3c5 expref: 10 pid: 92461 timeout: 3697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.609961:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.609969:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784047499.613535:0:26194:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012735071s 00010000:00010000:3.0:1784047499.613552:0:26194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613564:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613572:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613581:0:26194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613594:0:26194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047499.613599:0:26194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613733:0:26194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.613826:0:92463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.613836:0:92463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613868:0:26194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613878:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46800/0x4426598c0c77519a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.613909:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047499.614043:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2401:x1870705689467776:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 4156us (4321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.614054:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2544 00000100:00100000:2.0:1784047499.614407:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:3646:x1870705709318144:12345-0@lo:253:kworker.0 Request processed in 24630us (24923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.614418:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784047499.614447:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047499.614461:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:92453:x1870705709318400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784047499.614503:0:92458:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784047499.614506:0:92458:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784047499.614509:0:92458:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784047499.614515:0:92458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1784047499.614801:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784047499.614805:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784047499.614806:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047499.614808:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047499.614809:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047499.614810:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047499.614812:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784047499.614813:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047499.614815:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784047499.614818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709318144:0@lo:253:kworker.0 00000100:00100000:2.0:1784047499.614959:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+7:92453:x1870705709318400:12345-0@lo:253:mount.lustre.0 Request processed in 504us (24953us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.614967:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047499.615003:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318400:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784047499.615013:0:92453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784047499.615016:0:92453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784047499.615017:0:92453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047499.615018:0:92453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047499.615019:0:92453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047499.615020:0:92453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047499.615022:0:92453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047499.615023:0:92453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047499.615024:0:92453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047499.615025:0:92453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047499.615036:0:92453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784047499.615053:0:92453:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccc832f800 from lustre-MDT0000 10000000:01000000:2.0:1784047499.615080:0:92453:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784047499.615083:0:92453:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784047499.615091:0:92453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccc832f800 10000000:01000000:2.0:1784047499.615095:0:92453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784047499.615099:0:92453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ccc832f800 10000000:01000000:2.0:1784047499.615104:0:92453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784047499.615108:0:92453:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc832f800 from 1 10000000:01000000:2.0:1784047499.615111:0:92453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784047499.615142:0:92453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.615152:0:92453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047499.615162:0:92453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047499.615184:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784047499.615220:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.615249:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc109c900 going to sleep for 11 seconds 20000000:01000000:2.0:1784047499.616193:0:92466:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784047499.616731:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318656 00000100:00100000:1.0:1784047499.616741:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318656 00000100:00100000:1.0:1784047499.616813:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784047499.616825:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+7:92453:x1870705709318656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047499.616841:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047499.616860:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cec00/0x4426598c0c7751a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7751a1 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.616884:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cec00/0x4426598c0c7751a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7751a1 expref: 8 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.616896:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cec00/0x4426598c0c7751a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7751a1 expref: 8 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.616905:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cec00, rc 0) 00000100:00100000:1.0:1784047499.616968:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:92453:x1870705709318656:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047499.616975:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 20000000:01000000:1.0:1784047499.618303:0:92459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784047499.618331:0:92459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784047499.618460:0:92463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784047499.618467:0:92463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784047499.618494:0:92463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618509:0:92463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047499.618518:0:92463:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012735071s 00010000:00010000:0.0:1784047499.618535:0:92463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618542:0:92463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618549:0:92463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618556:0:92463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618562:0:92463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047499.618566:0:92463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618573:0:92463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618593:0:92463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618600:0:92463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.618641:0:92463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc600/0x4426598c0c7751af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047499.618971:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047499.618992:0:92453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.619000:0:92453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047499.619020:0:92453:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784047499.619075:0:92453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.619084:0:92453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047499.619091:0:92453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784047499.619106:0:92453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784047499.619112:0:92453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ccc832f800 10000000:01000000:3.0:1784047499.619115:0:92453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784047499.619119:0:92453:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784047499.619121:0:92453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784047499.619150:0:92453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.619157:0:92453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.619166:0:92453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047499.619187:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784047499.619250:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.619300:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c3ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047499.619366:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318784 00000100:00100000:1.0:1784047499.619373:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318784 00000100:00100000:1.0:1784047499.619444:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784047499.619455:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:92453:x1870705709318784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047499.619469:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047499.619483:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7751b6 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.619514:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.619535:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.619543:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfe00, rc 0) 00000100:00100000:1.0:1784047499.619639:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709318784:12345-0@lo:101:mount.lustre.0 Request processed in 186us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047499.619646:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784047499.620085:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047499.620101:0:92453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.620111:0:92453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047499.620183:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047499.620213:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.620247:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.623289:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709318912 00000100:00100000:0.0:1784047499.623304:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709318912 00000100:00100000:0.0:1784047499.623363:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784047499.623373:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709318912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047499.623848:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709318912:12345-0@lo:501:mount.lustre.0 Request processed in 474us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.623850:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:3646:x1870705709318016:12345-0@lo:253:kworker.0 Request processed in 33942us (34294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.623865:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784047499.623881:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:3.0:1784047499.628025:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784047499.628032:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784047499.628034:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047499.628035:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047499.628037:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047499.628039:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047499.628041:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784047499.628042:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047499.628043:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784047499.628050:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709318016:0@lo:253:kworker.0 00000100:00100000:3.0:1784047499.628911:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709318912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047499.628973:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709319040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047499.629058:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.629102:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c3ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.629927:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319040 00000100:00100000:0.0:1784047499.629938:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319040 00000100:00100000:0.0:1784047499.629988:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784047499.629998:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709319040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047499.633291:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709319040:12345-0@lo:503:mount.lustre.0 Request processed in 3282us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.633306:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784047499.633445:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709319040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047499.634363:0:92467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92467:1870705709319168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.634433:0:92467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.634474:0:92467:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047499.634525:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319168 00000100:00100000:3.0:1784047499.634534:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319168 00000100:00100000:3.0:1784047499.634574:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784047499.634596:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:92467:x1870705709319168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047499.635530:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:92467:x1870705709319168:12345-0@lo:502:llog_process_th.0 Request processed in 944us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.635539:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784047499.635778:0:92467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92467:1870705709319168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784047499.635815:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047499.635830:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.635833:0:92467:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784047499.635838:0:92467:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784047499.635846:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784047499.635861:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cbc76cb380) 00000020:00000080:0.0:1784047499.635883:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1784047499.635890:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784047499.635996:0:92467:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784047499.636005:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7751cb 00000020:00000080:0.0:1784047499.636396:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784047499.636403:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047499.636407:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.636409:0:92467:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784047499.636412:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047499.636416:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.636417:0:92467:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784047499.636421:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784047499.636430:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cbc76ccd40) 00000020:00000080:0.0:1784047499.636446:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1784047499.636452:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784047499.636454:0:92467:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784047499.636456:0:92467:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784047499.636462:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784047499.636511:0:92467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccc832f800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784047499.636522:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cbc76c8000) 00000020:00000080:0.0:1784047499.636532:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1784047499.636917:0:92467:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784047499.637289:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c7751e0 00000020:00000080:0.0:1784047499.637440:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784047499.637448:0:92467:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784047499.637454:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4426598c0c7751e7 00080000:01000000:0.0:1784047499.637459:0:92467:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784047499.637463:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c7751ee 20000000:01000000:2.0:1784047499.638072:0:92466:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784047499.638084:0:92466:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784047499.638492:0:92463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784047499.638497:0:92463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784047499.638519:0:92463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638545:0:92463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047499.638554:0:92463:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012735071s 00010000:00010000:0.0:1784047499.638559:0:92463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638566:0:92463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638573:0:92463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638581:0:92463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638602:0:92463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047499.638625:0:92463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638634:0:92463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638647:0:92463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638655:0:92463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.638662:0:92463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbd000/0x4426598c0c7751f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047499.640229:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709318272:12345-0@lo:253:kworker.0 Request processed in 45798us (50577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.640242:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:0.0:1784047499.642619:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784047499.642627:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784047499.642628:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047499.642630:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047499.642631:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047499.642633:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047499.642634:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047499.642636:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047499.642637:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784047499.642644:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709318272:0@lo:253:kworker.0 00010000:00010000:2.0:1784047499.746789:0:92467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784047499.747342:0:92467:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116995 lx: 0 gen 22 00000001:00080000:2.0:1784047499.747396:0:92467:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0c846d7a-6357-4e9c-a620-e35737ede709 idx: 2 lr: 0 srv lr: 115964116995 lx: 0 gen 24 00000001:00000004:2.0:1784047499.747427:0:92467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116995 00000001:00080000:2.0:1784047499.747896:0:92467:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784047499.747962:0:92467:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cbc6ceba80: xid 1870705709304320, transno 115964116995, client gen 22, slot idx 1 00000020:00000080:2.0:1784047499.748739:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ccc4ac3380) 00000020:00000080:2.0:1784047499.748763:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784047499.748840:0:92467:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784047499.748848:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775211 00000020:00000080:2.0:1784047499.750826:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784047499.762127:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4426598c0c775218 00000020:00000080:1.0:1784047499.766818:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784047499.766835:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047499.766845:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.766847:0:92467:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784047499.766850:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784047499.766854:0:92467:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784047499.766856:0:92467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047499.766857:0:92467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784047499.766858:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784047499.766861:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.766862:0:92467:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784047499.766865:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047499.766870:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.766871:0:92467:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784047499.766876:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784047499.766945:0:92467:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784047499.766963:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047499.766966:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.766967:0:92467:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784047499.766970:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047499.766991:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.766993:0:92467:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784047499.766998:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784047499.767004:0:92467:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:1.0:1784047499.767031:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047499.767056:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99cd00100000) 00000020:00000080:1.0:1784047499.767080:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784047499.767087:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784047499.767151:0:92467:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784047499.767158:0:92467:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784047499.767170:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775226 00010000:00080000:1.0:1784047499.767207:0:92467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbcad88800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1784047499.770556:0:92467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1784047499.772404:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047499.772423:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784047499.772465:0:92467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784047499.772492:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77522d 00000100:00080000:0.0:1784047499.772506:0:92467:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047499.772511:0:92467:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cbcad88800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047499.772548:0:92467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b97800 x1870705709319296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047499.772577:0:92467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1784047499.772669:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047499.772674:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.772676:0:92467:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1784047499.772679:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784047499.772681:0:92467:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1784047499.772683:0:92467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047499.772685:0:92467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047499.772686:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784047499.772688:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.772690:0:92467:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784047499.772693:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784047499.772706:0:92467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784047499.772711:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.772712:0:92467:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784047499.772717:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784047499.772722:0:92467:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000100:00080000:3.0:1784047499.772739:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047499.772745:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:01000000:0.0:1784047499.772746:0:92467:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00080000:3.0:1784047499.772748:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:0.0:1784047499.772750:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00080000:3.0:1784047499.772756:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3597 00000020:00000080:0.0:1784047499.772765:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cd00d799c0) 00000100:00080000:3.0:1784047499.772766:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047499.772783:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000020:00000080:0.0:1784047499.772784:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1784047499.772791:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1784047499.772803:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3ead80 x1870705709319552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047499.772840:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047499.772843:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047499.772845:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047499.772848:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3597 00000100:00080000:3.0:1784047499.772851:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047499.772855:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000004:00080000:0.0:1784047499.772855:0:92467:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784047499.772864:0:92467:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000100:00100000:3.0:1784047499.772872:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3eaa00 x1870705709319808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1784047499.772872:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c77523b 00000100:00080000:3.0:1784047499.772893:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047499.772896:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047499.772897:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00080000:0.0:1784047499.772908:0:92467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccfe78d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00000100:00100000:2.0:1784047499.773150:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709319680:0@lo:400:kworker.0 00010000:00010000:0.0:1784047499.773192:0:92467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1784047499.773219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.773259:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047499.773266:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709319936:0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.773290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.773330:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319680 00000100:00100000:2.0:1784047499.773336:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319680 00000100:00100000:2.0:1784047499.773393:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319936 00000100:00100000:2.0:1784047499.773397:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319936 00000100:00100000:2.0:1784047499.773423:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1784047499.773433:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709319680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.773494:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709319680:12345-0@lo:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.773502:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1784047499.773517:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1784047499.773524:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709319936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.773550:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709319936:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.773556:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1784047499.773662:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709319936:0@lo:400:kworker.0 00000100:00100000:0.0:1784047499.773676:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709319680:0@lo:400:kworker.0 00000100:00080000:3.0:1784047499.773710:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3597 00000100:00080000:3.0:1784047499.773715:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047499.773720:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047499.773738:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3eb100 x1870705709320064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047499.773761:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047499.773764:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047499.773766:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047499.773769:0:81515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3597 00000100:00080000:3.0:1784047499.773847:0:81515:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047499.773852:0:81515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047499.773865:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3e9880 x1870705709320448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047499.773895:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709319424:0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.774131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.774172:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709320320:0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.774197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.774218:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047499.774224:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709320192:0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.774245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.774289:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320320 00000100:00100000:3.0:1784047499.774294:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320320 00000100:00100000:3.0:1784047499.774322:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320192 00000100:00100000:3.0:1784047499.774325:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320192 00000040:01000000:0.0:1784047499.774340:0:92467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784047499.774345:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:3.0:1784047499.774353:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.774403:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709320320:12345-0@lo:400:kworker.0 Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.774410:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:3.0:1784047499.774423:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1784047499.774431:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709320192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.774459:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709320192:12345-0@lo:400:kworker.0 Request processed in 30us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.774464:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1784047499.774496:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709320192:0@lo:400:kworker.0 00000100:00100000:3.0:1784047499.774517:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709320320:0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.774579:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319424 00000100:00100000:2.0:1784047499.774592:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319424 00000100:00100000:2.0:1784047499.774644:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784047499.774651:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:3648:x1870705709319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047499.774687:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:3648:x1870705709319424:12345-0@lo:400:kworker.0 Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.774694:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784047499.774729:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709319424:0@lo:400:kworker.0 00000100:00100000:1.0:1784047499.775424:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709319296:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047499.775472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.775501:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709319552:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.775523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.775542:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709319808:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.775562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.775577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709320064:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.775688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.775705:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709320448:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.775724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.775761:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319552 00000100:00100000:1.0:1784047499.775766:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319552 00000100:00100000:0.0:1784047499.776070:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319296 00000100:00100000:0.0:1784047499.776076:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319296 00000100:00100000:0.0:1784047499.776116:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320064 00000100:00100000:0.0:1784047499.776121:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320064 00000100:00100000:0.0:1784047499.776146:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1784047499.776152:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709319296:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784047499.776180:0:83733:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3598 last 0 00000100:00100000:3.0:1784047499.776185:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:3.0:1784047499.776192:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709320064:12345-0@lo:38:kworker.0 00000020:00000080:0.0:1784047499.776223:0:83733:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775242 00000004:00100000:0.0:1784047499.776239:0:83733:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784047499.776258:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709320064:12345-0@lo:38:kworker.0 Request processed in 63us (568us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047499.776264:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00080000:0.0:1784047499.776330:0:83733:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d77800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047499.776398:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709319296:12345-0@lo:38:llog_process_th.0 Request processed in 245us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.776406:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000040:01000000:0.0:1784047499.776438:0:92467:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784047499.776690:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709319808 00000100:00100000:1.0:1784047499.776696:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320448 00000100:00100000:0.0:1784047499.776696:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709319808 00000100:00100000:1.0:1784047499.776704:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320448 00000100:00100000:0.0:1784047499.776726:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1784047499.776732:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709319552:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784047499.776771:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709319552:12345-0@lo:38:kworker.0 Request processed in 37us (1246us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784047499.777125:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047499.777136:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1784047499.777144:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784047499.777149:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784047499.777153:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcad88800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784047499.777165:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709319296:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784047499.777182:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047499.777186:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784047499.777188:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709319552:0@lo:38:kworker.0 00000100:00080000:2.0:1784047499.777197:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047499.777200:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784047499.777203:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709320064:0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.777312:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1784047499.777326:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709319808:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.777376:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709319808:12345-0@lo:38:kworker.0 Request processed in 49us (1812us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784047499.777392:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1784047499.777407:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1784047499.777411:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709320448:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784047499.777441:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709320448:12345-0@lo:38:kworker.0 Request processed in 28us (1715us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784047499.777447:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1784047499.777491:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709320576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047499.777525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.777557:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320576 00000100:00100000:1.0:1784047499.777561:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320576 00000100:00100000:1.0:1784047499.777600:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1784047499.777630:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709320576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047499.777654:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1784047499.777691:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709320576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047499.777698:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1784047499.777729:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709320576:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784047499.778260:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784047499.778471:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00080000:2.0:1784047499.778506:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784047499.778512:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709319808:0@lo:38:kworker.0 00000100:00080000:2.0:1784047499.778530:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047499.778542:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784047499.778546:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709320448:0@lo:38:kworker.0 00000040:00080000:0.0:1784047499.785090:0:92467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784047499.785602:0:92467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:0.0:1784047499.785823:0:92467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:1.0:1784047499.791354:0:92473:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:1.0:1784047499.791363:0:92473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784047499.796183:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047499.796198:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784047499.796241:0:92467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784047499.796266:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775249 00000100:00080000:0.0:1784047499.796277:0:92467:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047499.796284:0:92467:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccfe78d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047499.796322:0:92467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b94e00 x1870705709320704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047499.796346:0:92467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784047499.796418:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047499.796422:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.796424:0:92467:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784047499.796428:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784047499.796430:0:92467:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1784047499.796432:0:92467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047499.796434:0:92467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047499.796447:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784047499.796450:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.796452:0:92467:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784047499.796454:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784047499.796458:0:92467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784047499.796462:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047499.796463:0:92467:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784047499.796465:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784047499.796469:0:92467:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:0.0:1784047499.796492:0:92467:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784047499.796495:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784047499.796506:0:92467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ccc5e499c0) 00000020:00000080:0.0:1784047499.796522:0:92467:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1784047499.796528:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784047499.796602:0:92467:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784047499.796630:0:92467:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784047499.796638:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775257 00010000:00080000:0.0:1784047499.796666:0:92467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbcadfa000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1784047499.796822:0:92467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1784047499.796885:0:92467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784047499.796899:0:92467:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784047499.797753:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709320704:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784047499.797830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.798000:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320704 00000100:00100000:3.0:1784047499.798009:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320704 00000100:00100000:3.0:1784047499.798056:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988 00000100:00100000:3.0:1784047499.798064:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3644:x1870705709320704:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1784047499.798093:0:26182:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3598 last 0 00000020:00000080:3.0:1784047499.798118:0:26182:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77525e 00002000:00100000:3.0:1784047499.798132:0:26182:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ccd8416800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784047499.798137:0:26182:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784047499.798140:0:26182:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784047499.798212:0:26182:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784047499.798234:0:26182:0:(import.c:65:import_set_state_nolock()) ffff99ccec98c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047499.798292:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709320704:12345-0@lo:8:llog_process_th.0 Request processed in 226us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.798299:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988 00000100:00100000:1.0:1784047499.798640:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784047499.798649:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784047499.798667:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784047499.798672:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784047499.798675:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccfe78d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784047499.798693:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784047499.798699:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709320704:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1784047499.798860:0:92473:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784047499.798943:0:92473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3598051335923ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784047499.798950:0:92473:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784047499.799758:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047499.799782:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709320832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047499.799840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.800147:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320832 00000100:00100000:3.0:1784047499.800154:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320832 00000100:00100000:3.0:1784047499.800215:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1784047499.800224:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709320832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047499.800250:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047499.800308:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709320832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.800315:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1784047499.800362:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709320832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784047499.800998:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1784047499.801950:0:92454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1784047499.802689:0:92467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047499.803244:0:92467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:1.0:1784047499.803399:0:92467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:1.0:1784047499.804199:0:92475:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:1.0:1784047499.804204:0:92475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784047499.804853:0:92467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047499.804865:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784047499.805140:0:92467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784047499.805168:0:92467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775265 00000100:00080000:1.0:1784047499.805180:0:92467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784047499.805185:0:92467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbcadfa000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047499.805221:0:92467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edf800 x1870705709320960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047499.805252:0:92467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784047499.805310:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047499.805315:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.805317:0:92467:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784047499.805319:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047499.805323:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.805324:0:92467:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784047499.805326:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784047499.805328:0:92467:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784047499.805331:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047499.805333:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.805334:0:92467:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784047499.805342:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047499.805345:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.805346:0:92467:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784047499.805350:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784047499.805391:0:92467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92467:1870705709321088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047499.805464:0:92467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.805504:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321088 00000100:00100000:1.0:1784047499.805512:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321088 00000100:00100000:1.0:1784047499.805550:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784047499.805558:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:92467:x1870705709321088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047499.805681:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:92467:x1870705709321088:12345-0@lo:502:llog_process_th.0 Request processed in 123us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047499.805689:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784047499.805732:0:92467:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784047499.805751:0:92467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92467:1870705709321088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047499.806174:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709320960:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784047499.806211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.806293:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709320960 00000100:00100000:0.0:1784047499.806297:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709320960 00000100:00100000:0.0:1784047499.806324:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989 00000100:00100000:0.0:1784047499.806329:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3644:x1870705709320960:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784047499.806352:0:26193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3598 last 0 00000020:00000080:0.0:1784047499.806388:0:26193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c77526c 00002000:00100000:0.0:1784047499.806402:0:26193:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cbc7656800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784047499.806406:0:26193:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784047499.806409:0:26193:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784047499.806491:0:26193:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047499.806516:0:26193:0:(import.c:65:import_set_state_nolock()) ffff99cbc7656000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047499.806561:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709320960:12345-0@lo:8:llog_process_th.0 Request processed in 231us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.806568:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989 00000100:00100000:2.0:1784047499.806680:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047499.806687:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784047499.806694:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784047499.806699:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784047499.806702:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcadfa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784047499.806716:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784047499.806721:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709320960:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784047499.807167:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709321216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047499.807199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1784047499.807253:0:92467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047499.807261:0:92467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.807263:0:92467:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784047499.807268:0:92467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1784047499.807352:0:92453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1784047499.807394:0:92453:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784047499.807413:0:92453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047499.807425:0:92475:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1784047499.807427:0:92453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047499.807437:0:92453:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc832f800 from 1 10000000:01000000:3.0:1784047499.807441:0:92453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784047499.807469:0:92453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.807478:0:92453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047499.807484:0:92475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3598059876672ns, next at 0ns, rc = 0 00010000:00010000:3.0:1784047499.807488:0:92453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1784047499.807492:0:92475:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784047499.807509:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784047499.807543:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.807563:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321216 00000100:00100000:0.0:1784047499.807569:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321216 00000100:00100000:3.0:1784047499.807576:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9366a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047499.807596:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321344 00000100:00100000:3.0:1784047499.807601:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321344 00000100:00100000:0.0:1784047499.807640:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1784047499.807650:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709321216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047499.807671:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00002000:00000024:0.0:1784047499.807672:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047499.807682:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:92453:x1870705709321344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047499.807693:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047499.807706:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775273 expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.807728:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775273 expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.807740:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775273 expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.807750:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f800, rc 0) 00000100:00100000:3.0:1784047499.807799:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709321344:12345-0@lo:101:mount.lustre.0 Request processed in 119us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.807806:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784047499.808153:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047499.808166:0:92453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.808176:0:92453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.808477:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709321216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 829us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.808485:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00080000:0.0:1784047499.808518:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047499.808735:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709321216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047499.808802:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321472:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784047499.808846:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.808875:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784047499.809184:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321472 00000100:00100000:2.0:1784047499.809190:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321472 00000100:00100000:2.0:1784047499.809270:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784047499.809278:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709321472:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784047499.809296:0:92461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784047499.809319:0:92461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784047499.809323:0:92461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784047499.809326:0:92461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784047499.809328:0:92461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 124 00000100:00100000:2.0:1784047499.809439:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709321472:12345-0@lo:256:mount.lustre.0 Request processed in 161us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047499.809447:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784047499.809525:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321472:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784047499.811450:0:92453:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047499.811481:0:92453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.811494:0:92453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047499.811504:0:92453:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc832f800 from 1 10000000:01000000:1.0:1784047499.811507:0:92453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047499.811545:0:92453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.811555:0:92453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.811565:0:92453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047499.811589:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784047499.811685:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.811729:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784047499.812100:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321600 00000100:00100000:3.0:1784047499.812179:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321600 00000100:00100000:3.0:1784047499.812240:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784047499.812251:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:92453:x1870705709321600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047499.812278:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047499.812315:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd7ea00/0x4426598c0c775288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775281 expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.812344:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd7ea00/0x4426598c0c775288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775281 expref: 10 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.812356:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd7ea00/0x4426598c0c775288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775281 expref: 10 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047499.812390:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7ea00, rc 0) 00000100:00100000:3.0:1784047499.812469:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709321600:12345-0@lo:101:mount.lustre.0 Request processed in 219us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.812476:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1784047499.812502:0:92454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784047499.813224:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047499.813255:0:92453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047499.813265:0:92453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047499.813343:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047499.813395:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.813423:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.813496:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321728 00000100:00100000:0.0:1784047499.813502:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321728 00000100:00100000:0.0:1784047499.813546:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784047499.813555:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709321728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047499.813708:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709321728:12345-0@lo:501:mount.lustre.0 Request processed in 154us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.813718:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784047499.813923:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047499.813974:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047499.814015:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.814045:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784047499.814290:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321856 00000100:00100000:3.0:1784047499.814295:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321856 00000100:00100000:3.0:1784047499.814332:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784047499.814340:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709321856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047499.814461:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709321856:12345-0@lo:503:mount.lustre.0 Request processed in 121us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.814468:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784047499.814565:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709321856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047499.819338:0:92477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92477:1870705709321984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047499.819444:0:92477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.819495:0:92477:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047499.819722:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709321984 00000100:00100000:3.0:1784047499.819730:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709321984 00000100:00100000:3.0:1784047499.819790:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784047499.819801:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:92477:x1870705709321984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047499.821960:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:92477:x1870705709321984:12345-0@lo:502:llog_process_th.0 Request processed in 2148us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047499.821991:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784047499.822390:0:92477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92477:1870705709321984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047499.822433:0:92477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047499.822444:0:92477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047499.822447:0:92477:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784047499.822456:0:92477:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccc832f800 00000020:00000080:2.0:1784047499.822459:0:92477:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784047499.822467:0:92477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047499.822683:0:92477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047499.822686:0:92477:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784047499.822690:0:92477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047499.822693:0:92477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047499.822694:0:92477:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784047499.822698:0:92477:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccc832f800 00000020:00000080:2.0:1784047499.822701:0:92477:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784047499.822886:0:92477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92477:1870705709322112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047499.823126:0:92477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047499.823175:0:92477:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc276600 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.823930:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322112 00000100:00100000:0.0:1784047499.823940:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322112 00000100:00100000:0.0:1784047499.824011:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047499.824022:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92477:x1870705709322112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.824170:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92477:x1870705709322112:12345-0@lo:502:llog_process_th.0 Request processed in 148us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.824188:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784047499.824200:0:92477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92477:1870705709322112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047499.824239:0:92477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047499.824246:0:92477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047499.824248:0:92477:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784047499.824252:0:92477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784047499.824565:0:92453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784047499.824594:0:92453:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047499.824639:0:92453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.824651:0:92453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.824708:0:92453:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784047499.824712:0:92453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccc832f800 10000000:01000000:0.0:1784047499.824716:0:92453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccc832f800 10000000:01000000:0.0:1784047499.824721:0:92453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784047499.824728:0:92453:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc832f800 from 1 10000000:01000000:0.0:1784047499.824731:0:92453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047499.824762:0:92453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.824771:0:92453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.824781:0:92453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.824802:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709322240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047499.824846:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.824874:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc2bfa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.824891:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322240 00000100:00100000:0.0:1784047499.824895:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322240 00000100:00100000:0.0:1784047499.824931:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784047499.824938:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709322240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047499.824948:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047499.824962:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77528f expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.824985:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77528f expref: 11 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.824995:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77528f expref: 11 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.825003:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc600, rc 0) 00000100:00100000:0.0:1784047499.825035:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:92453:x1870705709322240:12345-0@lo:101:mount.lustre.0 Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.825042:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784047499.825077:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709322240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047499.825088:0:92453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.825096:0:92453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.825159:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709322368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047499.825186:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.825201:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc2bfa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.825215:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322368 00000100:00100000:0.0:1784047499.825218:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322368 00000100:00100000:0.0:1784047499.825252:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784047499.825259:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:92453:x1870705709322368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047499.825366:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:92453:x1870705709322368:12345-0@lo:501:mount.lustre.0 Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.825374:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784047499.825418:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709322368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047499.825449:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709322496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047499.825490:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.825507:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc2bfa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.825521:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322496 00000100:00100000:0.0:1784047499.825524:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322496 00000100:00100000:0.0:1784047499.825549:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784047499.825555:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:92453:x1870705709322496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047499.825656:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:92453:x1870705709322496:12345-0@lo:503:mount.lustre.0 Request processed in 100us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.825663:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784047499.825704:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709322496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047499.825897:0:92478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92478:1870705709322624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.825935:0:92478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.825954:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322624 00000100:00100000:0.0:1784047499.825958:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322624 00000100:00100000:0.0:1784047499.825981:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784047499.825987:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:92478:x1870705709322624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.826065:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:92478:x1870705709322624:12345-0@lo:502:llog_process_th.0 Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.826078:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784047499.826117:0:92478:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9343b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.826130:0:92478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92478:1870705709322624:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784047499.826182:0:92478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784047499.826198:0:92478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ccc5e4cd40) 00000020:00000080:0.0:1784047499.826222:0:92478:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784047499.831206:0:92478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccc832f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784047499.831217:0:92478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccc832f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784047499.831221:0:92478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc832f800 4 00010000:00080000:0.0:1784047499.831265:0:92478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccec807800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1784047499.835358:0:92478:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784047499.836322:0:92478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784047499.836388:0:92478:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784047499.836401:0:92478:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4426598c0c7752a4 00000100:00080000:0.0:1784047499.836414:0:92478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047499.836420:0:92478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccec807800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047499.836462:0:92478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9b96300 x1870705709322752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047499.836497:0:92478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784047499.836565:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709322752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784047499.836694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047499.836784:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322752 00000100:00100000:1.0:1784047499.836793:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322752 00000100:00100000:1.0:1784047499.836840:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1784047499.836849:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709322752:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047499.836912:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709322752:12345-0@lo:38:llog_process_th.0 Request processed in 62us (217us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784047499.836919:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1784047499.836973:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047499.836982:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec807800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047499.836987:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784047499.836991:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709322752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047499.837185:0:92478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92478:1870705709322880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.837234:0:92478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.837261:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709322880 00000100:00100000:0.0:1784047499.837265:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709322880 00000100:00100000:0.0:1784047499.837298:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784047499.837306:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:92478:x1870705709322880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.837427:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:92478:x1870705709322880:12345-0@lo:502:llog_process_th.0 Request processed in 121us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.837441:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784047499.837486:0:92478:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9343b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.837501:0:92478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92478:1870705709322880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.837537:0:92478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92478:1870705709323008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.837570:0:92478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.837590:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323008 00000100:00100000:0.0:1784047499.837594:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323008 00000100:00100000:0.0:1784047499.837658:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784047499.837667:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:92478:x1870705709323008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047499.837731:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+11:92478:x1870705709323008:12345-0@lo:502:llog_process_th.0 Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.837738:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784047499.837772:0:92478:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.837785:0:92478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:92478:1870705709323008:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784047499.837802:0:92478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784047499.837865:0:92453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784047499.837885:0:92453:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047499.837902:0:92453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.837913:0:92453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784047499.837962:0:92453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784047499.837964:0:92453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047499.837966:0:92453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047499.837970:0:92453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047499.837971:0:92453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047499.837972:0:92453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047499.837973:0:92453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047499.837975:0:92453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047499.837976:0:92453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047499.837978:0:92453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784047499.837982:0:92453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784047499.837984:0:92453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784047499.837986:0:92453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047499.837987:0:92453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047499.837988:0:92453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047499.837989:0:92453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047499.837989:0:92453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047499.837990:0:92453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047499.837991:0:92453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047499.837992:0:92453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047499.837993:0:92453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784047499.838005:0:92453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784047499.838014:0:92453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709323136:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784047499.838049:0:92453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.838066:0:92453:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.838087:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323136 00000100:00100000:0.0:1784047499.838090:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323136 00000100:00100000:0.0:1784047499.839228:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784047499.839239:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:92453:x1870705709323136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784047499.839265:0:92458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784047499.839279:0:92458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784047499.861732:0:92458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047499.861750:0:92458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784047499.861768:0:92463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784047499.861784:0:92463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784047499.861811:0:92463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.861832:0:92463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775273 expref: 11 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.861850:0:92463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.861895:0:92463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775273 expref: 11 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.861911:0:92463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775273 expref: 11 pid: 92458 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.861927:0:92463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92463:1870705709323264:0@lo:104: 00000100:00100000:0.0:1784047499.862013:0:92463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.862053:0:92463:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9343b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.862085:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323264 00000100:00100000:0.0:1784047499.862091:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323264 00000100:00100000:0.0:1784047499.862135:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1784047499.862144:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:92463:x1870705709323264:12345-0@lo:104: 00010000:00010000:0.0:1784047499.862157:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862208:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047499.862214:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:92463:x1870705709323264:12345-0@lo:104: Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.862221:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:0.0:1784047499.862243:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047499.862248:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862255:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fc00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047499.862264:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862273:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047499.862281:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047499.862286:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047499.862310:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862316:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047499.862335:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862343:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd7fc00/0x4426598c0c775273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77527a expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862358:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047499.862359:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047499.862361:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047499.862367:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047499.862389:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709323392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047499.862415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047499.862442:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323392 00000100:00100000:0.0:1784047499.862445:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323392 00010000:00010000:0.0:1784047499.862460:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775273 expref: 12 pid: 92458 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.862489:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1784047499.862495:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+12:3647:x1870705709323392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047499.862505:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047499.862510:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775273 expref: 12 pid: 92458 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862531:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775273 expref: 12 pid: 92458 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862547:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862555:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047499.862566:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012735071s 00010000:00010000:0.0:1784047499.862570:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862577:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862594:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862601:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862623:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbce00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047499.862632:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862640:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862649:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862658:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047499.862682:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+12:3647:x1870705709323392:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.862689:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00010000:00010000:0.0:1784047499.862730:0:92463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd7f800/0x4426598c0c77527a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775273 expref: 11 pid: 92458 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.862739:0:92463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92463:1870705709323264:0@lo:104: 00010000:00010000:0.0:1784047499.862754:0:92463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862762:0:92463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862768:0:92463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047499.862774:0:92463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbce00/0x4426598c0c7752ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047499.862791:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709323392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047499.866994:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:92453:x1870705709323136:12345-0@lo:253:mount.lustre.0 Request processed in 27740us (28926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.867012:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784047499.870925:0:92453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:92453:1870705709323136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784047499.871221:0:92453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784047499.871225:0:92453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784047499.871227:0:92453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784047499.871228:0:92453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784047499.871230:0:92453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784047499.871231:0:92453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784047499.871233:0:92453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784047499.871250:0:92453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784047499.871251:0:92453:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784047499.871253:0:92453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784047499.871255:0:92453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784047499.871277:0:92453:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1784047499.890940:0:92453:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411365 00000040:01000000:3.0:1784047499.891218:0:92453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784047499.891386:0:92485:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411365 00000020:00080000:2.0:1784047499.891391:0:92485:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411365 00000040:01000000:3.0:1784047499.891818:0:92486:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784047499.892098:0:92453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1784047499.892559:0:92487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92487:1870705709323520:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784047499.892658:0:92487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.892687:0:92487:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.892775:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323520 00000100:00100000:0.0:1784047499.892783:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323520 00000100:00100000:0.0:1784047499.892837:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:0.0:1784047499.892847:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92487:x1870705709323520:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047499.892927:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92487:x1870705709323520:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.892935:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000040:01000000:2.0:1784047499.893347:0:92453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784047499.893398:0:92453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784047499.893751:0:92487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92487:1870705709323520:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784047499.893784:0:92487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784047499.893815:0:92487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92487:1870705709323648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784047499.893852:0:92487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.893881:0:92487:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.893923:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323648 00000100:00100000:0.0:1784047499.893927:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323648 00000100:00100000:0.0:1784047499.893966:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:0.0:1784047499.893973:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92487:x1870705709323648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047499.894070:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92487:x1870705709323648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.894077:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000004:00000080:2.0:1784047499.894413:0:92453:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784047499.894423:0:92453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784047499.894471:0:92453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047499.898903:0:92453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1784047499.902568:0:92487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92487:1870705709323648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784047499.902710:0:92487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92487:1870705709323776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784047499.902773:0:92487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047499.902802:0:92487:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047499.902975:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323776 00000100:00100000:0.0:1784047499.902983:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323776 00000100:00100000:0.0:1784047499.903036:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1784047499.903046:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92487:x1870705709323776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047499.903125:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92487:x1870705709323776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047499.903134:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:3.0:1784047499.903717:0:92487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92487:1870705709323776:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784047499.903776:0:92487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784047499.905794:0:92487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784047499.905881:0:92487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1784047499.906199:0:92453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784047499.906262:0:92453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784047499.906465:0:92486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047499.908471:0:92486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784047499.908585:0:92486:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784047499.908591:0:92486:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1784047499.909229:0:92453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784047499.909999:0:92453:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00010000:00080000:2.0:1784047499.914562:0:92453:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116995 00010000:00080000:2.0:1784047499.915384:0:92488:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92488 00010000:02000000:2.0:1784047499.915399:0:92488:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1784047499.915402:0:92488:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784047499.915405:0:92488:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784047499.915497:0:92453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784047499.915514:0:92453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784047499.915536:0:92453:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784047499.915563:0:92453:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784047499.916451:0:92453:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047499.916725:0:92453:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784047499.998002:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047500.051513:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:1.0:1784047500.563989:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047501.010741:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047501.074743:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 10000000:01000000:0.0:1784047501.202922:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784047501.202932:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc832f800 from 125 10000000:01000000:0.0:1784047501.202939:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784047501.202998:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.203012:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.203024:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.203053:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709323904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.203128:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.203180:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9343240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047501.203462:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709323904 00000100:00100000:2.0:1784047501.203470:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709323904 00000100:00100000:2.0:1784047501.203526:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784047501.203536:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:6515:x1870705709323904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047501.203664:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047501.203680:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47000/0x4426598c0c7752b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7752b2 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.203705:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47000/0x4426598c0c7752b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7752b2 expref: 11 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.203717:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47000/0x4426598c0c7752b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752b2 expref: 11 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.203727:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47000, rc 0) 00000100:00100000:2.0:1784047501.203773:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709323904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047501.203781:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784047501.203893:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709323904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.203909:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.203919:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.203972:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.204005:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.204034:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047501.204441:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324032 00000100:00100000:2.0:1784047501.204448:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324032 00000100:00100000:2.0:1784047501.204566:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784047501.204575:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709324032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784047501.204591:0:92461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784047501.204633:0:92461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784047501.204636:0:92461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000100:00100000:2.0:1784047501.204731:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709324032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047501.204740:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784047501.205303:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784047501.205574:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784047501.205584:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.205918:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047501.205929:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047501.205932:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 52 10000000:01000000:3.0:1784047501.205935:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047501.205966:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.205974:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.205984:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047501.206003:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.214018:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.214074:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc935acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047501.214447:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324160 00000100:00100000:2.0:1784047501.214457:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324160 00000100:00100000:2.0:1784047501.214515:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784047501.214525:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709324160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047501.214566:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047501.214588:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7752c0 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.214639:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 12 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.214652:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 12 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.214662:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47e00, rc 0) 00000100:00100000:2.0:1784047501.214716:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709324160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047501.214724:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784047501.215185:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047501.215214:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.215226:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047501.215308:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.215342:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.215377:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc935acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.215445:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324288 00000100:00100000:0.0:1784047501.215451:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324288 00000100:00100000:0.0:1784047501.215487:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784047501.215495:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709324288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.215643:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709324288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.215652:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784047501.215771:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.215800:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.215838:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.215867:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc935acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.215920:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324416 00000100:00100000:1.0:1784047501.215925:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324416 00000100:00100000:1.0:1784047501.215957:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784047501.215965:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709324416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.216052:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709324416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.216060:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784047501.216136:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047501.217130:0:92548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047501.217640:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047501.217667:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047501.217679:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.217693:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.217725:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784047501.217729:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 122 10000000:01000000:1.0:1784047501.217731:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047501.217770:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.217778:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.217787:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.217808:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.217863:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.217899:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.218026:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324544 00000100:00100000:0.0:1784047501.218032:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324544 00000100:00100000:0.0:1784047501.218074:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784047501.218083:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709324544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.218094:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047501.218107:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c7752d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7752ce expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.218135:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c7752d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7752ce expref: 13 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.218146:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c7752d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752ce expref: 13 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.218154:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbcc00, rc 0) 00000100:00100000:0.0:1784047501.218189:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709324544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.218209:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784047501.218341:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.218366:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.218375:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.218423:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.218453:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.218473:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047501.219329:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324672 00000100:00100000:3.0:1784047501.219339:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324672 00000100:00100000:3.0:1784047501.219403:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784047501.219412:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709324672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047501.219432:0:92466:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784047501.219452:0:92466:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047501.219456:0:92466:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784047501.219458:0:92466:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784047501.219461:0:92466:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784047501.219463:0:92466:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 125 00000100:00100000:3.0:1784047501.219654:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709324672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 243us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047501.219662:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784047501.220086:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784047501.220165:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784047501.220178:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.220187:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.220210:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784047501.220213:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784047501.220216:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784047501.220240:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.220248:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.220256:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.220273:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.220305:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.220338:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.223448:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324800 00000100:00100000:0.0:1784047501.223461:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324800 00000100:00100000:0.0:1784047501.223527:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047501.223536:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709324800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.223552:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047501.223573:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7752dc expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.223602:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7752dc expref: 14 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.223654:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752dc expref: 14 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.223664:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc200, rc 0) 00000100:00100000:0.0:1784047501.223736:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709324800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (3431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.223743:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784047501.223961:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.223980:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.223990:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.224061:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.224104:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.224141:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.224197:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709324928 00000100:00100000:0.0:1784047501.224201:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709324928 00000100:00100000:0.0:1784047501.224233:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784047501.224240:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709324928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.224392:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709324928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.224400:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784047501.224464:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709324928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.224494:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.224536:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.224560:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc61c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.224603:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325056 00000100:00100000:0.0:1784047501.224629:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325056 00000100:00100000:0.0:1784047501.224653:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784047501.224659:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709325056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.227933:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709325056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3263us (3385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.227949:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784047501.228066:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784047501.228962:0:92549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1784047501.229145:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1784047501.229173:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784047501.229184:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229194:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.229204:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1784047501.229206:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc355c000 from 1 10000000:01000000:1.0:1784047501.229209:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784047501.229240:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229248:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229259:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.229282:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.229332:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.229380:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.229437:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325184 00000100:00100000:0.0:1784047501.229444:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325184 00000100:00100000:0.0:1784047501.229490:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784047501.229499:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709325184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.229512:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047501.229525:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7752f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7752ea expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.229548:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7752f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7752ea expref: 15 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.229560:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7752f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752ea expref: 15 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.229585:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc400, rc 0) 00000100:00100000:0.0:1784047501.229660:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709325184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.229667:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784047501.229747:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.229761:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229782:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.229798:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784047501.229801:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229808:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.229815:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784047501.229817:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc355c000 from 7 10000000:01000000:1.0:1784047501.229819:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047501.229834:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229840:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.229847:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.229860:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.229885:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.229910:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047501.230109:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325312 00000100:00100000:2.0:1784047501.230114:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325312 00000100:00100000:2.0:1784047501.230147:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784047501.230155:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709325312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047501.230163:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047501.230173:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46400/0x4426598c0c7752ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7752f8 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.230188:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46400/0x4426598c0c7752ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7752f8 expref: 16 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.230198:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46400/0x4426598c0c7752ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752f8 expref: 16 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.230204:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46400, rc 0) 00000100:00100000:2.0:1784047501.230242:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709325312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047501.230249:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784047501.230326:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.230337:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.230367:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.230416:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.230441:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.230463:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047501.230654:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325440 00000100:00100000:3.0:1784047501.230658:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325440 00000100:00100000:3.0:1784047501.230684:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784047501.230692:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709325440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.230812:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709325440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047501.230819:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784047501.230954:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.230983:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.231019:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.231046:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd0060bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.231094:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325568 00000100:00100000:0.0:1784047501.231098:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325568 00000100:00100000:0.0:1784047501.231128:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784047501.231134:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709325568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.231223:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709325568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.231229:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784047501.231431:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047501.234883:0:92550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784047501.235158:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784047501.235191:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047501.235202:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.235214:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047501.235225:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047501.235228:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 52 10000000:01000000:0.0:1784047501.235231:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047501.235265:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.235273:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.235302:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.235327:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.235404:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.235448:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047501.235518:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325696 00000100:00100000:2.0:1784047501.235525:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325696 00000100:00100000:2.0:1784047501.235574:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784047501.235586:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709325696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047501.235601:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047501.235637:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775306 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.235665:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775306 expref: 17 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.235678:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775306 expref: 17 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.235686:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46000, rc 0) 00000100:00100000:2.0:1784047501.235726:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709325696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047501.235734:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784047501.235840:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.235853:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.235862:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.235919:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.235944:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.235965:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.236100:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325824 00000100:00100000:1.0:1784047501.236104:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325824 00000100:00100000:1.0:1784047501.236169:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784047501.236177:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709325824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.236285:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709325824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.236292:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784047501.236361:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.236390:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.236429:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.241057:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047501.242583:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709325952 00000100:00100000:2.0:1784047501.242598:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709325952 00000100:00100000:1.0:1784047501.242782:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784047501.242796:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709325952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.242969:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709325952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (6539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.242986:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784047501.246164:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709325952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047501.246878:0:92551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784047501.246946:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784047501.246969:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047501.246989:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247000:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047501.247010:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784047501.247013:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1784047501.247016:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047501.247051:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247059:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247069:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.247091:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.247153:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.247188:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.247205:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326080 00000100:00100000:0.0:1784047501.247211:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326080 00000100:00100000:0.0:1784047501.247243:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784047501.247252:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709326080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.247265:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047501.247278:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775314 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247300:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775314 expref: 18 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247318:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775314 expref: 18 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247328:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd400, rc 0) 00000100:00100000:0.0:1784047501.247377:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709326080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.247384:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784047501.247423:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.247437:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.247446:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.247491:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.247514:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.247526:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.247537:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326208 00000100:00100000:0.0:1784047501.247540:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326208 00000100:00100000:0.0:1784047501.247556:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784047501.247562:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709326208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.247715:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709326208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.247723:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784047501.247750:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.247783:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.247817:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.247828:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.247839:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326336 00000100:00100000:0.0:1784047501.247842:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326336 00000100:00100000:0.0:1784047501.247857:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784047501.247863:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709326336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.254485:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709326336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6612us (6657us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.254500:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784047501.254637:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047501.255417:0:92552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1784047501.255711:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1784047501.255738:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784047501.255749:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.255761:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047501.255770:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784047501.255774:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccf756a000 from 7 10000000:01000000:0.0:1784047501.255776:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047501.255812:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.255822:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.255832:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.255870:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.255924:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.255954:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.256002:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326464 00000100:00100000:1.0:1784047501.256010:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326464 00000100:00100000:1.0:1784047501.256055:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784047501.256065:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709326464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.256079:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047501.256091:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9cf000/0x4426598c0c775329 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775322 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.256113:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9cf000/0x4426598c0c775329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775322 expref: 19 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.256124:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9cf000/0x4426598c0c775329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775322 expref: 19 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.256134:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf000, rc 0) 00000100:00100000:1.0:1784047501.256176:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709326464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.256183:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784047501.256376:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.256391:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.256401:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047501.256455:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.256479:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.256511:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.256550:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326592 00000100:00100000:1.0:1784047501.256554:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326592 00000100:00100000:1.0:1784047501.256584:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784047501.256591:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709326592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.256742:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709326592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.256763:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784047501.256850:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.256880:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.256917:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.256938:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.257705:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326720 00000100:00100000:1.0:1784047501.257712:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326720 00000100:00100000:1.0:1784047501.257754:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784047501.257761:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709326720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.257860:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709326720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.257868:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784047501.257955:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047501.260056:0:92553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784047501.260219:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784047501.260245:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784047501.260255:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.260284:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047501.260295:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047501.260298:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 52 10000000:01000000:2.0:1784047501.260301:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047501.260334:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.260342:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.260364:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047501.260389:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047501.260448:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047501.260491:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.260583:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326848 00000100:00100000:0.0:1784047501.260590:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326848 00000100:00100000:3.0:1784047501.260668:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784047501.260683:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709326848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047501.260697:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047501.260713:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775330 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.260738:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775330 expref: 20 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.260742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047501.260766:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689467904 00000100:00100000:1.0:1784047501.260771:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689467904 00010000:00010000:3.0:1784047501.260932:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775330 expref: 20 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.260945:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7fe00, rc 0) 00000100:00100000:3.0:1784047501.260993:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709326848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 315us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047501.262011:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047501.262033:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047501.262044:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047501.262112:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047501.262151:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047501.262182:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.263817:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709326976 00000100:00100000:0.0:1784047501.263827:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709326976 00000100:00100000:1.0:1784047501.263878:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:1.0:1784047501.263894:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689467904:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.263913:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047501.263934:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce800/0x4426598c0c77533e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3e1 expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.263964:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce800/0x4426598c0c77533e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3e1 expref: 10 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.263975:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce800/0x4426598c0c77533e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3e1 expref: 10 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.263986:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce800, rc 0) 00000100:00100000:3.0:1784047501.264004:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784047501.264059:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689467904:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 169us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.264066:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:0.0:1784047501.264792:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784047501.264802:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709326976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.264942:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709326976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.264957:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784047501.265035:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709326976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.265084:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.265131:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.265164:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047501.267270:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327104 00000100:00100000:3.0:1784047501.267284:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327104 00000100:00100000:3.0:1784047501.267333:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784047501.267344:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709327104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.267501:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709327104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047501.267510:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784047501.267698:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047501.268833:0:92555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784047501.272693:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784047501.272737:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047501.272750:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.272762:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.272772:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784047501.272774:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784047501.272777:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784047501.272815:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.272823:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.272833:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.272857:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.272935:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.272981:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090600 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.273052:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327232 00000100:00100000:0.0:1784047501.273060:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327232 00000100:00100000:0.0:1784047501.273120:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784047501.273129:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709327232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.273144:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047501.273158:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775345 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.273183:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775345 expref: 21 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.273194:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775345 expref: 21 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.273202:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbce00, rc 0) 00000100:00100000:0.0:1784047501.273243:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709327232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.273249:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784047501.274384:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.274404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.274415:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.274487:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.274523:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047501.274637:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327360 00000100:00100000:0.0:1784047501.274643:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327360 00000100:00100000:0.0:1784047501.274675:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784047501.274681:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709327360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047501.274808:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709327360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.274816:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784047501.274894:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090600 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.274907:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.274936:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.274972:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.274992:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090600 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.275006:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327488 00000100:00100000:1.0:1784047501.275010:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327488 00000100:00100000:1.0:1784047501.275030:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784047501.275036:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709327488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.277944:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709327488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2899us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.277958:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784047501.282754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047501.282823:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468032 00000100:00100000:3.0:1784047501.282834:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468032 00000100:00100000:3.0:1784047501.282909:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:3.0:1784047501.282920:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689468032:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047501.282947:0:92458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784047501.282970:0:92458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047501.282974:0:92458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784047501.282977:0:92458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784047501.282981:0:92458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784047501.282983:0:92458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 125 00000100:00100000:0.0:1784047501.283189:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047501.284911:0:92556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784047501.285016:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784047501.285045:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784047501.285057:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.285069:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047501.285079:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784047501.285082:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfe6b8800 from 7 10000000:01000000:3.0:1784047501.285085:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784047501.285136:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.285155:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.285167:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047501.285192:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.285544:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.285603:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00c5a540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047501.285720:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327616 00000100:00100000:0.0:1784047501.285728:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327616 00000100:00100000:0.0:1784047501.285781:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784047501.285792:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709327616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047501.285805:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047501.285817:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbda00/0x4426598c0c77535a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775353 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.285841:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbda00/0x4426598c0c77535a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775353 expref: 22 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.285852:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbda00/0x4426598c0c77535a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775353 expref: 22 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047501.285860:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbda00, rc 0) 00000100:00100000:0.0:1784047501.285907:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709327616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.285914:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784047501.285951:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047501.285966:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.285975:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047501.286034:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.286062:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.286083:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00c5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.286120:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327744 00000100:00100000:1.0:1784047501.286125:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327744 00000100:00100000:1.0:1784047501.286154:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784047501.286160:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709327744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.286795:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709327744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 634us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.286804:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784047501.286832:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.286878:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.286922:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.286955:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00c5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.287049:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709327872 00000100:00100000:1.0:1784047501.287053:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709327872 00000100:00100000:1.0:1784047501.287086:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784047501.287093:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709327872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.287172:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709327872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.287178:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784047501.289486:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689468032:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 6562us (6737us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.289498:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:3.0:1784047501.289575:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709327872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.296509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000040:00080000:0.0:1784047501.298640:0:92557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:3.0:1784047501.299938:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468160 00000100:00100000:3.0:1784047501.300043:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468160 00000100:00100000:3.0:1784047501.300091:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1357 00000100:00100000:3.0:1784047501.300100:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689468160:12345-192.168.204.40@tcp:38:ll_cfg_requeue.0 00000020:01000000:1.0:1784047501.300955:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784047501.301003:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784047501.301014:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.301027:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047501.301041:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784047501.301044:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ccc5e4b380 from 1 10000000:01000000:1.0:1784047501.301047:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00080000:3.0:1784047501.301071:0:68026:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '0c846d7a-6357-4e9c-a620-e35737ede709' at ffff99ccfe664800, cookie 0x4426598c0c775203 00010000:00080000:3.0:1784047501.301079:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp recovering/t0 exp ffff99ccfe664800 cur 3599 last 1784047499 00010000:00010000:1.0:1784047501.301084:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000400:3.0:1784047501.301088:0:68026:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1784047501.301093:0:68026:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00010000:00010000:1.0:1784047501.301104:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:3.0:1784047501.301119:0:68026:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00010000:1.0:1784047501.301311:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.301339:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709328000:0@lo:101:ll_cfg_requeue.0 00000100:00080000:3.0:1784047501.301400:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccd897e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047501.301481:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047501.301522:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047501.301539:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689468160:12345-192.168.204.40@tcp:38:ll_cfg_requeue.0 Request processed in 1438us (5041us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.301542:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328000 00000100:00100000:1.0:1784047501.301546:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328000 00000100:00100000:3.0:1784047501.301548:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1357 00000100:00100000:1.0:1784047501.302099:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784047501.302108:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709328000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047501.302135:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047501.302151:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccef9ce000/0x4426598c0c775368 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775361 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.302173:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccef9ce000/0x4426598c0c775368 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775361 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.302185:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccef9ce000/0x4426598c0c775368 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775361 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047501.302193:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce000, rc 0) 00000100:00100000:1.0:1784047501.302239:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709328000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047501.302245:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784047501.302789:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709328000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047501.302876:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.302886:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047501.302906:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784047501.302910:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.302917:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047501.302925:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784047501.302939:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:3.0:1784047501.302942:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784047501.303031:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.303039:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.303048:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047501.303065:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709328128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.303102:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.303128:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047501.303146:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328128 00000100:00100000:3.0:1784047501.303151:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328128 00000100:00100000:3.0:1784047501.303788:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784047501.303810:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709328128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047501.303824:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047501.303839:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77536f expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.303858:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77536f expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.303867:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77536f expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.303876:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7f800, rc 0) 00000100:00100000:3.0:1784047501.303914:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709328128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047501.303927:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784047501.305184:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709328128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047501.305461:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.305476:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047501.305736:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709328256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047501.305797:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047501.305909:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047501.306057:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328256 00000100:00100000:1.0:1784047501.306064:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328256 00000100:00100000:1.0:1784047501.306145:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784047501.306156:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709328256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047501.306276:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709328256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047501.306284:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784047501.306651:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709328256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784047501.306687:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784047501.306696:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047501.306706:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047501.313182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047501.313470:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468288 00000100:00100000:3.0:1784047501.313481:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468288 00000100:00100000:3.0:1784047501.313549:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1358 00000100:00100000:3.0:1784047501.313561:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689468288:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1784047501.313585:0:66219:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbc9edc700 x1870705689468288/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:632/0 lens 328/0 e 0 to 0 dl 1784047512 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047501.313649:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689468288:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 90us (478us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047501.313657:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1358 00010000:00080000:3.0:1784047501.320921:0:92488:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1784047501.587051:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047501.956996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047501.957073:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468416 00000100:00100000:0.0:1784047501.957083:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468416 00000100:00100000:0.0:1784047501.957166:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1332 00000100:00100000:0.0:1784047501.957178:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:2400:x1870705689468416:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047501.957275:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:2400:x1870705689468416:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 100us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047501.957284:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1332 00000100:00080000:1.0:1784047501.957397:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047502.035698:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047502.098694:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00100000:0.0:1784047502.613314:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047502.613354:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709328384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047502.613897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047502.614134:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328384 00000100:00100000:2.0:1784047502.614142:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328384 00000100:00100000:2.0:1784047502.614199:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1784047502.614212:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709328384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047502.614240:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047502.614289:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709328384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047502.614297:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00080000:2.0:1784047502.614317:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047502.614374:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709328384:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784047502.614418:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047502.620665:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047502.620691:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709328512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047502.620763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047502.621130:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328512 00000100:00100000:2.0:1784047502.621139:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328512 00000100:00100000:2.0:1784047502.622199:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1784047502.622213:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709328512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047502.622246:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047502.622314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709328512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047502.622321:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1784047502.622400:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709328512:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784047502.626153:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047503.058773:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047503.126690:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00010000:00010000:3.0:1784047503.642743:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047504.083883:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:0.0:1784047504.147409:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000001:02000400:1.0:1784047504.399834:0:92738:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784047504.663878:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047505.106668:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 0 seconds 00000100:00100000:2.0:1784047505.170929:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709328768:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1784047505.170943:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047505.170948:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047505.170951:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047505.170960:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047505.170986:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9edf480 x1870705709328896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047505.171012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047505.171028:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047505.171033:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047505.171035:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047505.171041:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047505.171054:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030d880 x1870705709329152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047505.171059:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047505.171069:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709328640:0@lo:400:kworker.0 00000100:00080000:1.0:1784047505.171088:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047505.171092:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047505.171094:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047505.171100:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047505.171114:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030c380 x1870705709329408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047505.171121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047505.171149:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047505.171153:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047505.171155:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047505.171160:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047505.171163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709329536:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.171173:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd0030d180 x1870705709329792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047505.171192:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047505.171201:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784047505.171205:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784047505.171207:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99ccec807800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784047505.171213:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1784047505.171213:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccec807800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047505.171223:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709329664:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.171230:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00fc0380 x1870705709330176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047505.171247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047505.171258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709329280:0@lo:400:kworker.0 00000100:00100000:2.0:1784047505.171293:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709328896:0@lo:38:kworker.0 00000100:00100000:1.0:1784047505.171309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.171330:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709329024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.171345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709330048:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.171379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047505.171411:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328640 00000100:00100000:1.0:1784047505.171425:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328640 00000100:00100000:1.0:1784047505.171483:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784047505.171492:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.171542:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709328640:12345-0@lo:400:kworker.0 Request processed in 50us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.171549:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784047505.171595:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329280 00000100:00100000:1.0:1784047505.171599:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329280 00000100:00100000:1.0:1784047505.171674:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1784047505.171835:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 0 seconds 00000100:00100000:2.0:1784047505.171950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.171974:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709329920:0@lo:400:kworker.0 00000100:00100000:2.0:1784047505.171997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.172026:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328768 00000100:00100000:2.0:1784047505.172030:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328768 00000100:00100000:2.0:1784047505.172058:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1784047505.172065:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709328768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047505.172095:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1784047505.172127:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709328768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.172134:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1784047505.172156:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329536 00000100:00100000:2.0:1784047505.172159:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329536 00000100:00100000:2.0:1784047505.172182:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329664 00000100:00100000:2.0:1784047505.172184:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329664 00000100:00100000:2.0:1784047505.172200:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330048 00000100:00100000:2.0:1784047505.172202:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330048 00000100:00100000:2.0:1784047505.172216:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329920 00000100:00100000:2.0:1784047505.172218:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329920 00000100:00100000:2.0:1784047505.172248:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1784047505.172254:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709329536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047505.172298:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709329536:12345-0@lo:400:kworker.0 Request processed in 45us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.172305:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1784047505.172316:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1784047505.172322:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709329664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047505.172352:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709329664:12345-0@lo:400:kworker.0 Request processed in 27us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.172352:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709329280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.172402:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709329280:12345-0@lo:400:kworker.0 Request processed in 722us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.172410:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1784047505.172423:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329024 00000100:00100000:1.0:1784047505.172426:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329024 00000100:00100000:1.0:1784047505.172452:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1784047505.172456:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709329024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.172499:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709329024:12345-0@lo:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.172505:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1784047505.172526:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1784047505.172533:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.172578:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709330048:12345-0@lo:400:kworker.0 Request processed in 45us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.172584:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1784047505.172598:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1784047505.172604:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.172666:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709329920:12345-0@lo:400:kworker.0 Request processed in 62us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.172672:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00080000:1.0:1784047505.172960:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047505.172965:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047505.172967:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047505.173009:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709329280:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.173022:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709330048:0@lo:400:kworker.0 00000100:00100000:3.0:1784047505.174173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047505.174222:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709329152:0@lo:38:kworker.0 00000100:00100000:3.0:1784047505.174270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047505.174309:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709329408:0@lo:38:kworker.0 00000100:00100000:3.0:1784047505.174642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047505.174664:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709329792:0@lo:38:kworker.0 00000100:00100000:3.0:1784047505.174690:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047505.174709:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709330176:0@lo:38:kworker.0 00000100:00100000:3.0:1784047505.174735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047505.174776:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709328896 00000100:00100000:3.0:1784047505.174783:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709328896 00000100:00100000:3.0:1784047505.175182:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329152 00000100:00100000:3.0:1784047505.175187:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329152 00000100:00100000:3.0:1784047505.175201:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329792 00000100:00100000:3.0:1784047505.175203:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329792 00000100:00100000:3.0:1784047505.175216:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330176 00000100:00100000:3.0:1784047505.175218:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330176 00000100:00100000:3.0:1784047505.175234:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1784047505.175244:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709328896:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784047505.175286:0:66220:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3603 last 0 00000020:00000080:3.0:1784047505.175642:0:66220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c77537d 00000004:00100000:3.0:1784047505.175660:0:66220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784047505.175798:0:66220:0:(import.c:65:import_set_state_nolock()) ffff99ccd897c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047505.175862:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709328896:12345-0@lo:38:kworker.0 Request processed in 618us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047505.175871:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1784047505.176124:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709329408 00000100:00100000:1.0:1784047505.176130:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709329408 00000100:00100000:1.0:1784047505.176162:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1784047505.176168:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709329408:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.176194:0:8441:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99ccfe667800, cookie 0x4426598c0c7751fc 00010000:00080000:1.0:1784047505.176198:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff99ccfe667800 cur 3603 last 1784047499 00000004:00100000:1.0:1784047505.176209:0:8441:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047505.176226:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccd0019800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047505.176269:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709329408:12345-0@lo:38:kworker.0 Request processed in 100us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.176287:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1784047505.176314:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1784047505.176320:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709329152:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.176335:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3603 last 0 00000020:00000080:1.0:1784047505.176366:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4426598c0c775384 00000004:00100000:1.0:1784047505.176373:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047505.176390:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccd001c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047505.176436:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870705709329152:12345-0@lo:38:kworker.0 Request processed in 114us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.176444:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1784047505.176462:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1784047505.176467:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709329792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.176483:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3603 last 0 00000020:00000080:1.0:1784047505.176508:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4426598c0c77538b 00000004:00100000:1.0:1784047505.176515:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047505.176531:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047505.176561:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870705709329792:12345-0@lo:38:kworker.0 Request processed in 92us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.176567:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1784047505.176580:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1784047505.176585:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709330176:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.176598:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3603 last 0 00000020:00000080:1.0:1784047505.176641:0:66221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4426598c0c775392 00000004:00100000:1.0:1784047505.176648:0:66221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784047505.176662:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccc5024800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047505.176692:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709330176:12345-0@lo:38:kworker.0 Request processed in 105us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.176697:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00010000:00080000:1.0:1784047505.176738:0:92488:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784047505.176743:0:92488:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 115964116996 00000020:00080000:1.0:1784047505.176748:0:92488:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047505.176751:0:92488:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116996 00000020:00080000:1.0:1784047505.176755:0:92488:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784047505.176763:0:92488:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116996 00000100:00100000:1.0:1784047505.176831:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709329664:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.176846:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709329536:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.176855:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709328640:0@lo:400:kworker.0 00000100:00100000:1.0:1784047505.176875:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709328768:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1784047505.176913:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9edf480 x1870705709328896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.176925:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:2.0:1784047505.176991:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1784047505.177050:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709329024:0@lo:400:kworker.0 00000100:00100000:2.0:1784047505.177064:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709329920:0@lo:400:kworker.0 00000100:00080000:1.0:1784047505.177986:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99cbc9edf480 x1870705709328896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047530 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.177996:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784047505.178001:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784047505.178005:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784047505.178012:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709328896:0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.178038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cd0030d880 x1870705709329152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.178051:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:1.0:1784047505.178852:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99cd0030d880 x1870705709329152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047530 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.178862:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784047505.178867:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784047505.178871:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784047505.178876:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709329152:0@lo:38:kworker.0 00000100:00080000:1.0:1784047505.178907:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:1.0:1784047505.178916:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1784047505.178920:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1784047505.178922:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000100:00080000:1.0:1784047505.178926:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc6531800 from lustre-MDT0000_UUID committed 115964116995 last 0 00000100:00080000:1.0:1784047505.178929:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1784047505.179552:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709329408:0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.179575:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cd0030d180 x1870705709329792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.179588:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:1.0:1784047505.180584:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99cd0030d180 x1870705709329792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047530 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.180646:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784047505.180651:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784047505.180655:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784047505.180662:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ef4bd063): req@ffff99cbc9c3e300 x1870705709313536/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047505.180695:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709329792:0@lo:38:kworker.0 00010000:00080000:1.0:1784047505.180724:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cd00fc0380 x1870705709330176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.180738:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:1.0:1784047505.180745:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784047505.180749:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784047505.180751:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec807800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784047505.180763:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709330176:0@lo:38:kworker.0 00000100:00100000:1.0:1784047505.181093:0:66229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047505.181121:0:66229:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d180 going to sleep for 11 seconds 00000100:00100000:1.0:1784047505.181164:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709313536 00000100:00100000:1.0:1784047505.181170:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709313536 00000100:00100000:1.0:1784047505.181211:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784047505.181220:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66229:x1870705709313536:12345-0@lo:700:mdt_seqm_0001.0 00010000:00080000:1.0:1784047505.181236:0:66226:0:(ldlm_lib.c:3211:target_queue_recovery_request()) @@@ not queueing req@ffff99cd00fc0380 x1870705709313536/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:636/0 lens 264/0 e 0 to 0 dl 1784047516 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784047505.182566:0:92777:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784047505.182573:0:92777:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784047505.182579:0:92777:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1784047505.183344:0:92777:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1784047505.183403:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709330304:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784047505.183465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.183648:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330304 00000100:00100000:2.0:1784047505.183656:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330304 00000100:00100000:2.0:1784047505.183731:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:2.0:1784047505.183742:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709330304:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784047505.183762:0:23872:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99ccfa3eb100 x1870705709330304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:636/0 lens 224/0 e 0 to 0 dl 1784047516 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047505.183779:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709330304:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 40us (313us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047505.183786:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000020:00080000:3.0:1784047505.184460:0:92488:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047505.184466:0:92488:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116996 00010000:00080000:3.0:1784047505.184469:0:92488:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1784047505.184472:0:92488:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784047505.184480:0:92488:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784047505.184482:0:92488:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784047505.184496:0:92488:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbc9edc700 x1870705689468288/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:632/0 lens 328/0 e 0 to 0 dl 1784047512 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784047505.184517:0:92488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047505.184552:0:92488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae39b expref: -99 pid: 92488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.184579:0:92488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 92488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.184636:0:92488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 92488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.184647:0:92488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd7fc00, rc 0) 00010000:00080000:3.0:1784047505.184731:0:92488:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1784047505.184744:0:92488:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 40000000:02000000:0.0:1784047505.187136:0:66226:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:1.0:1784047505.189663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047505.189723:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468544 00000100:00100000:3.0:1784047505.189734:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468544 00000100:00100000:3.0:1784047505.189876:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1335 00000100:00100000:3.0:1784047505.189961:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2398:x1870705689468544:12345-192.168.204.40@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1784047505.189985:0:66221:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cd00fc3480 x1870705689468544/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:636/0 lens 224/0 e 0 to 0 dl 1784047516 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047505.190011:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2398:x1870705689468544:12345-192.168.204.40@tcp:400:ptlrpcd_rcv.0 Request processed in 126us (359us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047505.190020:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1335 00010000:00080000:1.0:1784047505.190041:0:92488:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1784047505.190157:0:92488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000100:00100000:0.0:1784047505.200499:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66229:x1870705709313536:12345-0@lo:700:mdt_seqm_0001.0 Request processed in 19269us (19395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047505.200521:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784047505.200591:0:66229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-lwp-MDT0001_UUID:66229:1870705709313536:0@lo:700:mdt_seqm_0001.0 40000000:02000000:0.0:1784047505.200629:0:66229:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:3.0:1784047505.208736:0:92454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00100000:3.0:1784047505.208750:0:92454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784047505.208797:0:92488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1784047505.208844:0:92488:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1784047505.208859:0:92488:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99ccfa3eb100 x1870705709330304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:636/0 lens 224/0 e 0 to 0 dl 1784047516 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784047505.208986:0:92488:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.40@tcp: req@ffff99cd00fc3480 x1870705689468544/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:636/0 lens 224/0 e 0 to 0 dl 1784047516 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.209011:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784047505.209023:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99ccfa3eaa00 x1870705709330304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047521 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.209034:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99ccfa3eaa00 x1870705709330304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047521 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047505.209042:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:02000000:3.0:1784047505.209044:0:92488:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:02000000:1.0:1784047505.209058:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784047505.209064:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4ec6bce): req@ffff99ccff10dc00 x1870705709310592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047505.209087:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709330304:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784047505.209160:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047505.209173:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709330432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047505.209212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047505.209261:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330432 00000100:00100000:1.0:1784047505.209268:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330432 00000100:00100000:1.0:1784047505.209324:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1784047505.209334:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709330432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047505.210814:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444986880 avail 1298747392 00000100:00100000:1.0:1784047505.210905:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709330432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1569us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.210915:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1784047505.210981:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709330432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047505.213872:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047505.215395:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047505.217689:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709310592 00000100:00100000:1.0:1784047505.217706:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709310592 00000100:00100000:1.0:1784047505.218796:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:1.0:1784047505.218810:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75668:x1870705709310592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784047505.219415:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75668:x1870705709310592:12345-0@lo:1000:osp_up0-1.0 Request processed in 605us (5546us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1784047505.219424:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1784047505.221626:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709310592:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784047505.222818:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689462144:12345-192.168.204.40@tcp:700:cp.0 Request processed in 18565450us (18565687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047505.222831:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000001:00100000:0.0:1784047505.225060:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784047505.226373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047505.226438:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468800 00000100:00100000:2.0:1784047505.226448:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468800 00000100:00100000:2.0:1784047505.226519:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1363 00000100:00100000:2.0:1784047505.226528:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689468800:12345-192.168.204.40@tcp:101:cp.0 00000100:00080000:1.0:1784047505.226655:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784047505.226720:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047505.226741:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7753a0 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3e8 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.226829:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.226838:0:67153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.226847:0:67153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047505.226867:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709330560:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784047505.226920:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.227035:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047505.232258:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330560 00000100:00100000:1.0:1784047505.232287:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330560 00000100:00100000:1.0:1784047505.232404:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1784047505.232417:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:67153:x1870705709330560:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784047505.232444:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047505.232469:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7753ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c7753a7 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.232509:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7753ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7753a7 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.232543:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7753ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7753a7 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.232553:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047505.232556:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784047505.232560:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf600, rc 0) 00000100:00100000:1.0:1784047505.232654:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67153:x1870705709330560:12345-0@lo:101:mdt00_003.0 Request processed in 239us (5731us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.232661:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:2.0:1784047505.235808:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709330560:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784047505.235840:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c7753ae expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.235853:0:67153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c7753ae expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047505.235879:0:67153:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784047505.235886:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c7753ae expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.235894:0:67153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c7753ae expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.235977:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.235987:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.235999:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.236013:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.236020:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.236027:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047505.236179:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709330688:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047505.236239:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.236268:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dc900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047505.236301:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330688 00000100:00100000:2.0:1784047505.236307:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330688 00000100:00100000:2.0:1784047505.236355:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1784047505.237015:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67153:x1870705709330688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047505.237124:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67153:x1870705709330688:12345-0@lo:1000:mdt00_003.0 Request processed in 280us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.237133:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1784047505.237195:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709330688:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1784047505.239160:0:67153:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x89:0x0], count =409 00000004:00080000:2.0:1784047505.239173:0:67153:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x89:0x0]+409 in llog 00000004:00080000:2.0:1784047505.239191:0:67153:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x222:0x0], index 0: 0 00010000:00010000:2.0:1784047505.239412:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7753c3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.239433:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7753c3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.239446:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7753c3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240885:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240900:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240907:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240914:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240921:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047505.240925:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240933:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240963:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:2.0:1784047505.240966:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047505.240972:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.240979:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47a00/0x4426598c0c7753b5 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047505.240995:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005776dfbc reply state 00000000c999daff transno 77309411445 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.241007:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.241015:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff99ccd8400400) 00010000:00010000:2.0:1784047505.241017:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047505.241020:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047505.241073:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7753a0 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3e8 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.241091:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7753c3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3e8 expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.241098:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99ccd8400c00) 00010000:00010000:2.0:1784047505.241101:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047505.241103:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46a00, rc 0) 00000100:00100000:2.0:1784047505.241183:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:71053:x1870705689468800:12345-192.168.204.40@tcp:101:cp.0 Request processed in 14655us (14822us total) trans 77309411445 rc 0/0 00000100:00100000:2.0:1784047505.241193:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1363 00000004:00000080:3.0:1784047505.244463:0:92488:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc9141fb7e10 00100000:10000000:3.0:1784047505.244477:0:92488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1784047505.247999:0:92476:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x723:0x0] 00000100:00100000:1.0:1784047505.248052:0:92476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92476:1870705709330816:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784047505.248120:0:92476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784047505.248126:0:92474:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x722:0x0] 00000100:00100000:1.0:1784047505.248151:0:92476:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00288240 going to sleep for 11 seconds 00000100:00100000:0.0:1784047505.248155:0:92474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92474:1870705709330944:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784047505.248177:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330816 00000100:00100000:1.0:1784047505.248183:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330816 00000100:00100000:0.0:1784047505.248197:0:92474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047505.248235:0:92474:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd211e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047505.248643:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709330944 00000100:00100000:1.0:1784047505.248649:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709330944 00000100:00100000:1.0:1784047505.248678:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4990 00000100:00100000:1.0:1784047505.248687:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:92476:x1870705709330816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784047505.248715:0:26196:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -62 00002000:02000040:1.0:1784047505.248720:0:26196:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1828 to 0x2c0000401:1889) 00000100:00100000:3.0:1784047505.250818:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991 00000100:00100000:3.0:1784047505.250841:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:92474:x1870705709330944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784047505.250877:0:26183:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -63 00002000:02000040:3.0:1784047505.250883:0:26183:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1827 to 0x280000401:1889) 00000100:00100000:0.0:1784047505.254490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047505.254906:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689468928 00000100:00100000:2.0:1784047505.254917:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689468928 00000100:00100000:2.0:1784047505.254962:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4992 00000100:00100000:2.0:1784047505.254971:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2398:x1870705689468928:12345-192.168.204.40@tcp:8:cp.0 00010000:00080000:2.0:1784047505.255008:0:26180:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3603 last 0 00000020:00000080:2.0:1784047505.255152:0:26180:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c7753d1 00002000:00100000:2.0:1784047505.255164:0:26180:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccfddd5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784047505.255181:0:26180:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784047505.255253:0:26180:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784047505.255293:0:26180:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784047505.255355:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689468928:12345-192.168.204.40@tcp:8:cp.0 Request processed in 384us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.255363:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4992 00000001:00100000:2.0:1784047505.264921:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00100000:2.0:1784047505.264932:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1784047505.265053:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.265063:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265080:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.265094:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047505.265100:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265117:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265128:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265136:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265195:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047505.265446:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.265452:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265460:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.265463:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047505.265466:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265474:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265598:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265643:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.265692:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047505.265700:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.265708:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbfe00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.265714:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.265724:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265806:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.265817:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.265822:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265830:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.265833:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265841:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265860:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.265868:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007abcefcd/0x4426598c0c7753df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.265980:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.265988:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61904ba/0x4426598c0c7753d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.266003:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.266005:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.266007:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.266035:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.266037:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.266039:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047505.266413:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.266421:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266432:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.266435:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.266440:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266451:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266460:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266468:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266490:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047505.266543:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.266549:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266557:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.266560:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.266564:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266580:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266587:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266594:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266623:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784047505.266649:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047505.266655:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.266663:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd600 already unused, calling callback (ffffffffc0e4a230) 00002000:00010000:0.0:1784047505.266667:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047505.266668:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266676:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.266682:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.266694:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.266701:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc97306/0x4426598c0c7753e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266759:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.266762:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.266766:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266774:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266783:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266800:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266814:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784047505.266854:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.266860:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266868:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.266871:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.266875:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266884:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266891:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266898:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266910:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784047505.266942:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.266947:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266960:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.266963:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.266966:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266975:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266984:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.266991:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267005:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784047505.267046:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267051:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267058:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267061:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.267065:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267073:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267092:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267099:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267107:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1784047505.267133:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784047505.267140:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.267141:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267151:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.267153:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.267159:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267165:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267172:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.267176:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267178:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267201:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267210:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267217:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267236:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1784047505.267288:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267293:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267301:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267304:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.267308:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267316:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267324:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267331:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267339:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784047505.267373:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267377:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267384:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267393:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.267397:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267406:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267414:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267421:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267428:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1784047505.267468:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267472:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267480:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267483:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.267487:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267495:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267503:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267516:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267526:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1784047505.267843:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.267843:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267854:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.267858:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db4bf80f/0x4426598c0c7753ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267871:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267876:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.267881:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267891:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267899:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267907:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267917:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1784047505.267955:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.267961:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.267989:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.267992:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.267996:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268006:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268014:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268022:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268031:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1784047505.268073:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.268079:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268086:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.268088:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.268092:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268100:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268119:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268126:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268135:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1784047505.268168:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.268173:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268180:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.268183:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.268187:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268196:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268204:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268212:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268230:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1784047505.268266:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.268271:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268290:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.268294:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.268298:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268307:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268314:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268321:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268329:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:2.0:1784047505.268431:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1784047505.268437:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.268445:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbc000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.268449:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.268467:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.268481:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.268783:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.268790:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268797:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.268805:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.268810:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268820:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268828:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268835:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268844:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1784047505.268884:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.268888:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268896:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.268899:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.268903:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268911:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268919:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268930:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268939:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1784047505.268967:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.268971:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268979:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.268982:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.268985:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.268994:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269001:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269009:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269019:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1784047505.269045:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269051:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269063:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:2.0:1784047505.269067:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001664981c/0x4426598c0c7753f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269067:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269074:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269091:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269097:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1784047505.269099:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269103:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269113:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269119:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24bc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.269126:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269128:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:2.0:1784047505.269139:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269154:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269161:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c512cfe/0x4426598c0c7753fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.269164:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269171:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269185:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.269190:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269193:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269198:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1784047505.269205:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269205:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269225:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ba00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.269229:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269246:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269248:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269266:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269281:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269289:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:2.0:1784047505.269293:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d4fbe8f/0x4426598c0c775402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269310:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1784047505.269314:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.269325:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269330:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269338:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.269341:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269345:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269354:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269374:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269382:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269400:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1784047505.269431:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269436:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269444:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.269446:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269450:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269459:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269466:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269475:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269494:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1784047505.269521:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269525:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269767:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.269777:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269783:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269792:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269799:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269807:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.269825:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.269828:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1784047505.269870:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269874:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269882:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.269884:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269888:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269896:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269904:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269917:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269926:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1784047505.269962:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.269966:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269974:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.269976:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.269980:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269988:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.269995:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270002:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270010:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:2.0:1784047505.270035:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.270044:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.270050:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270059:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270076:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.270081:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.270083:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270086:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270102:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026fadd67/0x4426598c0c775409 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270107:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270120:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270126:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270127:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:2.0:1784047505.270134:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270138:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:2.0:1784047505.270146:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.270150:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270157:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270168:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270175:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a17c67/0x4426598c0c775410 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047505.270182:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.270189:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270203:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.270206:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.270210:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270211:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:2.0:1784047505.270218:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270222:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270227:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.270233:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270249:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270254:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270261:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270263:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270289:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d122254d/0x4426598c0c775417 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270304:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1784047505.270308:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270314:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.270523:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1784047505.270580:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.270586:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270595:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.270598:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.270601:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270631:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270640:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270647:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270696:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1784047505.270702:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270709:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.270713:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270722:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270734:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270742:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd9dc9c/0x4426598c0c775425 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270757:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1784047505.270761:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270768:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.270771:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270789:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270800:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270830:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270850:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270861:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270868:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf3a8d8e/0x4426598c0c77541e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.270882:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1784047505.270887:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000259199a2/0x4426598c0c77542c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270908:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1784047505.270913:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270919:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.270922:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270929:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270938:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270944:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba49776d/0x4426598c0c77543a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270968:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1784047505.270971:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270977:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.270980:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270988:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.270998:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271005:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000312cf760/0x4426598c0c775441 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271018:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1784047505.271022:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271028:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271031:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271052:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271064:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271071:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926aeab3/0x4426598c0c775448 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271084:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1784047505.271088:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271094:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24aa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271097:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271103:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271112:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271119:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712ae91d/0x4426598c0c77544f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271143:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1784047505.271146:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271151:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271155:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271161:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271170:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271176:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c53927c/0x4426598c0c775456 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271188:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1784047505.271191:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271197:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ae00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271200:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271220:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271230:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271238:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38d8fcc/0x4426598c0c77545d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271252:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1784047505.271256:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271262:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271265:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271282:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271294:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271302:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554b5804/0x4426598c0c775464 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271327:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1784047505.271330:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271336:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271340:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271347:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271395:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271402:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.271406:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271414:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271426:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271434:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a18406/0x4426598c0c775433 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271452:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271460:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1784047505.271463:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df31e82c/0x4426598c0c77546b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271466:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271481:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.271484:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271491:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271514:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784047505.271516:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271519:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271534:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4f1366/0x4426598c0c775472 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271549:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784047505.271554:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271560:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.271564:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271583:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271594:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271630:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.271635:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e4c078/0x4426598c0c775480 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271637:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271661:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784047505.271668:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271671:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271681:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.271686:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271691:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271696:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271703:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244f5337/0x4426598c0c775479 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271714:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.271723:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de7c2d8/0x4426598c0c775487 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271724:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784047505.271731:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271738:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271741:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271748:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271758:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271765:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a66e24/0x4426598c0c77548e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271789:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047505.271793:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271799:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271801:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271809:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271820:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271826:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a9317aa/0x4426598c0c775495 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271837:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047505.271840:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271846:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.271849:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271866:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271877:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271884:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3c3637d/0x4426598c0c77549c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.271896:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.271898:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.271900:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.271911:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.271918:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.271938:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.271955:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047505.272034:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.272039:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272049:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.272052:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.272057:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272067:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272082:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272089:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272102:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784047505.272109:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047505.272113:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272119:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.272122:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272129:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272140:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272146:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a983f6/0x4426598c0c7754a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272159:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047505.272168:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272175:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.272178:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272186:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272197:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272204:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000471bb6f6/0x4426598c0c7754aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272215:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.272217:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.272219:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.272224:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.272257:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.272259:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.272262:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047505.272269:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.272776:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272785:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:0.0:1784047505.272788:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.272792:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272813:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272823:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272830:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272845:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047505.272853:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047505.272856:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272863:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.272866:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272874:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272885:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272892:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000478592c1/0x4426598c0c7754b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.272911:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.272913:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.272915:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784047505.273184:0:26196:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1827 00000100:00100000:0.0:1784047505.273294:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:92476:x1870705709330816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24604us (25170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047505.273303:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4990 00000100:00100000:2.0:1784047505.273549:0:92476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92476:1870705709330816:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784047505.273567:0:92476:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x723:0x0] 00000100:00100000:0.0:1784047505.273654:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709331072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047505.273674:0:92476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92476:1870705709331200:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784047505.273706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047505.273717:0:92476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047505.273752:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709331072 00000100:00100000:0.0:1784047505.273759:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709331072 00000100:00100000:0.0:1784047505.273798:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1784047505.273808:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709331072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047505.273832:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047505.273869:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709331072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047505.273876:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1784047505.273912:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709331072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047505.274467:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709331200 00000100:00100000:2.0:1784047505.274473:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709331200 00000100:00100000:2.0:1784047505.274514:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4993 00000100:00100000:2.0:1784047505.274521:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:92476:x1870705709331200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784047505.274551:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00000001:00100000:1.0:1784047505.278000:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784047505.278032:0:92476:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1784047505.279511:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:92476:x1870705709331200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4977us (5780us total) trans 4294968754 rc 0/0 00000100:00100000:2.0:1784047505.279524:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4993 00000100:00100000:1.0:1784047505.279911:0:92476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92476:1870705709331200:0@lo:5:osp-pre-1-0.0 00002000:00010000:3.0:1784047505.279926:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1784047505.279929:0:92476:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00010000:00010000:3.0:1784047505.279938:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.279957:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.279962:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.279968:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.279985:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.279996:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280004:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280031:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.280093:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.280101:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280111:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.280116:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.280121:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.280129:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280130:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280147:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.280149:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280151:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.280159:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280163:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8a9a88a/0x4426598c0c7754b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280179:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280188:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280189:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.280192:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.280195:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.280201:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280225:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.280257:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.280263:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.280267:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.280288:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280310:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.280311:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047505.280317:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.280322:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280327:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280333:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280340:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280353:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280363:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e98903e9/0x4426598c0c7754bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280368:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280377:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.280379:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280381:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.280384:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.280400:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.280409:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.280415:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280423:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7fa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.280427:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280434:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.280444:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.280451:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280453:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280471:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.280472:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000204d58cd/0x4426598c0c7754c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280480:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.280488:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280493:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.280497:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280504:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.280510:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280564:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.280568:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280576:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.280579:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280585:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280596:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.280603:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.280619:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.281021:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.281033:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784047505.281039:0:26183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c49d997/0x4426598c0c7754cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.281086:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047505.281104:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.281111:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281119:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.281122:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.281126:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281135:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281143:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281150:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281168:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.281192:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.281199:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.281209:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.281219:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047505.281220:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.281225:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.281247:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281250:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.281258:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.281265:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.281267:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281290:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281297:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281303:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.281325:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047505.281401:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.281408:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.281416:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ec00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.281419:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.281439:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.281452:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.281460:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000627ff1f1/0x4426598c0c7754db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.281476:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.281478:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.281480:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.281575:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33afbf3/0x4426598c0c7754d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.281591:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.281593:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.281595:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047505.281835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047505.281996:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689469056 00000100:00100000:2.0:1784047505.282005:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689469056 00000100:00100000:2.0:1784047505.282094:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4994 00000100:00100000:2.0:1784047505.282105:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:0:x1870705689469056:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:2.0:1784047505.282122:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047505.282137:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3ef expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047505.282156:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047505.282172:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:2.0:1784047505.282177:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.282184:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 6 pid: 26186 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.282212:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 6 pid: 26186 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.282223:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46600, rc 0) 00000100:00100000:2.0:1784047505.282290:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+6:0:x1870705689469056:12345-192.168.204.40@tcp:101:cp.0 Request processed in 187us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.282297:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4994 00000100:00080000:1.0:1784047505.282454:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1784047505.282946:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.282953:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283033:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.283038:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.283043:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283066:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283091:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283099:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283122:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.283201:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.283207:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283215:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.283218:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.283222:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.283225:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.283235:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283236:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.283250:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7ee00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.283254:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283282:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283291:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283328:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.283383:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.283388:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283396:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.283399:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.283404:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283413:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283421:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.283428:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047505.283429:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.283436:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.283446:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047505.283450:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047505.283451:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283463:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.283463:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283471:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283481:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.283483:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283494:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283504:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.283506:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c7754f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283522:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.283530:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c7754f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.284029:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.284050:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.284061:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942e4f05/0x4426598c0c7754e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284464:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.284467:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.284469:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.284481:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.284484:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.284486:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047505.284545:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.284551:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284568:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.284572:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.284576:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284588:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284620:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284628:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284643:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.284678:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.284683:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284685:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.284693:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284694:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.284703:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.284712:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047505.284713:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284718:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284725:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284733:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284742:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284742:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284776:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284785:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c7754fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284789:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047505.284804:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.284808:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284815:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.284826:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284834:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284844:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284852:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775505 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.284867:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.284870:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.284872:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047505.284905:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.284911:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284918:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.284921:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.284924:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284931:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284938:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284945:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.284961:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047505.285013:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.285019:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.285026:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.285032:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.285040:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.285052:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.285067:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c77550c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.285083:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.285085:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.285087:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047505.285147:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.285153:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285161:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.285170:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.285175:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285185:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285193:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285200:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285222:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.285346:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.285352:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285474:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.285477:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.285480:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285489:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285496:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285508:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285519:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047505.285554:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.285559:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285566:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.285569:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.285573:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285582:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285590:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285598:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285624:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784047505.285659:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.285664:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285677:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.285680:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.285684:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285693:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285700:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285707:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285714:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784047505.285750:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.285755:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285762:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.285765:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.285769:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285777:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285796:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285803:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285845:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047505.285851:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285859:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.285863:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285870:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285880:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784047505.285886:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285894:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56f581d/0x4426598c0c775513 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285922:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00010000:3.0:1784047505.285924:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.285926:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285933:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285937:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.285943:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.285948:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.285956:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047505.285958:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285971:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285978:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f055de1d/0x4426598c0c77551a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285990:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047505.285992:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.285998:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.286001:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286019:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286029:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286030:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286043:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e683c437/0x4426598c0c775521 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286051:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286059:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047505.286064:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286071:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.286073:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286081:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286090:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286098:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d970bd2e/0x4426598c0c775528 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286121:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.286127:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286134:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286136:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.286142:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286150:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286170:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286193:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.286231:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.286236:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286245:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.286333:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.286338:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286349:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286357:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286368:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c7d0c8/0x4426598c0c77552f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286382:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.286385:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286391:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.286394:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286411:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286421:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286427:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081045561/0x4426598c0c775536 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286437:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.286439:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.286440:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.286443:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286455:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286473:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.286476:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.286482:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286490:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.286493:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286502:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286513:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.286518:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.286525:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286542:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c77553d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286543:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.286555:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047505.286558:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.286560:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286561:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.286565:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.286575:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286584:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286593:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.286597:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.286673:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.286678:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286686:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.286689:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286697:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286708:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.286716:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.286718:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.286732:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.286745:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784047505.286751:0:26183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.286798:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.286804:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286872:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.286876:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.286881:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286891:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286905:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286913:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.286928:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047505.287016:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.287023:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.287031:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.287035:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.287039:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784047505.287045:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287048:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.287065:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.287073:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c77554b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.287092:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.287095:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.287104:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.287129:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.287132:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.287137:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.287138:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.287142:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287155:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287164:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.287169:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.287172:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287206:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.287326:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.287329:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047505.287334:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287336:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287355:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.287361:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.287370:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287372:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.287378:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287386:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287389:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287405:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287411:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287417:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287422:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775552 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287444:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047505.287446:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784047505.287448:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287456:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.287460:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287468:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287478:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.287490:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.287492:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775559 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287499:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287509:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.287509:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.287512:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.287514:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.287520:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.287525:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287535:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287543:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287550:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287571:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.287627:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.287634:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287643:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.287647:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.287652:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287652:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.287660:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287666:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287673:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.287679:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287682:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287689:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287709:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287718:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287729:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.287740:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4a5f3a/0x4426598c0c775560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287756:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.287760:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.287773:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.287774:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047505.287780:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287782:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287798:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.287801:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287804:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047505.287818:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287829:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287829:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bcae0b/0x4426598c0c775567 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287853:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287858:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.287862:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.287864:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287865:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.287875:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287897:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.287932:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.287937:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.287951:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.287954:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.287959:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287964:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.287969:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287977:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.287980:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.287987:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.287988:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.288005:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.288012:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9b050a/0x4426598c0c77556e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.288026:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.288028:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.288030:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.288210:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.288428:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288438:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288445:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288466:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.288491:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047505.288498:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.288506:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.288510:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047505.288518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00002000:00010000:3.0:1784047505.288519:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.288525:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288528:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288543:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:1.0:1784047505.288547:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288548:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.288557:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.288559:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286bef3d/0x4426598c0c775575 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288580:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288602:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288629:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047505.288646:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689469184 00010000:00010000:3.0:1784047505.288648:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784047505.288658:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689469184 00010000:00010000:2.0:1784047505.288668:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.288675:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288684:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.288688:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288697:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.288699:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.288711:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047505.288713:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4995 00010000:00010000:2.0:1784047505.288717:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047505.288730:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:71053:x1870705689469184:12345-192.168.204.40@tcp:101:cp.0 00010000:00010000:3.0:1784047505.288732:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.288739:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.288746:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7424b0f/0x4426598c0c77557c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288749:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.288761:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047505.288771:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288773:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.288776:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3f6 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288777:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.288781:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.288788:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288798:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.288809:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 7 pid: 26186 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.288830:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.288833:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.288838:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288844:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784047505.288864:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047505.288870:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.288874:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 7 pid: 26186 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047505.288888:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047505.288894:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 7 pid: 26186 timeout: 3703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288896:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288912:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047505.288920:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.288927:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.288934:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047505.288934:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047505.288935:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1870705709331328:192.168.204.40@tcp:104: 00010000:00010000:1.0:1784047505.288937:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.288942:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047505.288945:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.288947:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.288959:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288968:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f8c12c/0x4426598c0c775583 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.288985:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.288987:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047505.288988:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047505.289024:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc90903c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784047505.290327:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290348:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290356:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290384:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047505.290466:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047505.290471:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290482:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.290495:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.290500:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290512:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290520:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290526:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290540:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047505.290556:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047505.290565:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290576:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89400 already unused, calling callback (ffffffffc0e4a230) 00002000:00010000:3.0:1784047505.290578:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047505.290581:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290584:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290598:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290600:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=3603s v=(0 0) 00010000:00010000:3.0:1784047505.290623:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047505.290628:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290645:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290655:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290656:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290667:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c775591 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290674:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290694:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047505.290699:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047505.290703:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047505.290710:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047505.290722:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047505.290729:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290732:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.290747:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047505.290753:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.290753:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290769:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.290772:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.290773:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290784:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c775598 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.290795:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290803:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.290805:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096235f10/0x4426598c0c77559f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047505.290807:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047505.290811:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.290829:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.290833:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047505.290835:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784047505.290946:0:26183:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1826 00000100:00100000:3.0:1784047505.292216:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:92474:x1870705709330944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 41377us (44011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047505.292230:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991 00000100:00100000:0.0:1784047505.292340:0:92474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92474:1870705709330944:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784047505.292369:0:92474:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x722:0x0] 00000100:00100000:0.0:1784047505.292453:0:92474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92474:1870705709331584:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784047505.292457:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709331456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047505.292509:0:92474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047505.292515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047505.292548:0:92474:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047505.292575:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709331456 00000100:00100000:1.0:1784047505.292582:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709331456 00000100:00100000:3.0:1784047505.292667:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709331584 00000100:00100000:3.0:1784047505.292673:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709331584 00000100:00100000:3.0:1784047505.292707:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4996 00000100:00100000:3.0:1784047505.292716:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:92474:x1870705709331584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784047505.292755:0:13594:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00000100:00100000:1.0:1784047505.292867:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1784047505.292877:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709331456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047505.292894:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 896 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047505.292942:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709331456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047505.292950:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1784047505.292984:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709331456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047505.295416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047505.295461:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689469312 00000100:00100000:0.0:1784047505.295471:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689469312 00010000:00010000:0.0:1784047505.295512:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 8 pid: 26186 timeout: 3703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047505.295565:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2546 00000100:00100000:0.0:1784047505.295587:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c846d7a-6357-4e9c-a620-e35737ede709+8:2401:x1870705689469312:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047505.295603:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047505.295638:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 8 pid: 26186 timeout: 3703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.295655:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 8 pid: 26186 timeout: 3703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.295682:0:25839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.295688:0:25839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047505.295697:0:25839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.295709:0:25839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047505.295750:0:25839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047505.295767:0:25839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25839:1870705709331712:192.168.204.40@tcp:105: 00000100:00100000:0.0:1784047505.295846:0:25839:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc834fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047505.297477:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:92474:x1870705709331584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4757us (4962us total) trans 4294968755 rc 0/0 00000100:00100000:3.0:1784047505.297489:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4996 00010000:00010000:2.0:1784047505.297538:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b6903ab/0x4426598c0c7754e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3ef expref: 8 pid: 26186 timeout: 3703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047505.297565:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1870705709331328:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047505.297597:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047505.297629:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600e00, rc 0) 00000100:00100000:0.0:1784047505.297637:0:92474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92474:1870705709331584:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784047505.297652:0:92474:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00000100:00100000:2.0:1784047505.297688:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:71053:x1870705689469184:12345-192.168.204.40@tcp:101:cp.0 Request processed in 8962us (9177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.297696:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4995 00000100:00100000:2.0:1784047505.302773:0:25839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25839:1870705709331712:192.168.204.40@tcp:105: 00010000:00010000:2.0:1784047505.302800:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047505.302858:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689469312:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 7274us (7449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047505.302870:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2546 00000100:00100000:1.0:1784047505.311172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047505.311353:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689469568 00000100:00100000:0.0:1784047505.311363:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689469568 00000100:00100000:0.0:1784047505.311461:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 232 00000100:00100000:0.0:1784047505.311472:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+10:71053:x1870705689469568:12345-192.168.204.40@tcp:35:cp.0 00000001:00080000:0.0:1784047505.311717:0:66222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411446 00000100:00100000:0.0:1784047505.311837:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+12:71053:x1870705689469568:12345-192.168.204.40@tcp:35:cp.0 Request processed in 366us (673us total) trans 77309411447 rc 0/0 00000100:00100000:0.0:1784047505.311845:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 232 00000020:00080000:0.0:1784047505.311850:0:66222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00000004:1.0:1784047505.329206:0:92792:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784047505.330168:0:92792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784047505.683318:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784047506.377658:0:92843:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784047506.378314:0:92843:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784047506.562261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047506.562731:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689469696 00000100:00100000:3.0:1784047506.562857:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689469696 00000100:00100000:3.0:1784047506.562938:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1364 00000100:00100000:3.0:1784047506.562950:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71321:x1870705689469696:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:3.0:1784047506.562978:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047506.563007:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c7755a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae3fd expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047506.564921:0:66220:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1772us 00010000:00010000:0.0:1784047506.602389:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.602422:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.602439:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.602457:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.602464:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.602471:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047506.602682:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66220:1870705709331840:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047506.604895:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047506.604937:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe679cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047506.605144:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709331840 00000100:00100000:2.0:1784047506.605157:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709331840 00000100:00100000:2.0:1784047506.605235:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:2.0:1784047506.605262:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66220:x1870705709331840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784047506.605384:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66220:x1870705709331840:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047506.605392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:2.0:1784047506.605442:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66220:1870705709331840:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1784047506.605522:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c7755bb lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605541:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c7755bb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605554:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c7755bb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047506.605597:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c7755bb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605650:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605657:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605665:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605672:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605679:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047506.605683:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605691:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605706:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:2.0:1784047506.605709:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047506.605713:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.605721:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7755ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606812:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606828:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606847:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606855:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047506.606859:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606867:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606880:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99ccef591500) 00010000:00010000:2.0:1784047506.606883:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047506.606887:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606894:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7755b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606956:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c7755a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3fd expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606974:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c7755bb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3fd expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.606983:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccd8400d00) 00010000:00010000:2.0:1784047506.606985:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047506.606987:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47a00, rc 0) 00000100:00100000:2.0:1784047506.607079:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:71321:x1870705689469696:12345-192.168.204.40@tcp:101:rm.0 Request processed in 44129us (44842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047506.607098:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1364 00000100:00100000:3.0:1784047506.614938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.615396:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689469824 00000100:00100000:1.0:1784047506.615413:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689469824 00000100:00100000:1.0:1784047506.615577:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1365 00000100:00100000:1.0:1784047506.615593:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+12:71321:x1870705689469824:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047506.615661:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047506.615693:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbee00/0x4426598c0c7755c2 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae404 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.615873:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfc00/0x4426598c0c7755c9 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.615892:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfc00/0x4426598c0c7755c9 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.615908:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfc00/0x4426598c0c7755c9 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047506.615972:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1784047506.615975:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784047506.616030:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbee00/0x4426598c0c7755c2 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae404 expref: 14 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.616054:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfc00/0x4426598c0c7755c9 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae404 expref: 13 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.616065:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:1.0:1784047506.616068:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784047506.616092:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbfc00, rc 0) 00000100:00100000:1.0:1784047506.616172:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+13:71321:x1870705689469824:12345-192.168.204.40@tcp:101:rm.0 Request processed in 584us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.616180:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1365 00000100:00100000:3.0:1784047506.624189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047506.624305:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689470080 00000100:00100000:2.0:1784047506.624318:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689470080 00000100:00100000:2.0:1784047506.624394:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1366 00000100:00100000:2.0:1784047506.624406:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+13:71321:x1870705689470080:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:2.0:1784047506.624433:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047506.624474:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7755d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae40b expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047506.624864:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1784047506.625015:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7755d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae40b expref: 15 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.625035:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd8400900) 00010000:00010000:2.0:1784047506.625039:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047506.625046:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7755d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae40b expref: 15 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.625070:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46600, rc 0) 00000100:00100000:2.0:1784047506.625220:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+14:71321:x1870705689470080:12345-192.168.204.40@tcp:101:rm.0 Request processed in 814us (1047us total) trans 77309411448 rc 301/301 00000100:00100000:2.0:1784047506.625231:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1366 00000100:00100000:0.0:1784047506.631267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.631441:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689470208 00000100:00100000:1.0:1784047506.631456:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689470208 00000100:00100000:1.0:1784047506.631533:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 233 00000100:00100000:1.0:1784047506.631547:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+14:71321:x1870705689470208:12345-192.168.204.40@tcp:37:rm.0 00000100:00100000:1.0:1784047506.638042:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+14:71321:x1870705689470208:12345-192.168.204.40@tcp:37:rm.0 Request processed in 6479us (6784us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.638064:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 233 00000100:00100000:1.0:1784047506.644753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047506.647332:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689470464 00000100:00100000:0.0:1784047506.647352:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689470464 00000100:00100000:2.0:1784047506.649789:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 234 00000100:00100000:2.0:1784047506.649809:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+14:71321:x1870705689470464:12345-192.168.204.40@tcp:35:rm.0 00000100:00100000:2.0:1784047506.650177:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+15:71321:x1870705689470464:12345-192.168.204.40@tcp:35:rm.0 Request processed in 371us (5437us total) trans 77309411449 rc 0/0 00000100:00100000:2.0:1784047506.650207:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 234 00000100:00100000:1.0:1784047506.658162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047506.659123:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689470720 00000100:00100000:2.0:1784047506.659139:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689470720 00000100:00100000:2.0:1784047506.659245:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1367 00000100:00100000:2.0:1784047506.659272:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+15:71321:x1870705689470720:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:2.0:1784047506.659322:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047506.659361:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7755de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae412 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.659681:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c7755e5 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.659701:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c7755e5 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.659716:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c7755e5 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047506.659860:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1784047506.660017:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46600/0x4426598c0c7755de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae412 expref: 18 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.660050:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c7755e5 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae412 expref: 17 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.660061:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:2.0:1784047506.660065:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784047506.660069:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47c00, rc 0) 00000100:00100000:2.0:1784047506.660184:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+17:71321:x1870705689470720:12345-192.168.204.40@tcp:101:rm.0 Request processed in 916us (2046us total) trans 77309411450 rc 0/0 00000100:00100000:2.0:1784047506.660194:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1367 00000100:00100000:0.0:1784047506.666600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.666837:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689470848 00000100:00100000:1.0:1784047506.666852:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689470848 00000100:00100000:1.0:1784047506.666935:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1368 00000100:00100000:1.0:1784047506.666949:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+17:71321:x1870705689470848:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047506.666985:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047506.667116:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbee00/0x4426598c0c7755f3 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae419 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.667217:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe200/0x4426598c0c7755fa lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.667233:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe200/0x4426598c0c7755fa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.667257:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe200/0x4426598c0c7755fa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047506.667343:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1784047506.667348:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047506.667374:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe200/0x4426598c0c7755fa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.667407:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbee00/0x4426598c0c7755f3 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae419 expref: 19 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.667430:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe200/0x4426598c0c7755fa lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae419 expref: 18 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.667440:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:1.0:1784047506.667444:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047506.667449:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbe200, rc 0) 00000100:00100000:1.0:1784047506.667587:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+18:71321:x1870705689470848:12345-192.168.204.40@tcp:101:rm.0 Request processed in 640us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.667597:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1368 00000100:00100000:2.0:1784047506.686013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047506.686511:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689471104 00000100:00100000:0.0:1784047506.686524:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689471104 00000100:00100000:0.0:1784047506.686602:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1369 00000100:00100000:0.0:1784047506.686639:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+18:71321:x1870705689471104:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:0.0:1784047506.686671:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047506.686709:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775601 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae420 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047506.686870:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1784047506.686997:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775601 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae420 expref: 20 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.687015:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:0.0:1784047506.687017:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047506.687023:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775601 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae420 expref: 20 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.687041:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600800, rc 0) 00000100:00100000:0.0:1784047506.687584:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+19:71321:x1870705689471104:12345-192.168.204.40@tcp:101:rm.0 Request processed in 945us (1583us total) trans 77309411451 rc 301/301 00000100:00100000:0.0:1784047506.687595:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1369 00000100:00100000:3.0:1784047506.691658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.691968:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689471232 00000100:00100000:1.0:1784047506.691982:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689471232 00000100:00100000:1.0:1784047506.692059:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 235 00000100:00100000:1.0:1784047506.692073:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+19:71321:x1870705689471232:12345-192.168.204.40@tcp:37:rm.0 00000100:00100000:1.0:1784047506.698823:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+19:71321:x1870705689471232:12345-192.168.204.40@tcp:37:rm.0 Request processed in 6733us (7210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.698843:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 235 00000100:00100000:3.0:1784047506.702064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047506.702216:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689471488 00000100:00100000:0.0:1784047506.702232:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689471488 00000100:00100000:0.0:1784047506.702333:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 236 00000100:00100000:0.0:1784047506.702348:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+19:71321:x1870705689471488:12345-192.168.204.40@tcp:35:rm.0 00000100:00100000:0.0:1784047506.702724:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+20:71321:x1870705689471488:12345-192.168.204.40@tcp:35:rm.0 Request processed in 377us (673us total) trans 77309411452 rc 0/0 00000100:00100000:0.0:1784047506.702732:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 236 00000100:00100000:3.0:1784047506.705662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.705828:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689471744 00000100:00100000:1.0:1784047506.705840:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689471744 00000100:00100000:1.0:1784047506.705928:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1370 00000100:00100000:1.0:1784047506.705940:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+20:71321:x1870705689471744:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047506.705972:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047506.705998:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbee00/0x4426598c0c77560f lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae427 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.706138:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775616 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.706156:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775616 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.706169:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775616 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047506.706182:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1784047506.706337:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbee00/0x4426598c0c77560f lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae427 expref: 23 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.706360:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775616 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae427 expref: 22 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.706370:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:1.0:1784047506.706374:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784047506.706378:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbf200, rc 0) 00000100:00100000:1.0:1784047506.706477:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689471744:12345-192.168.204.40@tcp:101:rm.0 Request processed in 538us (828us total) trans 77309411453 rc 0/0 00000100:00100000:1.0:1784047506.706486:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1370 00010000:00010000:2.0:1784047506.707016:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047506.709850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.709984:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689471872 00000100:00100000:1.0:1784047506.710017:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689471872 00000100:00100000:1.0:1784047506.710097:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1371 00000100:00100000:1.0:1784047506.710110:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:71321:x1870705689471872:12345-192.168.204.40@tcp:41:rm.0 00000004:00000024:1.0:1784047506.710186:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:1.0:1784047506.710297:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:71321:x1870705689471872:12345-192.168.204.40@tcp:41:rm.0 Request processed in 188us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.710308:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1371 00000100:00100000:3.0:1784047506.713559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047506.713930:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689472128 00000100:00100000:0.0:1784047506.713945:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689472128 00000100:00100000:0.0:1784047506.714021:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1372 00000100:00100000:0.0:1784047506.714035:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689472128:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:0.0:1784047506.714117:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784047506.714154:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7753c3 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3e8 expref: 22 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714182:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99ccd8400c00) 00010000:00010000:0.0:1784047506.714203:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe200/0x4426598c0c7755fa lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae419 expref: 21 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714214:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:0.0:1784047506.714218:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047506.714258:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714274:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714285:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714299:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714329:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714337:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714486:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714495:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714501:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784047506.714839:0:68026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x48:0x0].2, 64 off8320 00000004:00080000:0.0:1784047506.714851:0:68026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3604967243558ns, next at 3605967240208ns, rc = 0 00010000:00010000:0.0:1784047506.714903:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714913:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714921:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714929:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714936:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714954:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714969:0:68026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047506.714992:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.714998:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715005:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715012:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047506.715018:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715026:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715036:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99ccef591100) 00010000:00010000:0.0:1784047506.715039:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784047506.715043:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715049:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c775632 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715068:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715074:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715086:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715092:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715097:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047506.715100:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715106:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715115:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:0.0:1784047506.715118:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047506.715121:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715128:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600800/0x4426598c0c775624 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047506.715139:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b05ac4f reply state 00000000e3d9c3e5 transno 77309411454 ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715151:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.715157:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff99ccd8400400) 00010000:00010000:0.0:1784047506.715159:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047506.715163:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047506.715277:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689472128:12345-192.168.204.40@tcp:36:rm.0 Request processed in 1243us (1731us total) trans 77309411454 rc 0/0 00000100:00100000:0.0:1784047506.715293:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1372 00010000:00010000:2.0:1784047506.715782:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047506.715792:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.715800:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047506.715804:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.715812:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.715824:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff99ccef591100) 00010000:00010000:2.0:1784047506.715827:0:16469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784047506.715830:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.715836:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600400/0x4426598c0c775639 lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.715854:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047506.715856:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047506.715858:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047506.723600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047506.726000:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689472384 00000100:00100000:0.0:1784047506.726019:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689472384 00000100:00100000:0.0:1784047506.726155:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 237 00000100:00100000:0.0:1784047506.726171:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689472384:12345-192.168.204.40@tcp:35:rm.0 00000100:00100000:0.0:1784047506.726768:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+23:71321:x1870705689472384:12345-192.168.204.40@tcp:35:rm.0 Request processed in 598us (3182us total) trans 77309411455 rc 0/0 00000100:00100000:0.0:1784047506.726779:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 237 00000100:00100000:0.0:1784047506.729806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047506.729918:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689472640 00000100:00100000:2.0:1784047506.729931:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689472640 00000100:00100000:2.0:1784047506.730001:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1373 00000100:00100000:2.0:1784047506.730014:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+23:71321:x1870705689472640:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:2.0:1784047506.730116:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784047506.730154:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775616 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae427 expref: 23 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730183:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbdc00/0x4426598c0c775123 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3b0 expref: 22 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730202:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccc648ec00) 00010000:00010000:2.0:1784047506.730225:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfc00/0x4426598c0c7755c9 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae404 expref: 21 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730233:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:2.0:1784047506.730237:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047506.730279:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730296:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730308:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730328:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730336:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730343:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730490:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730500:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730508:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047506.730861:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1784047506.730883:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730891:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730898:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730905:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047506.730910:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730919:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730929:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff99ccd8400b00) 00010000:00010000:2.0:1784047506.730932:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784047506.730936:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730953:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c77564e lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730976:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730983:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730989:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.730995:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.731001:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047506.731004:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.731010:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.731018:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:2.0:1784047506.731021:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047506.731024:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.731031:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c775640 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047506.731041:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000baf4604d reply state 000000009e71d524 transno 77309411456 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.731060:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.731068:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99ccd8400900) 00010000:00010000:2.0:1784047506.731070:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047506.731074:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784047506.731178:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689472640:12345-192.168.204.40@tcp:36:rm.0 Request processed in 1164us (1385us total) trans 77309411456 rc 0/0 00000100:00100000:2.0:1784047506.731188:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1373 00000100:00100000:3.0:1784047506.736420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047506.736484:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047506.736669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689472768 00000100:00100000:2.0:1784047506.736681:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689472768 00000100:00100000:2.0:1784047506.736775:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 730 00000100:00100000:2.0:1784047506.736788:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:2400:x1870705689472768:12345-192.168.204.40@tcp:103:rm.0 00010000:00010000:2.0:1784047506.736811:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047506.736845:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c7755bb lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3fd expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.736868:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccd8400d00) 00010000:00010000:2.0:1784047506.736882:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047506.736949:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689472768:12345-192.168.204.40@tcp:103:rm.0 Request processed in 164us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047506.736958:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 730 00000100:00100000:1.0:1784047506.737133:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473024 00000100:00100000:1.0:1784047506.737138:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473024 00000100:00100000:1.0:1784047506.737185:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 238 00000100:00100000:1.0:1784047506.737194:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689473024:12345-192.168.204.40@tcp:35:rm.0 00000100:00100000:1.0:1784047506.737481:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+23:71321:x1870705689473024:12345-192.168.204.40@tcp:35:rm.0 Request processed in 288us (1076us total) trans 77309411457 rc 0/0 00000100:00100000:1.0:1784047506.737489:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 238 00000100:00100000:3.0:1784047506.740913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047506.741205:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473280 00000100:00100000:2.0:1784047506.741219:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473280 00000100:00100000:2.0:1784047506.741360:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1374 00000100:00100000:2.0:1784047506.741384:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+23:71321:x1870705689473280:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:2.0:1784047506.741505:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784047506.741544:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c7755e5 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae412 expref: 23 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.741571:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd7e200/0x4426598c0c775107 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3a9 expref: 22 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.741586:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd001e7b00) 00010000:00010000:2.0:1784047506.741600:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047506.741773:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.741782:0:66220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.741795:0:66220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047506.741824:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709331968:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1784047506.741893:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047506.741924:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73000 going to sleep for 11 seconds 00000100:00100000:1.0:1784047506.742142:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709331968 00000100:00100000:1.0:1784047506.742148:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709331968 00000100:00100000:1.0:1784047506.742200:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1784047506.742208:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709331968:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1784047506.742220:0:23872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047506.742237:0:23872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c775655 expref: -99 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.742272:0:23872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 6 pid: 92488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.742283:0:23872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.742324:0:23872:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 6 pid: 92488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.742341:0:23872:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 6 pid: 92488 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047506.742356:0:23872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23872:1870705709332096:192.168.204.40@tcp:104: 00000100:00100000:1.0:1784047506.742438:0:23872:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047506.745056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047506.745183:0:23872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23872:1870705709332096:192.168.204.40@tcp:104: 00000100:00100000:3.0:1784047506.745186:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473408 00000100:00100000:3.0:1784047506.745194:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473408 00010000:00010000:1.0:1784047506.745225:0:23872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.745233:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 92488 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.745240:0:23872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047506.745243:0:23872:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047506.745259:0:23872:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.745271:0:23872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbee00, rc 0) 00000100:00100000:3.0:1784047506.745281:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2547 00000100:00100000:3.0:1784047506.745291:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689473408:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047506.745319:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047506.745326:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 92488 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.745340:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 92488 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.745367:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd7fc00/0x4426598c0c775399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae39b expref: 7 pid: 92488 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047506.745424:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709331968:12345-0@lo:101:mdt00_001.0 Request processed in 3216us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.745433:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00010000:00010000:3.0:1784047506.745544:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047506.745549:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 8 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.745560:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 8 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.745570:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 8 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.745630:0:26194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 8 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047506.745647:0:26194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26194:1870705709332224:0@lo:105: 00000100:00100000:3.0:1784047506.745694:0:26194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047506.746192:0:26194:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047506.747657:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709331968:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1784047506.747696:0:66220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.747803:0:66220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047506.748154:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709332224 00000100:00100000:0.0:1784047506.748167:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709332224 00000100:00100000:0.0:1784047506.748258:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1784047506.748270:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:26194:x1870705709332224:12345-0@lo:105: 00010000:00010000:0.0:1784047506.748285:0:6502:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.748296:0:6502:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.748307:0:6502:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.748316:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.748341:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.748352:0:6502:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047506.748386:0:6502:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99ccf6c46a00) 00000100:00100000:0.0:1784047506.748488:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:26194:x1870705709332224:12345-0@lo:105: Request processed in 220us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047506.748496:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784047506.748571:0:26194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26194:1870705709332224:0@lo:105: 00010000:00010000:3.0:1784047506.748599:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047506.748603:0:66220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.748631:0:66220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047506.748664:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1784047506.748679:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689473408:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 3386us (3635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047506.748688:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2547 00010000:00010000:1.0:1784047506.749123:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.749133:0:66220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.749146:0:66220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047506.749174:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332352:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1784047506.749226:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047506.749270:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dc900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047506.749525:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709332352 00000100:00100000:3.0:1784047506.749532:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709332352 00000100:00100000:3.0:1784047506.749581:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1784047506.749590:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709332352:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1784047506.749644:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047506.749667:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77566a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c775663 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.749698:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77566a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775663 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.750447:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77566a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775663 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.750832:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99ccc2b81900) 00010000:00010000:3.0:1784047506.750837:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047506.750841:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89000, rc 0) 00000100:00100000:3.0:1784047506.750932:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66220:x1870705709332352:12345-0@lo:101:mdt00_001.0 Request processed in 1341us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047506.750942:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1784047506.750989:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332352:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1784047506.751015:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.751029:0:66220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047506.751069:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784047506.751138:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332480:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047506.751181:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047506.751213:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1784047506.751277:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709332480 00000100:00100000:2.0:1784047506.751285:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709332480 00000100:00100000:2.0:1784047506.751336:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:2.0:1784047506.751348:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66220:x1870705709332480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784047506.751454:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66220:x1870705709332480:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047506.751462:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1784047506.752942:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332480:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784047506.753052:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332608:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784047506.753126:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047506.753163:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047506.753487:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709332608 00000100:00100000:0.0:1784047506.753496:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709332608 00000100:00100000:0.0:1784047506.753565:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1784047506.753588:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66220:x1870705709332608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047506.753764:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66220:x1870705709332608:12345-0@lo:1000:mdt00_001.0 Request processed in 189us (636us total) trans 0 rc 1/1 00000100:00100000:0.0:1784047506.753772:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1784047506.754150:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332608:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1784047506.754258:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.754300:0:66220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.754314:0:66220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047506.754334:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332736:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1784047506.754386:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047506.754414:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3dc900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047506.754476:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709332736 00000100:00100000:2.0:1784047506.754483:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709332736 00000100:00100000:2.0:1784047506.754525:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1784047506.754534:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66220:x1870705709332736:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1784047506.754546:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047506.754568:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c775678 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c775671 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.754656:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c775678 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775671 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.754674:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c775678 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775671 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047506.754684:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccd8400d00) 00010000:00010000:2.0:1784047506.754688:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047506.754692:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47a00, rc 0) 00000100:00100000:2.0:1784047506.754743:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66220:x1870705709332736:12345-0@lo:101:mdt00_001.0 Request processed in 210us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047506.754760:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1784047506.754805:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709332736:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1784047506.754820:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.754832:0:66220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.754863:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.754876:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.754888:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784047506.755685:0:66220:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].3, 432 off36352 00000040:00080000:1.0:1784047506.755817:0:66220:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].3, 512 off36784 00000004:00080000:1.0:1784047506.755825:0:66220:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99cccc3dc900 with version 11 00000004:00080000:0.0:1784047506.762550:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 11 rpc_version 11 00000020:00100000:0.0:1784047506.762654:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784047506.762670:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99ccff10ed80 x1870705709332992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047506.762702:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709332992:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784047506.762821:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047506.762875:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe679180 going to sleep for 11 seconds 00000100:00100000:1.0:1784047506.763437:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709332992 00000100:00100000:1.0:1784047506.763478:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709332992 00000100:00100000:1.0:1784047506.763563:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1784047506.763575:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75668:x1870705709332992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784047506.771715:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75668:x1870705709332992:12345-0@lo:1000:osp_up0-1.0 Request processed in 8120us (8872us total) trans 120259084290 rc 0/0 00000100:00100000:1.0:1784047506.771735:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1784047506.772128:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709332992:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1784047506.772531:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1784047506.772561:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772572:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772581:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772588:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047506.772593:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772602:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772659:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99cd02171a00) 00010000:00010000:1.0:1784047506.772662:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047506.772667:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772674:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe400/0x4426598c0c77567f lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772699:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772737:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772744:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772766:0:66220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784047506.772784:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784047506.772790:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772798:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772806:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772924:0:66220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1784047506.772930:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784047506.772935:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.772943:0:66220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047506.773041:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+22:71321:x1870705689473280:12345-192.168.204.40@tcp:36:rm.0 Request processed in 31667us (32140us total) trans 77309411458 rc 0/0 00000100:00100000:1.0:1784047506.773060:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1374 00010000:00010000:3.0:1784047506.780538:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047506.780562:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780579:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf400 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:3.0:1784047506.780588:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047506.780647:0:6507:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780713:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780730:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047506.780776:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780784:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbf400/0x4426598c0c775671 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775678 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047506.780812:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709333120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047506.780817:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047506.780822:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780828:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:3.0:1784047506.780832:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047506.780838:0:6507:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780855:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780861:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047506.780887:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780893:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c46a00/0x4426598c0c775655 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c77565c expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.780904:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047506.780905:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047506.780907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047506.780908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047506.780972:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709333248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047506.781001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047506.781071:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333120 00000100:00100000:3.0:1784047506.781081:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333120 00000100:00100000:3.0:1784047506.781142:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333248 00000100:00100000:3.0:1784047506.781146:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333248 00000100:00100000:3.0:1784047506.781174:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1784047506.781278:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+13:3646:x1870705709333120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047506.781297:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047506.781321:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47a00/0x4426598c0c775678 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775671 expref: 13 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047506.781339:0:26195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff99ccd8400d00) 00010000:00010000:3.0:1784047506.781350:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047506.781474:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3646:x1870705709333120:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.782003:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1784047506.782017:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3647:x1870705709333248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047506.782030:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047506.782059:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbee00/0x4426598c0c77565c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775655 expref: 12 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047506.782086:0:25839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047506.782090:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047506.782137:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3647:x1870705709333248:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047506.782145:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00010000:00010000:2.0:1784047506.782154:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047506.782202:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709333248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047506.785695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709333120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047506.786151:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1784047507.082905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047507.082960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047507.083026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047507.083065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047507.083211:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473536 00000100:00100000:3.0:1784047507.083224:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473536 00000100:00100000:1.0:1784047507.083299:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473664 00000100:00100000:1.0:1784047507.083304:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473664 00000100:00100000:3.0:1784047507.083311:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:3.0:1784047507.083323:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689473536:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047507.083356:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473792 00000100:00100000:1.0:1784047507.083359:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473792 00000100:00100000:1.0:1784047507.083378:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1336 00000100:00100000:1.0:1784047507.083386:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689473664:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047507.083417:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689473536:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 95us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047507.083432:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:1.0:1784047507.083433:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689473664:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 48us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047507.083448:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1336 00000100:00100000:1.0:1784047507.083460:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1337 00000100:00100000:1.0:1784047507.083466:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+22:2402:x1870705689473792:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:3.0:1784047507.083490:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047507.083495:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047507.083499:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+22:2402:x1870705689473792:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 33us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047507.083506:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1337 00000100:00100000:2.0:1784047507.083949:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689473920 00000100:00100000:2.0:1784047507.083955:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689473920 00000100:00080000:3.0:1784047507.084145:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047507.084946:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2602 00000100:00100000:3.0:1784047507.084968:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689473920:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047507.085067:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689473920:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 109us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047507.085076:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2602 00000004:00080000:2.0:1784047507.731856:0:75671:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3605984244997ns, next at 3606984241288ns, rc = 0 00000100:00100000:2.0:1784047507.731933:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709333376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047507.732233:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709333504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047507.732295:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047507.735595:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047507.738970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047507.739119:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333376 00000100:00100000:3.0:1784047507.739132:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333376 00000100:00100000:3.0:1784047507.739381:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333504 00000100:00100000:3.0:1784047507.739389:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333504 00000100:00100000:3.0:1784047507.739429:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:3.0:1784047507.739445:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709333376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047507.739496:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047507.739561:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709333376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (7266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047507.739569:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:3.0:1784047507.739591:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1784047507.739598:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709333504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047507.739644:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047507.739683:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709333504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047507.739700:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00080000:3.0:1784047507.739721:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047507.739726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047507.739780:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709333504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047507.740036:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709333376:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047508.755916:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047509.781844:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047510.291804:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709333632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047510.291883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.291922:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709334144:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.291946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047510.291947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709333760:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.291963:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709334656:0@lo:400:kworker.0 00000100:00100000:1.0:1784047510.291978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.291985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047510.292004:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709334272:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.292005:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709335168:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.292026:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047510.292040:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.292044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784047510.292049:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709334016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047510.292052:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709334784:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.292068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.292088:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709334528:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.292111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.292126:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709335040:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.292151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047510.292248:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709333888:0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.292273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047510.297926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709334400:0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.297995:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047510.298019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709334912:0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.298046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047510.298073:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047510.298079:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709335296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047510.298097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047510.298136:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333632 00000100:00100000:2.0:1784047510.298143:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333632 00000100:00100000:2.0:1784047510.298210:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334400 00000100:00100000:2.0:1784047510.298213:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334400 00000100:00100000:2.0:1784047510.298227:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335296 00000100:00100000:2.0:1784047510.298243:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335296 00000100:00100000:2.0:1784047510.298260:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:2.0:1784047510.298269:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709333632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047510.298305:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1784047510.298357:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709333632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (6472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.298364:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:2.0:1784047510.298381:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1784047510.298387:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3648:x1870705709334400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.298428:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3648:x1870705709334400:12345-0@lo:400:kworker.0 Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.298435:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1784047510.298447:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:2.0:1784047510.298453:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3648:x1870705709335296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047510.298469:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444990976 avail 1298751488 00000100:00100000:2.0:1784047510.298497:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3648:x1870705709335296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.298502:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:2.0:1784047510.298523:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334656 00000100:00100000:2.0:1784047510.298526:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334656 00000100:00100000:2.0:1784047510.298562:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334528 00000100:00100000:2.0:1784047510.298566:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334528 00000100:00100000:2.0:1784047510.298880:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335040 00000100:00100000:2.0:1784047510.298884:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335040 00000100:00100000:2.0:1784047510.298905:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334912 00000100:00100000:2.0:1784047510.298908:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334912 00000100:00100000:2.0:1784047510.298931:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1784047510.298938:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.298989:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709334656:12345-0@lo:400:kworker.0 Request processed in 52us (7003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.298997:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1784047510.299010:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1784047510.299016:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709334528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.299045:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709334528:12345-0@lo:400:kworker.0 Request processed in 30us (6933us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.299052:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1784047510.299063:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1784047510.299069:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709335040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.299096:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709335040:12345-0@lo:400:kworker.0 Request processed in 28us (6944us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.299102:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1784047510.299112:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1784047510.299118:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709334912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047510.299144:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709334912:12345-0@lo:400:kworker.0 Request processed in 26us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.299150:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:3.0:1784047510.299800:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334144 00000100:00100000:3.0:1784047510.299808:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334144 00000100:00100000:3.0:1784047510.299845:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335168 00000100:00100000:3.0:1784047510.299848:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335168 00000100:00100000:3.0:1784047510.299865:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334272 00000100:00100000:3.0:1784047510.299876:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334272 00000100:00100000:3.0:1784047510.299896:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334016 00000100:00100000:3.0:1784047510.299898:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334016 00000100:00100000:3.0:1784047510.299913:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333888 00000100:00100000:3.0:1784047510.299916:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333888 00000100:00100000:3.0:1784047510.299933:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1784047510.299941:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.299993:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709334144:12345-0@lo:400:kworker.0 Request processed in 53us (8045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.300000:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1784047510.300016:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1784047510.300022:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709335168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300053:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709335168:12345-0@lo:400:kworker.0 Request processed in 31us (8025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.300059:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1784047510.300072:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1784047510.300078:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709334272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300109:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709334272:12345-0@lo:400:kworker.0 Request processed in 31us (8068us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.300116:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1784047510.300128:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1784047510.300135:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709334016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300164:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709334016:12345-0@lo:400:kworker.0 Request processed in 30us (8094us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.300170:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1784047510.300194:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1784047510.300201:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709333888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300241:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709333888:12345-0@lo:400:kworker.0 Request processed in 41us (7967us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.300248:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1784047510.300357:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709335296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047510.300371:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709333888:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300381:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709334400:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300393:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709334912:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300434:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709334016:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300446:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709334528:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300457:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709335040:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300469:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709335168:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300480:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709334144:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300493:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709334656:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.300510:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709333632:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1784047510.300556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047510.300561:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047510.300564:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047510.301982:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709335424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047510.302042:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047510.302083:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335424 00000100:00100000:1.0:1784047510.302089:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335424 00000100:00100000:1.0:1784047510.302125:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1784047510.302133:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709335424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047510.302160:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047510.302211:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709335424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047510.302219:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1784047510.302257:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709335424:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784047510.302619:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047510.303822:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709333760 00000100:00100000:3.0:1784047510.303834:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709333760 00000100:00100000:3.0:1784047510.303884:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784047510.303894:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.304000:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709333760:12345-0@lo:400:kworker.0 Request processed in 107us (12019us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.304007:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784047510.304137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.304195:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709333760:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.304211:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709334272:0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.305758:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709334784 00000100:00100000:3.0:1784047510.305769:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709334784 00000100:00100000:3.0:1784047510.305827:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1784047510.305837:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709334784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047510.305917:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709334784:12345-0@lo:400:kworker.0 Request processed in 81us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.305925:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1784047510.305985:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709334784:0@lo:400:kworker.0 00010000:00010000:3.0:1784047510.804188:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047510.808871:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709335552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047510.808938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.808995:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335552 00000100:00100000:3.0:1784047510.809002:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335552 00000100:00100000:3.0:1784047510.809048:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1784047510.809057:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709335552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047510.809085:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047510.809124:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709335552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.809131:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1784047510.809196:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709335552:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1784047510.809294:0:75662:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:3.0:1784047510.809600:0:75662:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047510.809635:0:75662:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809684:0:75662:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809691:0:75662:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047510.809708:0:75662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe000/0x4426598c0c775663 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c77566a expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047510.809729:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411458 is committed 00000004:00080000:3.0:1784047510.809744:0:75662:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:3.0:1784047510.809840:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809848:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809855:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809863:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047510.809867:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809874:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809894:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff99ccd8400400) 00010000:00010000:3.0:1784047510.809898:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047510.809902:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809909:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7753bc lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809923:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809929:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809935:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809940:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047510.809942:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809947:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809954:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff99ccd8400400) 00010000:00010000:3.0:1784047510.809956:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047510.809959:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809964:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600a00/0x4426598c0c77562b lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809989:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.809997:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810003:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810008:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047510.810011:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810017:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810026:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff99ccd8400900) 00010000:00010000:3.0:1784047510.810029:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047510.810032:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810038:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47600/0x4426598c0c775647 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047510.810062:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709335808:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1784047510.810107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.810148:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335808 00000100:00100000:3.0:1784047510.810154:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335808 00000100:00100000:3.0:1784047510.810202:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4997 00000100:00100000:3.0:1784047510.810209:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709335808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1784047510.810233:0:26190:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:546 count 1 00010000:00010000:3.0:1784047510.810256:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810276:0:26190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 5 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.810285:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x222:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1784047510.810289:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784047510.810294:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.811940:0:26190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 5 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.811961:0:26190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 5 pid: 8431 timeout: 3709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047510.811976:0:26190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:26190:1870705709335936:192.168.204.40@tcp:104: 00000100:00100000:3.0:1784047510.812048:0:26190:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d540 going to sleep for 11 seconds 00000100:00100000:3.0:1784047510.812443:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709335680:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784047510.812483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047510.812594:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709335680 00000100:00100000:3.0:1784047510.812600:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709335680 00000100:00100000:3.0:1784047510.812664:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:3.0:1784047510.812672:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3646:x1870705709335680:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784047510.812697:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047510.812718:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77566a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775663 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.812822:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff99ccc2b81900) 00010000:00010000:3.0:1784047510.812832:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047510.812873:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1870705709335680:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 201us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047510.812881:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:3.0:1784047510.812958:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709335680:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:1.0:1784047510.814075:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968754 is committed 00000001:00080000:1.0:1784047510.814910:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968755 is committed 00000001:00080000:2.0:1784047510.815301:0:92454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:0.0:1784047510.820143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047510.820589:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474048 00000100:00100000:2.0:1784047510.820599:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474048 00010000:00010000:2.0:1784047510.820680:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 6 pid: 8431 timeout: 3709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047510.820727:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2548 00000100:00100000:2.0:1784047510.820738:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689474048:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784047510.820765:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047510.820772:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 6 pid: 8431 timeout: 3709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.820787:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 6 pid: 8431 timeout: 3709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.820814:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784047510.820819:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784047510.820824:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.820835:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.820857:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047510.820913:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689474048:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 176us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047510.820920:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2548 00000100:00080000:0.0:1784047510.821517:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784047510.821794:0:26190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000478592c1/0x4426598c0c77558a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3f6 expref: 5 pid: 8431 timeout: 3709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047510.821811:0:26190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:26190:1870705709335936:192.168.204.40@tcp:104: 00010000:00010000:3.0:1784047510.821834:0:26190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.821845:0:26190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.821851:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.821862:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.821886:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047510.824569:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784047510.824861:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+6:3647:x1870705709335808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14647us (14748us total) trans 4294968756 rc 0/0 00000100:00100000:3.0:1784047510.824873:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4997 00000004:00080000:1.0:1784047510.825458:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cce3d20380/2, rc 0, transno 4294968756 00000100:00100000:1.0:1784047510.825468:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709335808:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1784047510.826745:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047510.826758:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.826771:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047510.826776:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.826812:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.826836:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.826844:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003848bc5e/0x4426598c0c775686 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047510.826869:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047510.826871:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047510.826873:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047511.834266:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047512.198182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047512.198362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047512.198520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047512.198565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047512.198647:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474176 00000100:00100000:1.0:1784047512.198657:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474176 00000100:00100000:1.0:1784047512.198714:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:1.0:1784047512.198723:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689474176:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047512.198792:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689474176:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047512.198799:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:2.0:1784047512.199311:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474560 00000100:00100000:2.0:1784047512.199316:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474560 00000100:00100000:2.0:1784047512.199363:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2607 00000100:00100000:2.0:1784047512.199380:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689474560:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047512.199430:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689474560:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 60us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047512.199438:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2607 00000100:00080000:1.0:1784047512.199516:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047512.206230:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474304 00000100:00100000:0.0:1784047512.206248:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474304 00000100:00100000:0.0:1784047512.206390:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474432 00000100:00100000:0.0:1784047512.206395:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474432 00000100:00100000:2.0:1784047512.207529:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1344 00000100:00100000:2.0:1784047512.207549:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689474304:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047512.207662:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689474304:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 121us (9490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047512.207670:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1344 00000100:00080000:1.0:1784047512.210538:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047512.210550:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047512.210744:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1345 00000100:00100000:0.0:1784047512.210759:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689474432:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047512.210843:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689474432:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 88us (12279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047512.210851:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1345 00010000:00010000:1.0:1784047512.851014:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047512.851034:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047512.851059:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709336064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047512.851146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047512.851198:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336064 00000100:00100000:0.0:1784047512.851207:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336064 00000100:00100000:0.0:1784047512.851269:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:0.0:1784047512.851280:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709336064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047512.851309:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047512.851365:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709336064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047512.851373:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00080000:0.0:1784047512.851397:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047512.851432:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709336064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047512.852912:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047512.852933:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709336192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047512.852994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047512.853170:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336192 00000100:00100000:0.0:1784047512.853192:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336192 00000100:00100000:0.0:1784047512.853256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1784047512.853265:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709336192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047512.853290:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047512.853351:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870705709336192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047512.853358:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:3.0:1784047512.853518:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709336192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784047512.853575:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1784047513.829478:0:93039:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 12:45:11 (1784047511) 00010000:00010000:3.0:1784047513.886846:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784047514.879000:0:93087:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcf0b34d70 20000000:00000080:2.0:1784047514.879018:0:93087:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99cce587bc00 uarg=0000000000000000 00000040:00100000:2.0:1784047514.879600:0:93087:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:2.0:1784047514.879634:0:93087:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:2.0:1784047514.880157:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:2.0:1784047514.880177:0:93087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1784047514.880195:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:2.0:1784047514.880213:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:2.0:1784047514.880282:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:2.0:1784047514.880291:0:93087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1784047514.880305:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:2.0:1784047514.880532:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:2.0:1784047514.881283:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:2.0:1784047514.881297:0:93087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1784047514.881318:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:2.0:1784047514.881429:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:2.0:1784047514.881448:0:93087:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784047514.882014:0:93087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882036:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882044:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882052:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882059:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882079:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882086:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7752dc expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882106:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775306 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882114:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775314 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882120:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775330 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882127:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775345 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882133:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77536f expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882140:0:93087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882181:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c77536f expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882196:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c77536f expref: 23 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.882222:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336320:0@lo:104: 00000100:00100000:2.0:1784047514.882343:0:93087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047514.882435:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775345 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882444:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775345 expref: 23 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.882452:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336448:0@lo:104: 00000100:00100000:2.0:1784047514.882474:0:93087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047514.882668:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775330 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.882677:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775330 expref: 23 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.882686:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336576:0@lo:104: 00000100:00100000:2.0:1784047514.882707:0:93087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.882817:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336320 00000100:00100000:0.0:1784047514.882825:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336320 00000100:00100000:0.0:1784047514.882870:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336448 00000100:00100000:0.0:1784047514.882873:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336448 00000100:00100000:0.0:1784047514.882887:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784047514.882897:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+4:93087:x1870705709336320:12345-0@lo:104: 00010000:00010000:0.0:1784047514.882909:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.882961:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047514.882967:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+4:93087:x1870705709336320:12345-0@lo:104: Request processed in 72us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.882974:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784047514.882991:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784047514.882997:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:93087:x1870705709336448:12345-0@lo:104: 00010000:00010000:0.0:1784047514.883003:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883034:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784047514.883047:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:93087:x1870705709336448:12345-0@lo:104: Request processed in 50us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.883053:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:0.0:1784047514.883071:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047514.883077:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883085:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047514.883101:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883110:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047514.883118:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047514.883123:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047514.883150:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883156:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047514.883176:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883184:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e400/0x4426598c0c77536f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883197:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047514.883200:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883215:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfc00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047514.883218:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883224:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047514.883230:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047514.883234:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047514.883258:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883264:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047514.883280:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883287:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cfc00/0x4426598c0c775345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77534c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883296:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047514.883298:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047514.883300:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047514.883307:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047514.883327:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709336704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.883357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.883399:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709336832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.883431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.883469:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336704 00000100:00100000:0.0:1784047514.883473:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336704 00010000:00010000:0.0:1784047514.883492:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c77536f expref: 24 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.883511:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336832 00000100:00100000:0.0:1784047514.883514:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336832 00010000:00010000:0.0:1784047514.883524:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775345 expref: 25 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.883541:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1784047514.883548:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+25:3646:x1870705709336704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047514.883559:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047514.883564:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c77536f expref: 25 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883575:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c77536f expref: 25 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883590:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047514.883639:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+25:3646:x1870705709336704:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.883645:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1784047514.883658:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1784047514.883664:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709336832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047514.883672:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047514.883677:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775345 expref: 24 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883695:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775345 expref: 24 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.883704:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047514.883731:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709336832:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.883737:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1784047514.883777:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709336832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.883805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709336704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047514.884413:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775314 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884424:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775314 expref: 23 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884434:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336960:0@lo:104: 00000100:00100000:2.0:1784047514.884464:0:93087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047514.884543:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775306 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884565:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775306 expref: 23 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884575:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337088:0@lo:104: 00010000:00010000:2.0:1784047514.884626:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7752dc expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884634:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7752dc expref: 23 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884643:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337216:0@lo:104: 00010000:00010000:2.0:1784047514.884670:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884677:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 23 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884685:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337344:0@lo:104: 00010000:00010000:2.0:1784047514.884708:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884715:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884723:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337472:0@lo:104: 00010000:00010000:2.0:1784047514.884747:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884764:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 23 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884771:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337600:0@lo:104: 00010000:00010000:2.0:1784047514.884799:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884807:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 9 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884816:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337728:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047514.884870:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.884879:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 9 pid: 92458 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884887:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337856:192.168.204.40@tcp:104: 00000100:00100000:2.0:1784047514.884909:0:93087:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73d80 going to sleep for 11 seconds 00010000:00010000:2.0:1784047514.884926:0:93087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd7f800/0x4426598c0c775376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c77536f expref: 23 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884939:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336320:0@lo:104: 00010000:00010000:2.0:1784047514.884949:0:93087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbce00/0x4426598c0c77534c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775345 expref: 22 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047514.884957:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336448:0@lo:104: 00000100:00100000:1.0:1784047514.885127:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784047514.885148:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.885162:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.885171:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.885179:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.885186:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.885194:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336576 00000100:00100000:1.0:1784047514.885200:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336576 00000100:00100000:1.0:1784047514.885230:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709336960 00000100:00100000:1.0:1784047514.885233:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709336960 00000100:00100000:1.0:1784047514.885240:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709337088 00000100:00100000:1.0:1784047514.885242:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709337088 00000100:00100000:1.0:1784047514.885260:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709337216 00000100:00100000:1.0:1784047514.885262:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709337216 00000100:00100000:1.0:1784047514.885269:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709337344 00000100:00100000:1.0:1784047514.885271:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709337344 00000100:00100000:1.0:1784047514.885278:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709337472 00000100:00100000:1.0:1784047514.885280:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709337472 00000100:00100000:1.0:1784047514.885287:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709337600 00000100:00100000:1.0:1784047514.885290:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709337600 00000100:00100000:1.0:1784047514.885300:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784047514.885307:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+9:93087:x1870705709336576:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885319:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885373:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047514.885379:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+9:93087:x1870705709336576:12345-0@lo:104: Request processed in 72us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885385:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784047514.885399:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1784047514.885404:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+8:93087:x1870705709336960:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885411:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885437:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784047514.885441:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+8:93087:x1870705709336960:12345-0@lo:104: Request processed in 38us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885447:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1784047514.885480:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784047514.885486:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+7:93087:x1870705709337088:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885492:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885580:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784047514.885586:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+7:93087:x1870705709337088:12345-0@lo:104: Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885592:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784047514.885603:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1784047514.885630:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+6:93087:x1870705709337216:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885637:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885669:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784047514.885674:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+6:93087:x1870705709337216:12345-0@lo:104: Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885680:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1784047514.885693:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784047514.885699:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+5:93087:x1870705709337344:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885707:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885738:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1784047514.885743:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+5:93087:x1870705709337344:12345-0@lo:104: Request processed in 46us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885748:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784047514.885758:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784047514.885763:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:93087:x1870705709337472:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885769:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885802:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1784047514.885807:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:93087:x1870705709337472:12345-0@lo:104: Request processed in 44us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885813:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784047514.885825:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1784047514.885830:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:93087:x1870705709337600:12345-0@lo:104: 00010000:00010000:1.0:1784047514.885838:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885862:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1784047514.885866:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:93087:x1870705709337600:12345-0@lo:104: Request processed in 37us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.885872:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:1.0:1784047514.885889:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1784047514.885894:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885902:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.885906:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885915:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.885922:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.885929:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.885962:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885970:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.885988:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.885995:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775337 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886007:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784047514.886010:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886015:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbca00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.886017:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886023:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.886030:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.886034:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.886046:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886052:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.886066:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886082:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbca00/0x4426598c0c775314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77531b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886101:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784047514.886105:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886111:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.886114:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886120:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.886125:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.886130:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.886143:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886149:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.886155:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886160:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd800/0x4426598c0c775306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77530d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886170:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047514.886178:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886184:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.886187:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886194:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.886200:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.886204:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.886216:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886222:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.886227:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886233:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf800/0x4426598c0c7752dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7752e3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886241:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047514.886244:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886248:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7e800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.886251:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886266:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.886272:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.886277:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.886290:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886295:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.886299:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886306:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e800/0x4426598c0c7752c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7752c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886315:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047514.886318:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886323:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbd000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.886326:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886332:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.886338:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.886349:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.886365:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886370:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.886374:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886380:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c77528f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775296 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886389:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047514.886392:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886397:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd7f400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047514.886400:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886406:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047514.886411:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047514.886416:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047514.886426:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886432:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047514.886445:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886451:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd7f400/0x4426598c0c7751b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7751bd expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.886464:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047514.886466:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047514.886468:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047514.886475:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047514.886480:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047514.886486:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047514.886508:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709337984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047514.886662:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336576:0@lo:104: 00000100:00100000:2.0:1784047514.886671:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709336960:0@lo:104: 00000100:00100000:2.0:1784047514.886678:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337088:0@lo:104: 00000100:00100000:2.0:1784047514.886685:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337216:0@lo:104: 00000100:00100000:2.0:1784047514.886692:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337344:0@lo:104: 00000100:00100000:2.0:1784047514.886699:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337472:0@lo:104: 00000100:00100000:2.0:1784047514.886706:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337600:0@lo:104: 00000100:00100000:0.0:1784047514.886779:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.886814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.886855:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.886874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.886894:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784047514.886900:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.886919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.886935:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.886955:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047514.886985:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338112 00000100:00100000:0.0:1784047514.886991:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338112 00010000:00010000:0.0:1784047514.887015:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775314 expref: 22 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.887036:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338624 00000100:00100000:0.0:1784047514.887038:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338624 00010000:00010000:0.0:1784047514.887059:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.887075:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338240 00000100:00100000:0.0:1784047514.887078:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338240 00010000:00010000:0.0:1784047514.887088:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775306 expref: 24 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.887113:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338752 00000100:00100000:0.0:1784047514.887116:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338752 00010000:00010000:0.0:1784047514.887127:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 25 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.887140:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1784047514.887147:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+25:3645:x1870705709338112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047514.887157:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047514.887162:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775314 expref: 25 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.887171:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775314 expref: 25 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.887184:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbd400/0x4426598c0c77531b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775314 expref: 25 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.887197:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047514.887228:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709338112:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.887235:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1784047514.887401:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1784047514.887410:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709338624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047514.887418:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047514.887423:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887431:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887440:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc600/0x4426598c0c775296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c77528f expref: 23 pid: 92466 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887449:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047514.887473:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+22:3645:x1870705709338624:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047514.887480:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1784047514.887493:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1784047514.887499:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+21:3645:x1870705709338240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047514.887506:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047514.887517:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775306 expref: 21 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887737:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775306 expref: 21 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887748:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46000/0x4426598c0c77530d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775306 expref: 21 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887757:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047514.887783:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+20:3645:x1870705709338240:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047514.887788:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1784047514.887802:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1784047514.887808:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+19:3645:x1870705709338752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047514.887816:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047514.887820:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 19 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887828:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 19 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887838:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cfe00/0x4426598c0c7751bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7751b6 expref: 19 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.887845:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047514.887866:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+18:3645:x1870705709338752:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047514.887873:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1784047514.887978:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.887997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.888003:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.888010:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709338624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047514.888156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.888191:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709338496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047514.888212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047514.888226:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047514.888232:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709338368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047514.888249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047514.888273:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047514.888349:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709337984 00000100:00100000:0.0:1784047514.888354:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709337984 00010000:00010000:0.0:1784047514.888373:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775330 expref: 18 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.888398:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338496 00000100:00100000:0.0:1784047514.888401:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338496 00010000:00010000:0.0:1784047514.888413:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 19 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.888427:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338368 00000100:00100000:1.0:1784047514.888659:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1784047514.888669:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+19:3648:x1870705709337984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047514.888678:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047514.888683:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775330 expref: 19 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.888694:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775330 expref: 19 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.888719:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd7fe00/0x4426598c0c775337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775330 expref: 19 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.888728:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047514.888760:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+18:3648:x1870705709337984:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.888766:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1784047514.888781:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1784047514.888786:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+17:3648:x1870705709338496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047514.888794:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047514.888798:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 17 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.888806:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 17 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.888816:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c7752c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7752c0 expref: 17 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.888824:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047514.888845:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+16:3648:x1870705709338496:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.888851:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1784047514.888877:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709337984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047514.888885:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709338496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047514.888937:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338368 00010000:00010000:0.0:1784047514.888952:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7752dc expref: 16 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.888978:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1784047514.888984:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+16:3648:x1870705709338368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047514.888991:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047514.888994:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7752dc expref: 16 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.889002:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7752dc expref: 16 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.889012:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc200/0x4426598c0c7752e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7752dc expref: 16 pid: 92459 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.889027:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047514.889057:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+15:3648:x1870705709338368:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.889063:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1784047514.889105:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709338368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047514.895123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047514.895145:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337728:192.168.204.40@tcp:104: 00000100:00100000:2.0:1784047514.895166:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1870705709337856:192.168.204.40@tcp:104: 00000100:00100000:1.0:1784047514.895216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:2.0:1784047514.895230:0:93087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047514.895249:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474688 00000100:00100000:1.0:1784047514.895255:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474688 00010000:00010000:1.0:1784047514.895289:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 10 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047514.895332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474816 00000100:00100000:1.0:1784047514.895335:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474816 00010000:00010000:1.0:1784047514.895348:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 11 pid: 92458 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047514.895349:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2558 00000100:00100000:0.0:1784047514.895360:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f88e784-1ed8-4645-9d2f-1081095d1f30+11:2402:x1870705689474688:12345-192.168.204.40@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784047514.895365:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2559 00000100:00100000:1.0:1784047514.895370:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f88e784-1ed8-4645-9d2f-1081095d1f30+11:2402:x1870705689474816:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784047514.895376:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047514.895376:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047514.895381:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 11 pid: 92458 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.895382:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 11 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.895392:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 11 pid: 92458 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.899114:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 11 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.899150:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce400/0x4426598c0c77518c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3da expref: 11 pid: 92461 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047514.899169:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047514.899259:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689474688:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 3899us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047514.899270:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2558 00010000:00010000:2.0:1784047514.899687:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047514.901037:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c77517e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3cc expref: 9 pid: 92458 timeout: 3713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901061:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901071:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901104:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901128:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901135:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901143:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901151:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047514.901156:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.901166:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.901287:0:93087:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047514.901305:0:93087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.902380:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.902394:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46600/0x4426598c0c77568d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047514.902412:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047514.902997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:2402:x1870705689474816:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 7619us (7773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047514.903008:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2559 00000100:00100000:0.0:1784047515.410974:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709338880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047515.411055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047515.411224:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709338880 00000100:00100000:1.0:1784047515.411233:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709338880 00000100:00100000:1.0:1784047515.411313:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1784047515.411322:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709338880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047515.411365:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047515.411416:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709338880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047515.411423:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1784047515.411467:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968754 gen 2 00000100:00100000:1.0:1784047515.411489:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709338880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784047515.411635:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047515.411822:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047515.411831:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709339008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047515.411871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047515.412113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709339264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.412154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047515.412172:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339008 00000100:00100000:2.0:1784047515.412178:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339008 00000100:00100000:3.0:1784047515.412191:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709339776:0@lo:400:kworker.0 00000100:00100000:2.0:1784047515.412216:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1784047515.412226:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709339008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047515.412234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1784047515.412257:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047515.412261:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709340288:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.412303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047515.412307:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709339008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047515.412316:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:3.0:1784047515.412329:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784047515.412333:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339776 00000100:00100000:2.0:1784047515.412337:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339776 00000100:00100000:3.0:1784047515.412338:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709339136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047515.412364:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:2.0:1784047515.412373:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709339776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.412380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047515.412396:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709339648:0@lo:400:kworker.0 00000100:00100000:2.0:1784047515.412414:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709339776:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047515.412421:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1784047515.412426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047515.412433:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339136 00000100:00100000:2.0:1784047515.412438:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339136 00000100:00100000:3.0:1784047515.412449:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709340160:0@lo:400:kworker.0 00000100:00100000:2.0:1784047515.412465:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:2.0:1784047515.412473:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709339136:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047515.412478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1784047515.412494:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:3.0:1784047515.412508:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:3.0:1784047515.412515:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000100:00100000:2.0:1784047515.412532:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709339136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000004:00080000:3.0:1784047515.412534:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000100:00100000:2.0:1784047515.412541:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000020:00080000:3.0:1784047515.412543:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99cccc3dc780 refcount 2 committed 0 result 0 batchid 73014444091 00000020:00080000:3.0:1784047515.412549:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ccf2f47c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99cccc3dc900 00000020:00080000:3.0:1784047515.412553:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].3 00000020:00080000:3.0:1784047515.412556:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ccf2f47200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ccff2b6e00 00000020:00080000:3.0:1784047515.412559:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].3 00000100:00100000:2.0:1784047515.412567:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339264 00000100:00100000:2.0:1784047515.412571:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339264 00000100:00100000:3.0:1784047515.412581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709339776:0@lo:400:kworker.0 00000100:00100000:2.0:1784047515.412632:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339648 00000100:00100000:3.0:1784047515.412634:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709339136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047515.412637:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339648 00000100:00100000:2.0:1784047515.412661:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340160 00000100:00100000:2.0:1784047515.412664:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340160 00000020:00080000:3.0:1784047515.412665:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444091 committed batchid 73014444090 00000100:00100000:2.0:1784047515.412680:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1784047515.412688:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047515.412725:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709339264:12345-0@lo:400:kworker.0 Request processed in 38us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047515.412732:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000020:00080000:3.0:1784047515.412736:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000100:00100000:2.0:1784047515.412747:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1784047515.412751:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709339520:0@lo:400:kworker.0 00000100:00100000:2.0:1784047515.412756:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709339648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.412789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047515.412845:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339520 00000100:00100000:0.0:1784047515.412850:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339520 00000100:00100000:1.0:1784047515.412880:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340288 00000100:00100000:0.0:1784047515.412882:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1784047515.412887:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340288 00000100:00100000:0.0:1784047515.412894:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709340160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.412955:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709340032:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.412981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047515.413006:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784047515.413012:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709339392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047515.413053:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709339904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047515.413105:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709340416:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047515.413153:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340032 00000100:00100000:3.0:1784047515.413156:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340032 00000100:00100000:3.0:1784047515.413184:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339904 00000100:00100000:3.0:1784047515.413187:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339904 00000100:00100000:3.0:1784047515.413208:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:3.0:1784047515.413215:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709340288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413248:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709340288:12345-0@lo:400:kworker.0 Request processed in 34us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047515.413255:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:3.0:1784047515.413267:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:3.0:1784047515.413273:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709340032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413303:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709340032:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047515.413308:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:3.0:1784047515.413321:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:3.0:1784047515.413327:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709339904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413352:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3648:x1870705709339904:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047515.413358:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:3.0:1784047515.413396:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709339904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413407:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709340032:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413443:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709339648:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413452:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968755 gen 2 00000100:00100000:3.0:1784047515.413462:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709340288:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413472:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709339264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413505:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709339392 00000100:00100000:3.0:1784047515.413508:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709339392 00000100:00100000:3.0:1784047515.413528:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340416 00000100:00100000:3.0:1784047515.413531:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340416 00000100:00100000:3.0:1784047515.413543:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1784047515.413549:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709339520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413591:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709339520:12345-0@lo:400:kworker.0 Request processed in 42us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047515.413598:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1784047515.413636:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1784047515.413644:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709339392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413672:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709339392:12345-0@lo:400:kworker.0 Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047515.413677:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1784047515.413689:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1784047515.413695:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709340416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413722:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709340416:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047515.413728:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1784047515.413762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709339008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047515.413800:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709339392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413812:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709340416:0@lo:400:kworker.0 00000100:00100000:3.0:1784047515.413825:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709339520:0@lo:400:kworker.0 00000100:00080000:1.0:1784047515.413828:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047515.413834:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047515.413838:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047515.413841:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047515.414943:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709339648:12345-0@lo:400:kworker.0 Request processed in 2184us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047515.414954:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1784047515.416995:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709340160:12345-0@lo:400:kworker.0 Request processed in 4094us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047515.417010:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1784047515.417118:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709340160:0@lo:400:kworker.0 00010000:00010000:2.0:1784047515.922864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047515.922942:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784047515.922970:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709340544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047515.923048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047515.923109:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340544 00000100:00100000:2.0:1784047515.923120:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340544 00000100:00100000:2.0:1784047515.923191:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:2.0:1784047515.923203:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709340544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047515.923258:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047515.923312:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709340544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047515.923320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1784047515.923428:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709340544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047516.167708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047516.169333:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689474944 00000100:00100000:3.0:1784047516.169348:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689474944 00000100:00100000:3.0:1784047516.169415:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:3.0:1784047516.169428:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689474944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.169446:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047516.169466:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae42e expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.169493:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.169505:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.169515:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88400, rc 0) 00000100:00100000:3.0:1784047516.169666:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689474944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 239us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.169674:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:3.0:1784047516.175587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047516.175722:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475072 00000100:00100000:1.0:1784047516.175732:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475072 00000100:00100000:1.0:1784047516.175789:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:1.0:1784047516.175800:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689475072:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.175984:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689475072:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 185us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.175993:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:0.0:1784047516.178396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047516.178496:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475200 00000100:00100000:1.0:1784047516.178527:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475200 00000100:00100000:1.0:1784047516.178588:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1784047516.178599:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689475200:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.178797:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689475200:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 199us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.178806:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:2.0:1784047516.189084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047516.189478:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475328 00000100:00100000:0.0:1784047516.189489:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475328 00000100:00100000:0.0:1784047516.189562:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:0.0:1784047516.189576:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71912:x1870705689475328:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784047516.190131:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71912:x1870705689475328:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 555us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.190142:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:0.0:1784047516.204991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047516.205121:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475456 00000100:00100000:1.0:1784047516.205138:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475456 00000100:00100000:1.0:1784047516.205217:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1784047516.205229:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71912:x1870705689475456:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784047516.205597:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71912:x1870705689475456:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 369us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.205642:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:3.0:1784047516.212864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047516.213210:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475584 00000100:00100000:1.0:1784047516.213221:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475584 00000100:00100000:1.0:1784047516.213289:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:1.0:1784047516.213300:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689475584:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047516.213325:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047516.213345:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae435 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.213374:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 10 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.213385:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 10 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.213412:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbfa00, rc 0) 00000100:00100000:1.0:1784047516.213477:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689475584:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 178us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.213484:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:2.0:1784047516.215232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047516.215330:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475712 00000100:00100000:1.0:1784047516.215341:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475712 00000100:00100000:1.0:1784047516.215392:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:1.0:1784047516.215402:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689475712:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.215672:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689475712:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 271us (446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047516.215681:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 10000000:01000000:1.0:1784047516.626741:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047516.626751:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc832f800 from 52 10000000:01000000:1.0:1784047516.626756:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047516.626811:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.626824:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.626836:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047516.626864:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709340672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.626952:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047516.627007:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.627247:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340672 00000100:00100000:3.0:1784047516.627268:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340672 00000100:00100000:3.0:1784047516.627336:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784047516.627353:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709340672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.627366:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047516.627381:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756a2 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.627403:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 16 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.627414:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 16 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.627422:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89200, rc 0) 00000100:00100000:3.0:1784047516.627476:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709340672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.627483:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784047516.627689:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709340672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047516.627705:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.627714:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047516.627778:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709340800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.627804:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047516.627830:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.627892:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340800 00000100:00100000:0.0:1784047516.627897:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340800 00000100:00100000:0.0:1784047516.627938:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784047516.627946:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709340800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.628088:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709340800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.628096:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784047516.628325:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709340800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.628357:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709340928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.628397:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.628420:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.628517:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709340928 00000100:00100000:1.0:1784047516.628521:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709340928 00000100:00100000:1.0:1784047516.628556:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784047516.628563:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709340928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.628663:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709340928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.628669:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784047516.628843:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709340928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.629335:0:93088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93088:1870705709341056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.629377:0:93088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047516.629407:0:93088:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.629514:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341056 00000100:00100000:0.0:1784047516.629519:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341056 00000100:00100000:0.0:1784047516.629566:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784047516.629574:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:93088:x1870705709341056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047516.629694:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:93088:x1870705709341056:12345-0@lo:502:llog_process_th.0 Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.629701:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784047516.629868:0:93088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93088:1870705709341056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047516.629911:0:93088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93088:1870705709341184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047516.629954:0:93088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.629980:0:93088:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.630161:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341184 00000100:00100000:3.0:1784047516.630166:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341184 00000100:00100000:3.0:1784047516.630201:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784047516.630208:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:93088:x1870705709341184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.630294:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:93088:x1870705709341184:12345-0@lo:502:llog_process_th.0 Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.630301:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784047516.630426:0:93088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93088:1870705709341184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784047516.630446:0:93088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1784047516.630624:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1784047516.630643:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047516.630652:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.630663:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047516.630683:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784047516.630686:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:1.0:1784047516.630688:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784047516.630710:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.630718:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.630726:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047516.630739:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709341312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.630768:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047516.630788:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.630800:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341312 00000100:00100000:1.0:1784047516.630804:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341312 00000100:00100000:1.0:1784047516.631390:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784047516.631399:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709341312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047516.631409:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047516.631420:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756b0 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.631439:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 17 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.631449:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 17 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.631468:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbf800, rc 0) 00000100:00100000:1.0:1784047516.631507:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709341312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.631512:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784047516.631571:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709341312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047516.631585:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.631593:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047516.631678:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709341440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.631703:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.631949:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.632004:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341440 00000100:00100000:0.0:1784047516.632008:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341440 00000100:00100000:0.0:1784047516.632039:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784047516.632046:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709341440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.632406:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709341440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.632413:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784047516.632670:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709341440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.632702:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709341568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.632740:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.632797:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.632824:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341568 00000100:00100000:0.0:1784047516.632828:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341568 00000100:00100000:0.0:1784047516.632886:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784047516.632893:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709341568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.632983:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709341568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.632989:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784047516.633045:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709341568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.633595:0:93089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93089:1870705709341696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047516.633648:0:93089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.633900:0:93089:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73000 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.634028:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341696 00000100:00100000:1.0:1784047516.634034:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341696 00000100:00100000:1.0:1784047516.634080:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784047516.634088:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:93089:x1870705709341696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.634183:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:93089:x1870705709341696:12345-0@lo:502:llog_process_th.0 Request processed in 95us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.634190:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784047516.634470:0:93089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93089:1870705709341696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047516.634495:0:93089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047516.634506:0:93089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047516.634509:0:93089:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1784047516.634515:0:93089:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1784047516.634684:0:93089:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:2.0:1784047516.636004:0:93089:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:0.0:1784047516.642654:0:93089:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:0.0:1784047516.645891:0:93089:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:0.0:1784047516.655899:0:93089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93089:1870705709341824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047516.655984:0:93089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047516.656077:0:93089:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe6799c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.662414:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341824 00000100:00100000:1.0:1784047516.662431:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341824 00000100:00100000:1.0:1784047516.662495:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784047516.662505:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:93089:x1870705709341824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.662709:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:93089:x1870705709341824:12345-0@lo:502:llog_process_th.0 Request processed in 204us (6724us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.662718:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784047516.662987:0:93089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93089:1870705709341824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047516.663051:0:93089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93089:1870705709341952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047516.663191:0:93089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047516.663269:0:93089:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfe6799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.664674:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709341952 00000100:00100000:2.0:1784047516.664686:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709341952 00000100:00100000:2.0:1784047516.664865:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784047516.664876:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:93089:x1870705709341952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047516.665015:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:93089:x1870705709341952:12345-0@lo:502:llog_process_th.0 Request processed in 140us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.665031:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784047516.665125:0:93089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93089:1870705709341952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784047516.665156:0:93089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047516.665163:0:93089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047516.665165:0:93089:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:0.0:1784047516.665170:0:93089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:1.0:1784047516.665456:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:1.0:1784047516.665480:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784047516.665491:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.665502:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047516.665522:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047516.665525:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 52 10000000:01000000:1.0:1784047516.665528:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047516.665558:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.665566:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.665576:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047516.665597:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.665678:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047516.665932:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.666049:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342080 00000100:00100000:3.0:1784047516.666054:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342080 00000100:00100000:3.0:1784047516.666114:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784047516.666122:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709342080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.666132:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047516.666146:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756be expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.666177:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756be expref: 18 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.666188:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756be expref: 18 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.666197:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88e00, rc 0) 00000100:00100000:3.0:1784047516.666236:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709342080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.666242:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784047516.666292:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.666307:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.666317:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.666377:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.666404:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.666417:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799de40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.666429:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342208 00000100:00100000:3.0:1784047516.666432:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342208 00000100:00100000:3.0:1784047516.666450:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784047516.666455:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709342208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.666566:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709342208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.666582:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784047516.666631:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.666660:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.666698:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.666712:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799de40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.666723:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342336 00000100:00100000:3.0:1784047516.666726:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342336 00000100:00100000:3.0:1784047516.666938:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784047516.666944:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709342336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.667013:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709342336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.667020:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784047516.667054:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.667375:0:93090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93090:1870705709342464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.667407:0:93090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.667426:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342464 00000100:00100000:3.0:1784047516.667429:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342464 00000100:00100000:3.0:1784047516.667446:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784047516.667451:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:93090:x1870705709342464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.667526:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:93090:x1870705709342464:12345-0@lo:502:llog_process_th.0 Request processed in 74us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.667533:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784047516.667560:0:93090:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799d240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.667572:0:93090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93090:1870705709342464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.667633:0:93090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93090:1870705709342592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.667662:0:93090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.667679:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342592 00000100:00100000:3.0:1784047516.667682:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342592 00000100:00100000:3.0:1784047516.667698:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784047516.667703:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:93090:x1870705709342592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.667932:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:93090:x1870705709342592:12345-0@lo:502:llog_process_th.0 Request processed in 228us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.667939:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784047516.667966:0:93090:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.667978:0:93090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93090:1870705709342592:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784047516.667996:0:93090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1784047516.668046:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784047516.668073:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047516.668082:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668092:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047516.668112:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784047516.668115:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784047516.668119:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784047516.668139:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668148:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668162:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.668175:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.668201:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.668214:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.668227:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342720 00000100:00100000:3.0:1784047516.668230:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342720 00000100:00100000:3.0:1784047516.668246:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784047516.668251:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709342720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.668259:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047516.668384:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756cc expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668404:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756cc expref: 19 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668414:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756cc expref: 19 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668422:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89000, rc 0) 00000100:00100000:3.0:1784047516.668451:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709342720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.668456:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784047516.668484:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.668495:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.668510:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.668549:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.668571:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.668592:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff363240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047516.668602:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342848 00000100:00100000:3.0:1784047516.668626:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342848 00000100:00100000:3.0:1784047516.668646:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784047516.668652:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709342848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.668916:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709342848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.668923:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784047516.669081:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.669178:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.669219:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.669283:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.669398:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709342976 00000100:00100000:0.0:1784047516.669404:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709342976 00000100:00100000:3.0:1784047516.669490:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784047516.669498:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709342976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.669637:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709342976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047516.669645:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784047516.669922:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709342976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.670345:0:93091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93091:1870705709343104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.670385:0:93091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.670418:0:93091:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.670591:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343104 00000100:00100000:1.0:1784047516.670596:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343104 00000100:00100000:1.0:1784047516.670649:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784047516.670656:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:93091:x1870705709343104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.671372:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:93091:x1870705709343104:12345-0@lo:502:llog_process_th.0 Request processed in 714us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.671381:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784047516.671511:0:93091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93091:1870705709343104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047516.671541:0:93091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047516.671574:0:93091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047516.671583:0:93091:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:3.0:1784047516.671590:0:93091:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1784047516.671685:0:93091:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1784047516.671718:0:93091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93091:1870705709343232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.671767:0:93091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.671794:0:93091:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.671889:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343232 00000100:00100000:2.0:1784047516.671895:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343232 00000100:00100000:2.0:1784047516.671933:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784047516.671942:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:93091:x1870705709343232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047516.672035:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:93091:x1870705709343232:12345-0@lo:502:llog_process_th.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.672042:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784047516.672140:0:93091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93091:1870705709343232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.672173:0:93091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93091:1870705709343360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.672203:0:93091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.672231:0:93091:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.672390:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343360 00000100:00100000:2.0:1784047516.672395:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343360 00000100:00100000:2.0:1784047516.672424:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784047516.672431:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:93091:x1870705709343360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047516.672496:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:93091:x1870705709343360:12345-0@lo:502:llog_process_th.0 Request processed in 65us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.672503:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784047516.672641:0:93091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93091:1870705709343360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047516.672660:0:93091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047516.672665:0:93091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047516.672667:0:93091:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:3.0:1784047516.672670:0:93091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1784047516.675473:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1784047516.675523:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784047516.675538:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.675575:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047516.675587:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047516.675590:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 52 10000000:01000000:2.0:1784047516.675593:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047516.675662:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.675670:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.675680:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047516.675707:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709343488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.675828:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.675877:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.676509:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343488 00000100:00100000:0.0:1784047516.676519:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343488 00000100:00100000:0.0:1784047516.676637:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784047516.676647:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709343488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047516.676662:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047516.676678:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756da expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.676702:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756da expref: 20 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.676713:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756da expref: 20 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.676722:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601e00, rc 0) 00000100:00100000:0.0:1784047516.676785:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709343488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.676792:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784047516.676919:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709343488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.676937:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.676947:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.677027:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709343616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.677073:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.679217:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.679941:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343616 00000100:00100000:2.0:1784047516.679952:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343616 00000100:00100000:2.0:1784047516.680015:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784047516.680026:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709343616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.680217:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709343616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.680226:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784047516.680360:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709343616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.680434:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709343744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.680483:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.680518:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.680560:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343744 00000100:00100000:0.0:1784047516.680565:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343744 00000100:00100000:0.0:1784047516.680679:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784047516.680687:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709343744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.680938:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709343744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.680946:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784047516.681075:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709343744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.681634:0:93092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93092:1870705709343872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.681677:0:93092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.681707:0:93092:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.681817:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709343872 00000100:00100000:0.0:1784047516.681822:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709343872 00000100:00100000:0.0:1784047516.681857:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784047516.681865:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:93092:x1870705709343872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047516.681966:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:93092:x1870705709343872:12345-0@lo:502:llog_process_th.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.681974:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784047516.682009:0:93092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93092:1870705709343872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.682047:0:93092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93092:1870705709344000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.682873:0:93092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.682948:0:93092:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.682983:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344000 00000100:00100000:1.0:1784047516.682989:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344000 00000100:00100000:1.0:1784047516.683027:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784047516.683035:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:93092:x1870705709344000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.683314:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:93092:x1870705709344000:12345-0@lo:502:llog_process_th.0 Request processed in 225us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.683329:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784047516.683521:0:93092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93092:1870705709344000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784047516.683549:0:93092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1784047516.683831:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1784047516.683851:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047516.683861:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.683878:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047516.683888:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784047516.683890:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784047516.683893:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784047516.683920:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.683927:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.683935:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047516.683952:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.683990:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.684978:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.685075:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344128 00000100:00100000:1.0:1784047516.685083:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344128 00000100:00100000:1.0:1784047516.685174:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784047516.685184:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709344128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047516.685198:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047516.685212:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756e8 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.685236:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 21 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.685247:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 21 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.685270:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbf600, rc 0) 00000100:00100000:1.0:1784047516.685332:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709344128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.685338:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784047516.685410:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047516.685427:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.685437:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.686163:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.686207:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.686431:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.686554:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344256 00000100:00100000:0.0:1784047516.686561:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344256 00000100:00100000:0.0:1784047516.686670:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784047516.686679:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709344256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.688468:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709344256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1783us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.688481:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784047516.688686:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.688737:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.688790:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.688824:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.688896:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344384 00000100:00100000:1.0:1784047516.688902:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344384 00000100:00100000:1.0:1784047516.688939:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784047516.688948:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709344384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.689052:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709344384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.689069:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784047516.689554:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047516.690900:0:93093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784047516.691141:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784047516.691174:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784047516.691185:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.691197:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047516.691206:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047516.691209:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 52 10000000:01000000:3.0:1784047516.691212:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047516.691243:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.691535:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.691547:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.691573:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.691679:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.691717:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.691816:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344512 00000100:00100000:0.0:1784047516.691824:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344512 00000100:00100000:0.0:1784047516.691876:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784047516.691887:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709344512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047516.691900:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047516.691915:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7756f6 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.691951:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 22 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.691961:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 22 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.691970:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600000, rc 0) 00000100:00100000:0.0:1784047516.692014:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709344512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.692021:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784047516.692189:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047516.692204:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047516.692213:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047516.692282:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.692587:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.692649:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.692756:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344640 00000100:00100000:2.0:1784047516.692762:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344640 00000100:00100000:2.0:1784047516.692804:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784047516.692812:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709344640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.692938:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709344640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.692945:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784047516.693033:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.693075:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.693194:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.693218:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.693265:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344768 00000100:00100000:0.0:1784047516.693269:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344768 00000100:00100000:0.0:1784047516.693398:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784047516.693405:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709344768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.693487:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709344768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.693493:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784047516.693552:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709344768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047516.693967:0:93094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93094:1870705709344896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.694000:0:93094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.694467:0:93094:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.694528:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709344896 00000100:00100000:1.0:1784047516.694542:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709344896 00000100:00100000:1.0:1784047516.694582:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784047516.694589:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:93094:x1870705709344896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.694711:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:93094:x1870705709344896:12345-0@lo:502:llog_process_th.0 Request processed in 123us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.694719:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784047516.695163:0:93094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93094:1870705709344896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.695218:0:93094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93094:1870705709345024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047516.695409:0:93094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047516.695472:0:93094:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.695511:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345024 00000100:00100000:1.0:1784047516.695516:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345024 00000100:00100000:1.0:1784047516.695583:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784047516.695593:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:93094:x1870705709345024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047516.695713:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:93094:x1870705709345024:12345-0@lo:502:llog_process_th.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.695722:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784047516.695806:0:93094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93094:1870705709345024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784047516.695826:0:93094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1784047516.696044:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1784047516.696078:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047516.696092:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.696116:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047516.696126:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784047516.696130:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784047516.696133:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784047516.696164:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.696173:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.696183:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047516.696202:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.696240:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.696918:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.696998:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345152 00000100:00100000:0.0:1784047516.697005:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345152 00000100:00100000:0.0:1784047516.697070:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784047516.697080:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709345152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047516.697095:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047516.697208:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775704 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.697236:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775704 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.697402:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775704 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.697413:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601000, rc 0) 00000100:00100000:0.0:1784047516.697476:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709345152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 398us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047516.697484:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784047516.697640:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047516.697665:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.697675:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047516.697803:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.697833:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.697848:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047516.697901:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345280 00000100:00100000:1.0:1784047516.697907:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345280 00000100:00100000:1.0:1784047516.698014:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784047516.698025:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709345280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.698179:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709345280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047516.698187:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784047516.698472:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.698500:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.698535:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047516.698554:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.698565:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345408 00000100:00100000:2.0:1784047516.698568:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345408 00000100:00100000:2.0:1784047516.698584:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784047516.698589:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709345408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047516.698675:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709345408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.698682:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784047516.698718:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047516.699725:0:93095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1784047516.700200:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1784047516.700228:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784047516.700238:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.700472:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047516.700486:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784047516.700489:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047516.700492:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784047516.700537:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.700545:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.700557:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047516.700584:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.700911:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047516.701077:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047516.701204:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345536 00000100:00100000:2.0:1784047516.701211:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345536 00000100:00100000:2.0:1784047516.701298:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784047516.701426:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709345536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047516.701447:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047516.701461:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775712 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.701484:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775712 expref: 24 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.701494:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775712 expref: 24 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.701503:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47a00, rc 0) 00000100:00100000:2.0:1784047516.701547:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709345536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047516.701554:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784047516.701641:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047516.701658:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047516.701667:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047516.701753:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047516.701785:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047516.702000:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047516.702071:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345664 00000100:00100000:0.0:1784047516.702076:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345664 00000100:00100000:0.0:1784047516.702201:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784047516.702209:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709345664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047516.702298:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709345664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (512us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047516.702317:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784047516.702529:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709345664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784047516.702558:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784047516.702565:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047516.702575:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047516.947345:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784047516.948487:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968756 is committed 00000100:00100000:3.0:1784047517.317154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047517.317202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047517.317238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047517.317269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047517.317354:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475968 00000100:00100000:2.0:1784047517.317363:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475968 00000100:00100000:2.0:1784047517.317433:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476096 00000100:00100000:2.0:1784047517.317436:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476096 00000100:00100000:2.0:1784047517.317463:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1352 00000100:00100000:2.0:1784047517.317474:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689475968:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047517.317548:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689475968:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047517.317558:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1352 00000100:00100000:2.0:1784047517.317574:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1353 00000100:00100000:2.0:1784047517.317581:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689476096:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047517.317637:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689476096:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047517.317660:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1353 00000100:00100000:1.0:1784047517.317987:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689475840 00000100:00100000:1.0:1784047517.317993:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689475840 00000100:00100000:1.0:1784047517.318040:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:1.0:1784047517.318057:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689475840:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047517.318096:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689475840:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047517.318103:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:1.0:1784047517.318136:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476224 00000100:00100000:1.0:1784047517.318140:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476224 00000100:00100000:1.0:1784047517.318169:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2611 00000100:00100000:1.0:1784047517.318175:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689476224:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047517.318202:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689476224:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047517.318209:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2611 00000100:00080000:3.0:1784047517.318509:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047517.318515:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047517.318517:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047517.971904:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709345792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047517.972014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047517.972099:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047517.972118:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345792 00000100:00100000:0.0:1784047517.972128:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345792 00000100:00100000:0.0:1784047517.972204:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:0.0:1784047517.972217:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709345792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047517.972261:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047517.972314:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709345792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047517.972340:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00080000:0.0:1784047517.972367:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047517.972417:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709345792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047517.977141:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047517.977176:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709345920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047517.977275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047517.977349:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709345920 00000100:00100000:0.0:1784047517.977360:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709345920 00000100:00100000:0.0:1784047517.977440:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1784047517.977451:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709345920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047517.977509:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047517.977568:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709345920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047517.977577:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00080000:0.0:1784047517.977634:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047517.977675:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968756 gen 2 00000004:00080000:0.0:1784047517.977683:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cce3d20380, transno 4294968756 00000100:00100000:0.0:1784047517.977707:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709345920:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1784047518.981497:0:93192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd6e834460 20000000:00000080:1.0:1784047518.981517:0:93192:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99ccecd71800 uarg=0000000000000000 00000040:00100000:1.0:1784047518.982198:0:93192:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:1.0:1784047518.982205:0:93192:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:1.0:1784047518.982286:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:1.0:1784047518.982303:0:93192:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784047518.982317:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:1.0:1784047518.982341:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:1.0:1784047518.982389:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:1.0:1784047518.982396:0:93192:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784047518.982408:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:1.0:1784047518.982421:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:1.0:1784047518.982465:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:1.0:1784047518.982471:0:93192:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784047518.982484:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:1.0:1784047518.982499:0:93192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:1.0:1784047518.982508:0:93192:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784047518.982527:0:93192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982548:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982556:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 9 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982565:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982572:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982579:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756be expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982586:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756cc expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982593:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756da expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982631:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982639:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982646:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775704 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982653:0:93192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775712 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982661:0:93192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982702:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775712 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982715:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775712 expref: 23 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.982730:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346048:0@lo:104: 00000100:00100000:1.0:1784047518.982793:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047518.982845:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775704 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982853:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775704 expref: 23 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.982873:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346176:0@lo:104: 00000100:00100000:1.0:1784047518.982903:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047518.982926:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982934:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 23 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.982941:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346304:0@lo:104: 00010000:00010000:1.0:1784047518.982969:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.982976:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 23 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.982983:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346432:0@lo:104: 00010000:00010000:1.0:1784047518.983003:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756da expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.983010:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756da expref: 23 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047518.983124:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784047518.983150:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.983170:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.983178:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346048 00000100:00100000:3.0:1784047518.983184:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346048 00000100:00100000:3.0:1784047518.983224:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346176 00000100:00100000:3.0:1784047518.983227:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346176 00000100:00100000:3.0:1784047518.983237:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346304 00000100:00100000:3.0:1784047518.983239:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346304 00000100:00100000:3.0:1784047518.983246:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346432 00000100:00100000:3.0:1784047518.983248:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346432 00000100:00100000:3.0:1784047518.983261:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784047518.983269:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+6:93192:x1870705709346048:12345-0@lo:104: 00010000:00010000:3.0:1784047518.983281:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983334:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784047518.983340:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+6:93192:x1870705709346048:12345-0@lo:104: Request processed in 72us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.983347:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784047518.983363:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784047518.983368:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccecd70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+5:93192:x1870705709346176:12345-0@lo:104: 00010000:00010000:3.0:1784047518.983375:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983405:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784047518.983410:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccecd70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+5:93192:x1870705709346176:12345-0@lo:104: Request processed in 42us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.983415:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784047518.983442:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784047518.983448:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+4:93192:x1870705709346304:12345-0@lo:104: 00010000:00010000:3.0:1784047518.983461:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983493:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784047518.983498:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+4:93192:x1870705709346304:12345-0@lo:104: Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.983504:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784047518.983516:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784047518.983522:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709346432:12345-0@lo:104: 00010000:00010000:3.0:1784047518.983528:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983559:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784047518.983563:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709346432:12345-0@lo:104: Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.983569:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:3.0:1784047518.983692:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047518.983698:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983706:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047518.983710:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983719:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047518.983726:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047518.983739:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047518.983773:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983779:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047518.983797:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983804:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983816:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047518.983819:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983824:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047518.983827:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983834:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047518.983840:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047518.983846:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047518.983854:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983860:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047518.983870:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983877:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47c00/0x4426598c0c775704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c77570b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983885:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047518.983887:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983893:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047518.983896:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983902:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047518.983908:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047518.983913:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047518.983921:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983926:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047518.983938:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983944:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cce3b88c00/0x4426598c0c7756f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756fd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983951:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047518.983958:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983965:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047518.983968:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.983974:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047518.983980:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047518.983986:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047518.983995:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.984001:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047518.984005:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.984025:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c7756e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756ef expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.984033:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047518.984035:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047518.984037:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047518.984049:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709346688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.984076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.984104:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047518.984109:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709346816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.984133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.984154:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709346944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.984171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.984186:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047518.984190:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709347072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.984210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.984238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346688 00000100:00100000:3.0:1784047518.984242:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346688 00010000:00010000:3.0:1784047518.984263:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775712 expref: 24 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047518.984284:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346816 00000100:00100000:3.0:1784047518.984287:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346816 00010000:00010000:3.0:1784047518.984297:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775704 expref: 25 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047518.984311:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346944 00000100:00100000:3.0:1784047518.984314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346944 00010000:00010000:3.0:1784047518.984323:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 26 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047518.984337:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709347072 00000100:00100000:3.0:1784047518.984340:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709347072 00010000:00010000:3.0:1784047518.984350:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 27 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047518.984362:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1784047518.984369:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+27:3647:x1870705709346688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047518.984380:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047518.984391:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775712 expref: 27 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.984460:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047518.984465:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047518.984470:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047518.984486:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1784047518.984495:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+27:3647:x1870705709346816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047518.984503:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047518.984508:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775704 expref: 27 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047518.986491:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:0.0:1784047518.986512:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+27:3645:x1870705709346944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047518.986530:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047518.986538:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 27 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.986651:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346560:0@lo:104: 00000100:00100000:1.0:1784047518.986715:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047518.986800:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775712 expref: 27 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.986827:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047518.986872:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+27:3647:x1870705709346688:12345-0@lo:103:ldlm_bl.0 Request processed in 2503us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.986880:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1784047518.986908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1784047518.986928:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709347072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047518.986938:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047518.986943:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 26 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.986951:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 26 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.986961:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047518.986986:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709347072:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.986992:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1784047518.987154:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709347072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.987183:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709346688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.987201:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709346560 00000100:00100000:3.0:1784047518.987206:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709346560 00000100:00100000:3.0:1784047518.987239:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784047518.987256:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709346560:12345-0@lo:104: 00010000:00010000:3.0:1784047518.987266:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987303:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784047518.987308:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709346560:12345-0@lo:104: Request processed in 53us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.987314:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:3.0:1784047518.987328:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047518.987333:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987341:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047518.987345:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987353:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047518.987360:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047518.987366:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047518.987395:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987402:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047518.987421:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987439:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47200/0x4426598c0c7756da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987452:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047518.987454:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047518.987455:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047518.987476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709347200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047518.987501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.987536:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709347200 00000100:00100000:3.0:1784047518.987539:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709347200 00010000:00010000:3.0:1784047518.987554:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756da expref: 26 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047518.987568:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1784047518.987574:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+26:3647:x1870705709347200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047518.987582:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047518.987585:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756da expref: 26 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987594:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756da expref: 26 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047518.987625:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047518.987653:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+26:3647:x1870705709347200:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.987659:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1784047518.987682:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709347200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047518.987876:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775704 expref: 25 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.987888:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047518.987985:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709346816:12345-0@lo:103:ldlm_bl.0 Request processed in 3493us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047518.987992:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1784047518.988111:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709346816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047518.988241:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 24 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.988260:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047518.988331:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709346944:12345-0@lo:103:ldlm_bl.0 Request processed in 1828us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047518.988338:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00010000:00010000:1.0:1784047518.988530:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756cc expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.988544:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756cc expref: 23 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.988563:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347328:0@lo:104: 00000100:00100000:1.0:1784047518.988591:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047518.988691:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756be expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.988699:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756be expref: 23 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.988707:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347456:0@lo:104: 00000100:00100000:1.0:1784047518.988729:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047518.988769:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709346944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047518.988876:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.988885:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 23 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.988893:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347584:0@lo:104: 00000100:00100000:1.0:1784047518.988911:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047518.988990:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709347328 00000100:00100000:2.0:1784047518.988996:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709347328 00000100:00100000:0.0:1784047518.989084:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709347456 00000100:00100000:0.0:1784047518.989088:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709347456 00000100:00100000:0.0:1784047518.989100:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1784047518.989107:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:93192:x1870705709347328:12345-0@lo:104: 00010000:00010000:0.0:1784047518.989118:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.989158:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047518.989164:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:93192:x1870705709347328:12345-0@lo:104: Request processed in 57us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047518.989170:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1784047518.989182:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1784047518.989187:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709347456:12345-0@lo:104: 00010000:00010000:0.0:1784047518.989193:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.989219:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784047518.989224:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709347456:12345-0@lo:104: Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047518.989230:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:1.0:1784047518.989287:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 23 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989296:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 23 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989304:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347712:0@lo:104: 00000100:00100000:1.0:1784047518.989324:0:93192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047518.989341:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 9 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989360:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 9 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989370:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347840:192.168.204.40@tcp:104: 00010000:00010000:1.0:1784047518.989417:0:93192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 9 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989427:0:93192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 9 pid: 92458 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989447:0:93192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347968:192.168.204.40@tcp:104: 00000100:00100000:1.0:1784047518.989469:0:93192:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f840 going to sleep for 11 seconds 00010000:00010000:1.0:1784047518.989484:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c775719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775712 expref: 23 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989497:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346048:0@lo:104: 00010000:00010000:1.0:1784047518.989507:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601000/0x4426598c0c77570b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775704 expref: 22 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989515:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346176:0@lo:104: 00010000:00010000:1.0:1784047518.989523:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600000/0x4426598c0c7756fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756f6 expref: 21 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989531:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346304:0@lo:104: 00010000:00010000:1.0:1784047518.989541:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbf600/0x4426598c0c7756ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756e8 expref: 20 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989560:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346432:0@lo:104: 00010000:00010000:1.0:1784047518.989572:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601e00/0x4426598c0c7756e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756da expref: 19 pid: 92459 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047518.989580:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709346560:0@lo:104: 00000100:00100000:1.0:1784047518.989587:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347328:0@lo:104: 00000100:00100000:1.0:1784047518.989593:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347456:0@lo:104: 00010000:00010000:1.0:1784047518.989655:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047518.989661:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989668:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047518.989673:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989687:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047518.989694:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047518.989701:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047518.989727:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989734:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047518.989751:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989768:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cce3b89600/0x4426598c0c7756cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989780:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047518.989783:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989789:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047518.989792:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989799:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047518.989805:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047518.989810:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047518.989823:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989829:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047518.989841:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989849:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c7756be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047518.989857:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047518.989862:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047518.989864:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047518.990133:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784047518.990145:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709347584 00000100:00100000:0.0:1784047518.990150:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709347584 00000100:00100000:0.0:1784047518.990179:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709347712 00000100:00100000:0.0:1784047518.990182:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709347712 00000100:00100000:0.0:1784047518.990193:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1784047518.990199:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:93192:x1870705709347584:12345-0@lo:104: 00010000:00010000:0.0:1784047518.990207:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.990258:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047518.990264:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:93192:x1870705709347584:12345-0@lo:104: Request processed in 65us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047518.990271:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1784047518.990284:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784047518.990290:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef694450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709347712:12345-0@lo:104: 00010000:00010000:0.0:1784047518.990296:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.990325:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784047518.990329:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef694450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:93192:x1870705709347712:12345-0@lo:104: Request processed in 40us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047518.990334:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1784047518.990487:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347584:0@lo:104: 00000100:00100000:1.0:1784047518.990495:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347712:0@lo:104: 00010000:00010000:2.0:1784047518.990556:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784047518.990562:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990569:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbea00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047518.990573:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990580:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047518.990598:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047518.990640:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784047518.990661:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990667:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047518.990675:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990682:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbea00/0x4426598c0c7756b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990694:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047518.990698:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990704:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047518.990706:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990712:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047518.990718:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047518.990722:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784047518.990740:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990746:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047518.990752:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990757:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe800/0x4426598c0c7756a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c7756a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.990769:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047518.990770:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047518.990772:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047518.990778:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047518.990787:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047518.990796:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709348480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.990828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047518.990863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047518.990868:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709348096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.990887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047518.990914:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348480 00000100:00100000:2.0:1784047518.990917:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348480 00010000:00010000:2.0:1784047518.990937:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 19 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047518.990957:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348096 00000100:00100000:2.0:1784047518.990960:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348096 00010000:00010000:2.0:1784047518.990970:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756cc expref: 20 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047518.990987:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1784047518.991001:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+20:3647:x1870705709348480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047518.991022:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047518.991028:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 20 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991037:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 20 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991052:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b89200/0x4426598c0c7756a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756a2 expref: 20 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991064:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047518.991093:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+19:3647:x1870705709348480:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047518.991099:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1784047518.991112:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1784047518.991118:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+18:3647:x1870705709348096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047518.991126:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047518.991130:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756cc expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991140:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756cc expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991150:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b89000/0x4426598c0c7756d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756cc expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991157:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047518.991177:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+17:3647:x1870705709348096:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047518.991190:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1784047518.991224:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709348096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.991231:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709348480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.991395:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709348224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.991419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047518.991436:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047518.991442:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709348352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.991460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047518.991482:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348224 00000100:00100000:2.0:1784047518.991486:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348224 00010000:00010000:2.0:1784047518.991500:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756be expref: 17 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047518.991519:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348352 00000100:00100000:2.0:1784047518.991522:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348352 00010000:00010000:2.0:1784047518.991531:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047518.991546:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1784047518.991552:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+18:3645:x1870705709348224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047518.991560:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047518.991564:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756be expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991572:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756be expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991595:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88e00/0x4426598c0c7756c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756be expref: 18 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991628:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047518.991655:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+17:3645:x1870705709348224:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047518.991661:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1784047518.991673:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1784047518.991678:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+16:3645:x1870705709348352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047518.991686:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047518.991691:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 16 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991698:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 16 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991707:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbf800/0x4426598c0c7756b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c7756b0 expref: 16 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047518.991715:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047518.991735:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+15:3645:x1870705709348352:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047518.991741:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1784047518.991792:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709348352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047518.991800:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709348224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047518.996436:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047518.999181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047518.999290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047518.999573:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476352 00000100:00100000:0.0:1784047518.999584:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476352 00010000:00010000:0.0:1784047518.999656:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 10 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047518.999686:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476480 00000100:00100000:0.0:1784047518.999689:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476480 00010000:00010000:0.0:1784047518.999701:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 11 pid: 92458 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047518.999734:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2569 00000100:00100000:0.0:1784047518.999743:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+11:2402:x1870705689476352:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047518.999759:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047518.999765:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 11 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999777:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 11 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999798:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047518.999856:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+11:2402:x1870705689476352:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 114us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047518.999864:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2569 00000100:00100000:0.0:1784047518.999882:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2570 00000100:00100000:0.0:1784047518.999889:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689476480:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047518.999897:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047518.999901:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 10 pid: 92458 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999910:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 10 pid: 92458 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999923:0:26195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999932:0:26195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999953:0:26195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999961:0:26195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999967:0:26195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999974:0:26195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999979:0:26195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047518.999983:0:26195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047518.999991:0:26195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047519.000000:0:26195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047519.000021:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047519.000042:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689476480:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 153us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047519.000048:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2570 00010000:00010000:1.0:1784047519.000526:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbfa00/0x4426598c0c77569b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae435 expref: 9 pid: 92466 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047519.000540:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347840:192.168.204.40@tcp:104: 00010000:00010000:0.0:1784047519.000688:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88400/0x4426598c0c775694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae42e expref: 8 pid: 92458 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047519.000699:0:93192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93192:1870705709347968:192.168.204.40@tcp:104: 00010000:00010000:0.0:1784047519.000751:0:93192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047519.000759:0:93192:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047519.000765:0:93192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047519.000771:0:93192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775720 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.018990:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047520.133489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047520.133591:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476608 00000100:00100000:0.0:1784047520.133602:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476608 00000100:00100000:0.0:1784047520.133698:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:0.0:1784047520.133710:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff31f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689476608:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047520.133727:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047520.133748:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600a00/0x4426598c0c775727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae43c expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.133788:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600a00/0x4426598c0c775727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae43c expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.133799:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600a00/0x4426598c0c775727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae43c expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.133808:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600a00, rc 0) 00000100:00100000:0.0:1784047520.133871:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff31f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689476608:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 163us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.133895:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:1.0:1784047520.138246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047520.138435:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476736 00000100:00100000:3.0:1784047520.138444:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476736 00000100:00100000:3.0:1784047520.138505:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:3.0:1784047520.138516:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689476736:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.138709:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689476736:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 194us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.138718:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:3.0:1784047520.142383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047520.142714:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476864 00000100:00100000:0.0:1784047520.142734:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476864 00000100:00100000:0.0:1784047520.143025:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 129 00000100:00100000:0.0:1784047520.143048:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689476864:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.143557:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689476864:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 520us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.143566:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 129 00000100:00100000:2.0:1784047520.152666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047520.158944:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689476992 00000100:00100000:3.0:1784047520.158962:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689476992 00000100:00100000:3.0:1784047520.159059:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 130 00000100:00100000:3.0:1784047520.159070:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71956:x1870705689476992:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784047520.159268:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71956:x1870705689476992:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 199us (6610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.159277:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 130 00000100:00100000:1.0:1784047520.165595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047520.165703:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689477120 00000100:00100000:2.0:1784047520.165713:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689477120 00000100:00100000:2.0:1784047520.165767:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:2.0:1784047520.165777:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71956:x1870705689477120:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784047520.165929:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:71956:x1870705689477120:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 152us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.165937:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:2.0:1784047520.174139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047520.181304:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689477248 00000100:00100000:3.0:1784047520.181319:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689477248 00000100:00100000:3.0:1784047520.181401:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:3.0:1784047520.181411:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689477248:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047520.181428:0:92466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047520.181460:0:92466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88c00/0x4426598c0c77572e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae443 expref: -99 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.181489:0:92466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88c00/0x4426598c0c77572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae443 expref: 10 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.181501:0:92466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88c00/0x4426598c0c77572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae443 expref: 10 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.181510:0:92466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88c00, rc 0) 00000100:00100000:3.0:1784047520.181585:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689477248:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 175us (7457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.181593:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:3.0:1784047520.185850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047520.185954:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689477376 00000100:00100000:2.0:1784047520.185966:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689477376 00000100:00100000:2.0:1784047520.186049:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:2.0:1784047520.186061:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689477376:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.186185:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689477376:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 126us (343us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784047520.186193:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:2.0:1784047520.531552:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709348608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047520.531654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.532104:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348608 00000100:00100000:0.0:1784047520.532114:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348608 00000100:00100000:0.0:1784047520.532187:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1784047520.532197:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709348608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047520.532229:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047520.532297:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709348608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.532305:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1784047520.532359:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709348608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047520.532852:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709348736:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.532896:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.532926:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709349248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.532950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.532966:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709349760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.533000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.533021:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784047520.533027:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709348864:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.533048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.533068:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709349376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.533091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.533107:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709349888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.533125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.533158:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349248 00000100:00100000:1.0:1784047520.533162:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349248 00000100:00100000:1.0:1784047520.533212:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349760 00000100:00100000:1.0:1784047520.533215:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349760 00000100:00100000:1.0:1784047520.533230:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348864 00000100:00100000:1.0:1784047520.533232:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348864 00000100:00100000:1.0:1784047520.533246:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1784047520.533253:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709349248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.535077:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709350400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047520.535226:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1784047520.535239:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709349760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.535415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.535449:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047520.535456:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709350272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047520.535479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.535507:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349376 00000100:00100000:3.0:1784047520.535514:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349376 00000100:00100000:3.0:1784047520.535544:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349888 00000100:00100000:3.0:1784047520.535547:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349888 00000100:00100000:3.0:1784047520.535557:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350400 00000100:00100000:3.0:1784047520.535559:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350400 00000100:00100000:3.0:1784047520.535567:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350272 00000100:00100000:3.0:1784047520.535569:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350272 00000100:00100000:3.0:1784047520.535581:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:3.0:1784047520.535587:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1870705709349376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.535651:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1870705709349376:12345-0@lo:400:kworker.0 Request processed in 63us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.535659:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:3.0:1784047520.535679:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:3.0:1784047520.535684:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709349888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.535714:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709349888:12345-0@lo:400:kworker.0 Request processed in 30us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.535720:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:3.0:1784047520.535732:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:3.0:1784047520.535738:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709350400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047520.535764:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444929536 avail 1298690048 00000100:00100000:3.0:1784047520.535801:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709350400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.535807:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:3.0:1784047520.535835:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1784047520.535841:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709350272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047520.535856:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445535744 avail 1299296256 00000100:00100000:3.0:1784047520.535884:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709350272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.535890:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1784047520.535915:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709348992:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.535943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.535956:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709349504:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.535978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.536019:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709350016:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.536064:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784047520.536070:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709349120:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.536105:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709349632:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.536143:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709350144:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.536185:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349504 00000100:00100000:3.0:1784047520.536188:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349504 00000100:00100000:3.0:1784047520.536218:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350016 00000100:00100000:3.0:1784047520.536222:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350016 00000100:00100000:3.0:1784047520.536239:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349632 00000100:00100000:3.0:1784047520.536241:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349632 00000100:00100000:3.0:1784047520.536261:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1784047520.536267:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709349504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536313:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709349504:12345-0@lo:400:kworker.0 Request processed in 46us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.536320:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1784047520.536332:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1784047520.536338:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709350016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536365:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709350016:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.536372:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1784047520.536383:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1784047520.536388:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709349632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536427:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709349632:12345-0@lo:400:kworker.0 Request processed in 39us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.536433:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1784047520.536493:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709350272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047520.536508:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709350400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047520.536682:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709349376:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536691:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709349888:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536742:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709349632:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536783:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709349504:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536793:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709350016:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536836:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348736 00000100:00100000:3.0:1784047520.536840:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348736 00000100:00100000:3.0:1784047520.536870:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784047520.536876:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+15:3645:x1870705709348736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.536912:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+15:3645:x1870705709348736:12345-0@lo:400:kworker.0 Request processed in 36us (4015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.536919:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784047520.537004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709348736:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.537058:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709348992 00000100:00100000:3.0:1784047520.537062:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709348992 00000100:00100000:3.0:1784047520.537083:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709349120 00000100:00100000:3.0:1784047520.537086:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709349120 00000100:00100000:3.0:1784047520.537097:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350144 00000100:00100000:3.0:1784047520.537105:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350144 00000100:00100000:3.0:1784047520.537121:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1784047520.537126:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709348864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.537166:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709348864:12345-0@lo:400:kworker.0 Request processed in 39us (4116us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.537172:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1784047520.537184:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1784047520.537189:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709348992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.537259:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709348992:12345-0@lo:400:kworker.0 Request processed in 69us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.537282:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1784047520.537294:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1784047520.537300:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709349120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.537328:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709349120:12345-0@lo:400:kworker.0 Request processed in 29us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.537334:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1784047520.537345:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1784047520.537350:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709350144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.537375:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709350144:12345-0@lo:400:kworker.0 Request processed in 25us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.537381:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000020:00080000:3.0:1784047520.537417:0:75662:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444091 batchid updated 00000020:00080000:3.0:1784047520.537434:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000004:00080000:3.0:1784047520.537509:0:75682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99cbcaa61a80 with version 12 00000020:00080000:3.0:1784047520.537522:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444091 cancel update log [0x2000090a1:0x2:0x0].3: rc = 0 00000020:00080000:3.0:1784047520.537598:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444091 cancel update log [0x2400088d0:0x2:0x0].3: rc = 0 00000020:00080000:3.0:1784047520.537631:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000004:00080000:3.0:1784047520.537639:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 12 rpc_version 12 00000020:00100000:3.0:1784047520.537662:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784047520.537670:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99cd0030c700 x1870705709350656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047520.537689:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709350656:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784047520.537720:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.537739:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc61c8240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.537753:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350656 00000100:00100000:3.0:1784047520.537757:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350656 00000100:00100000:3.0:1784047520.537781:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1784047520.537787:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75668:x1870705709350656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784047520.537893:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75668:x1870705709350656:12345-0@lo:1000:osp_up0-1.0 Request processed in 106us (172us total) trans 120259084291 rc 0/0 00000100:00100000:3.0:1784047520.537900:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1784047520.537937:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709350656:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784047520.537963:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709348864:0@lo:400:kworker.0 00000100:00080000:2.0:1784047520.540401:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047520.540413:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047520.540416:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047520.540420:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047520.541073:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709349120:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.541114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709350144:0@lo:400:kworker.0 00000100:00100000:3.0:1784047520.541127:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709348992:0@lo:400:kworker.0 00000100:00100000:0.0:1784047520.542173:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709349760:12345-0@lo:400:kworker.0 Request processed in 6932us (9166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.542199:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1784047520.542771:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709349248:12345-0@lo:400:kworker.0 Request processed in 9515us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.542911:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1784047520.548701:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709349248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047520.548721:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709349760:0@lo:400:kworker.0 10000000:01000000:2.0:1784047520.722684:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047520.722693:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc832f800 from 55 10000000:01000000:2.0:1784047520.722699:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047520.722761:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.722774:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.722798:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047520.722825:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709350784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.722900:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.722954:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.723036:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350784 00000100:00100000:0.0:1784047520.723043:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350784 00000100:00100000:0.0:1784047520.723115:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784047520.723124:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709350784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047520.723140:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047520.723154:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600600/0x4426598c0c77573c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775735 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.723179:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600600/0x4426598c0c77573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775735 expref: 16 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.724224:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600600/0x4426598c0c77573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775735 expref: 16 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.724235:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600600, rc 0) 00000100:00100000:0.0:1784047520.724306:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709350784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1183us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.724315:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784047520.724365:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709350784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047520.724384:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.724393:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047520.724470:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709350912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.724512:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.724548:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.726576:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709350912 00000100:00100000:3.0:1784047520.726589:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709350912 00000100:00100000:3.0:1784047520.726688:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784047520.726697:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709350912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.726883:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709350912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.726891:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784047520.727009:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709350912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.727078:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.727121:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.727155:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdd4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.728146:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351040 00000100:00100000:3.0:1784047520.728156:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351040 00000100:00100000:3.0:1784047520.728218:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784047520.728226:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709351040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.728364:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709351040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.728371:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784047520.729323:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.736014:0:93194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93194:1870705709351168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047520.736125:0:93194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.736182:0:93194:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.736235:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351168 00000100:00100000:0.0:1784047520.736245:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351168 00000100:00100000:0.0:1784047520.736359:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784047520.736373:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:93194:x1870705709351168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047520.736526:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+16:93194:x1870705709351168:12345-0@lo:502:llog_process_th.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.736534:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784047520.736654:0:93194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93194:1870705709351168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.736721:0:93194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93194:1870705709351296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.736773:0:93194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.740886:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351296 00000100:00100000:3.0:1784047520.740904:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351296 00000100:00100000:2.0:1784047520.740945:0:93194:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.740976:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784047520.741033:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:93194:x1870705709351296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.741223:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:93194:x1870705709351296:12345-0@lo:502:llog_process_th.0 Request processed in 224us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.741231:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784047520.742809:0:93194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93194:1870705709351296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784047520.742865:0:93194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784047520.743082:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1784047520.743110:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047520.743133:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.743144:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047520.743155:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784047520.743158:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:1.0:1784047520.743161:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784047520.743205:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.743213:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.743238:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047520.743261:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.743316:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.743366:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.744089:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351424 00000100:00100000:2.0:1784047520.744097:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351424 00000100:00100000:2.0:1784047520.744164:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784047520.744174:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709351424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047520.744187:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047520.744202:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c77574a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775743 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.744227:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c77574a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775743 expref: 17 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.744237:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c77574a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775743 expref: 17 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.744247:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47a00, rc 0) 00000100:00100000:2.0:1784047520.744298:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709351424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.744304:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784047520.744554:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047520.744570:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.744579:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047520.744675:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.744705:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.744725:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.744818:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351552 00000100:00100000:3.0:1784047520.744822:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351552 00000100:00100000:3.0:1784047520.744846:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784047520.744853:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709351552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.745007:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709351552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.745014:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784047520.745142:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.745173:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.745215:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.745236:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.745777:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351680 00000100:00100000:3.0:1784047520.745790:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351680 00000100:00100000:3.0:1784047520.745813:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784047520.745820:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709351680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.745914:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709351680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.745921:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784047520.746106:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709351680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.746812:0:93195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93195:1870705709351808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.746870:0:93195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.746903:0:93195:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.747092:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351808 00000100:00100000:3.0:1784047520.747098:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351808 00000100:00100000:1.0:1784047520.747558:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784047520.747568:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:93195:x1870705709351808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.747721:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:93195:x1870705709351808:12345-0@lo:502:llog_process_th.0 Request processed in 154us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.747734:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784047520.747901:0:93195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93195:1870705709351808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047520.748014:0:93195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047520.748026:0:93195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047520.748028:0:93195:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784047520.748033:0:93195:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1784047520.748051:0:93195:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1784047520.751875:0:93195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93195:1870705709351936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.751965:0:93195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.752019:0:93195:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.752147:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709351936 00000100:00100000:0.0:1784047520.752155:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709351936 00000100:00100000:0.0:1784047520.752211:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784047520.752221:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:93195:x1870705709351936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047520.752395:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:93195:x1870705709351936:12345-0@lo:502:llog_process_th.0 Request processed in 174us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.752403:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000020:01000004:3.0:1784047520.754252:0:93196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccc832f800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784047520.754261:0:93196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc832f800 4 00000100:00100000:2.0:1784047520.759328:0:93195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93195:1870705709351936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047520.759399:0:93195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047520.759410:0:93195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047520.759863:0:93195:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1784047520.759871:0:93195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1784047520.760238:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:1.0:1784047520.760263:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784047520.760277:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.760289:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047520.760302:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047520.760305:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 55 10000000:01000000:1.0:1784047520.760308:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047520.760344:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.760353:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.760363:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047520.760385:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.760568:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.760823:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.760862:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352064 00000100:00100000:2.0:1784047520.760869:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352064 00000100:00100000:2.0:1784047520.760951:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784047520.760963:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709352064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047520.760988:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047520.761004:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775751 expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.761029:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775751 expref: 18 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.761041:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775751 expref: 18 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.761050:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47e00, rc 0) 00000100:00100000:2.0:1784047520.761230:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709352064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.761237:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784047520.766464:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047520.766493:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.766507:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047520.769511:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.769593:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.770050:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.772090:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352192 00000100:00100000:0.0:1784047520.772103:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352192 00000100:00100000:0.0:1784047520.772172:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784047520.772184:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709352192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.772381:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709352192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.772389:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784047520.774052:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.774119:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.774198:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.774245:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.774266:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352320 00000100:00100000:1.0:1784047520.774273:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352320 00000100:00100000:1.0:1784047520.774321:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784047520.774330:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709352320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.774443:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709352320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.774458:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784047520.774558:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.777340:0:93197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93197:1870705709352448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047520.777427:0:93197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.777476:0:93197:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23840 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.777786:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352448 00000100:00100000:2.0:1784047520.777794:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352448 00000100:00100000:2.0:1784047520.777849:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784047520.777858:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:93197:x1870705709352448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.777999:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:93197:x1870705709352448:12345-0@lo:502:llog_process_th.0 Request processed in 141us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.778008:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784047520.778028:0:93197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93197:1870705709352448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047520.778092:0:93197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93197:1870705709352576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047520.778311:0:93197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.778342:0:93197:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.778401:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352576 00000100:00100000:1.0:1784047520.778405:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352576 00000100:00100000:1.0:1784047520.778437:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784047520.778444:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:93197:x1870705709352576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.778532:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+18:93197:x1870705709352576:12345-0@lo:502:llog_process_th.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.778539:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784047520.778637:0:93197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93197:1870705709352576:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784047520.778662:0:93197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1784047520.778754:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1784047520.778850:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047520.778861:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.778872:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047520.778881:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784047520.778884:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:3.0:1784047520.778887:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784047520.778912:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.778919:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.778927:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047520.778941:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.778970:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.779010:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352704 00000100:00100000:3.0:1784047520.779013:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.779015:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352704 00000100:00100000:2.0:1784047520.779047:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784047520.779054:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709352704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047520.779063:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047520.779074:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c775766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77575f expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.779095:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c775766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77575f expref: 19 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.779107:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c775766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77575f expref: 19 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.779121:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46e00, rc 0) 00000100:00100000:2.0:1784047520.779155:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709352704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.779161:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784047520.779764:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047520.779844:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.779873:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047520.780053:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.780093:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.780174:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.786731:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352832 00000100:00100000:1.0:1784047520.786747:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352832 00000100:00100000:1.0:1784047520.786919:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784047520.786930:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709352832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.787155:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709352832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (7059us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.787162:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784047520.787250:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.787308:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.787363:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.791536:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.791801:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709352960 00000100:00100000:2.0:1784047520.791812:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709352960 00000100:00100000:2.0:1784047520.791871:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784047520.791882:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709352960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.792054:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709352960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (4689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.792061:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784047520.792224:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709352960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.792627:0:93198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93198:1870705709353088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047520.792675:0:93198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.792702:0:93198:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23840 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.792757:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353088 00000100:00100000:2.0:1784047520.792761:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353088 00000100:00100000:2.0:1784047520.792782:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784047520.792788:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:93198:x1870705709353088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.792901:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:93198:x1870705709353088:12345-0@lo:502:llog_process_th.0 Request processed in 111us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.792909:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784047520.792989:0:93198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93198:1870705709353088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047520.793013:0:93198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047520.793024:0:93198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047520.793027:0:93198:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784047520.793032:0:93198:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1784047520.793048:0:93198:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1784047520.793065:0:93198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93198:1870705709353216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047520.793097:0:93198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.793129:0:93198:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b23840 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.793367:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353216 00000100:00100000:2.0:1784047520.793372:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353216 00000100:00100000:2.0:1784047520.793391:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784047520.793398:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:93198:x1870705709353216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.793476:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:93198:x1870705709353216:12345-0@lo:502:llog_process_th.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.793482:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784047520.793546:0:93198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93198:1870705709353216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047520.793565:0:93198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047520.793569:0:93198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047520.793570:0:93198:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1784047520.793580:0:93198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:2.0:1784047520.793755:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:2.0:1784047520.793780:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784047520.793791:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.793808:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047520.793818:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047520.793821:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 55 10000000:01000000:2.0:1784047520.793823:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047520.793848:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.793857:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.793866:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047520.793879:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.793904:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.793939:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.794160:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353344 00000100:00100000:3.0:1784047520.794164:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353344 00000100:00100000:3.0:1784047520.794182:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784047520.794188:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709353344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047520.794196:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047520.794207:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88a00/0x4426598c0c775774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77576d expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.794225:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88a00/0x4426598c0c775774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77576d expref: 20 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.794235:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88a00/0x4426598c0c775774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77576d expref: 20 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.794243:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88a00, rc 0) 00000100:00100000:3.0:1784047520.794277:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709353344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.794283:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784047520.795920:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047520.795944:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047520.795957:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047520.796050:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.796097:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.796150:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.796197:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353472 00000100:00100000:3.0:1784047520.796203:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353472 00000100:00100000:3.0:1784047520.796234:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784047520.796242:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709353472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.796380:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709353472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.796389:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784047520.796739:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.796775:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.796816:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.797888:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.798148:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353600 00000100:00100000:0.0:1784047520.798156:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353600 00000100:00100000:0.0:1784047520.798213:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784047520.798223:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709353600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.798345:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709353600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.798353:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784047520.798456:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.799069:0:93199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93199:1870705709353728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.799113:0:93199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.799170:0:93199:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.799220:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353728 00000100:00100000:1.0:1784047520.799225:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353728 00000100:00100000:0.0:1784047520.799269:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784047520.799278:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:93199:x1870705709353728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047520.799373:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:93199:x1870705709353728:12345-0@lo:502:llog_process_th.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.799380:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784047520.799456:0:93199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93199:1870705709353728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.799503:0:93199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93199:1870705709353856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047520.799540:0:93199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047520.799567:0:93199:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047520.799694:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353856 00000100:00100000:3.0:1784047520.799698:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353856 00000100:00100000:3.0:1784047520.799732:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784047520.799738:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:93199:x1870705709353856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047520.799823:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc67fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+20:93199:x1870705709353856:12345-0@lo:502:llog_process_th.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047520.799830:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784047520.799898:0:93199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93199:1870705709353856:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784047520.799919:0:93199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1784047520.800416:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1784047520.800444:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047520.800455:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.800465:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047520.800473:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784047520.800476:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784047520.800479:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784047520.800505:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.800513:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.800522:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047520.800538:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.800570:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.800680:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9c3c000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.800801:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709353984 00000100:00100000:0.0:1784047520.800806:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709353984 00000100:00100000:0.0:1784047520.800840:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784047520.800847:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709353984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047520.800856:0:92458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047520.800871:0:92458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00601400/0x4426598c0c775782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77577b expref: -99 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.800893:0:92458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00601400/0x4426598c0c775782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77577b expref: 21 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.800904:0:92458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00601400/0x4426598c0c775782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77577b expref: 21 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.800912:0:92458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601400, rc 0) 00000100:00100000:0.0:1784047520.800947:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709353984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.800953:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784047520.800997:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709353984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047520.801011:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.801019:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047520.801083:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.801109:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.801122:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.801135:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354112 00000100:00100000:0.0:1784047520.801138:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354112 00000100:00100000:0.0:1784047520.801153:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784047520.801159:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709354112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.801266:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709354112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.801272:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784047520.801300:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.801326:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.801357:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.801369:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.801381:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354240 00000100:00100000:0.0:1784047520.801384:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354240 00000100:00100000:0.0:1784047520.801399:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784047520.801404:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709354240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.801471:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709354240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047520.801478:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784047520.801518:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047520.802350:0:93200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1784047520.802418:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1784047520.802438:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784047520.802445:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.802454:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047520.802463:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047520.802466:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 55 10000000:01000000:0.0:1784047520.802468:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047520.802490:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.802498:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047520.802506:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047520.802522:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.802558:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.802573:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.802689:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354368 00000100:00100000:1.0:1784047520.802694:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354368 00000100:00100000:1.0:1784047520.802719:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784047520.802727:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709354368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047520.802736:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047520.802747:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775789 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.802764:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775789 expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.802780:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775789 expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.802788:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbee00, rc 0) 00000100:00100000:1.0:1784047520.802825:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709354368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.802831:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784047520.802872:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047520.802885:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.802894:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047520.802943:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.802966:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.802990:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f180 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.803002:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354496 00000100:00100000:1.0:1784047520.803005:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354496 00000100:00100000:1.0:1784047520.803021:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784047520.803027:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709354496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.803118:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709354496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.803125:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784047520.803152:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.803187:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.803221:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.803234:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f180 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.803244:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354624 00000100:00100000:1.0:1784047520.803247:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354624 00000100:00100000:1.0:1784047520.803263:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784047520.803268:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709354624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.803335:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709354624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.803342:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784047520.803383:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709354624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.803582:0:93201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93201:1870705709354752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.803695:0:93201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.803713:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354752 00000100:00100000:1.0:1784047520.803717:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354752 00000100:00100000:1.0:1784047520.803733:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784047520.803739:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:93201:x1870705709354752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.803810:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:93201:x1870705709354752:12345-0@lo:502:llog_process_th.0 Request processed in 69us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.803817:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784047520.803841:0:93201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.803852:0:93201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93201:1870705709354752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.803888:0:93201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93201:1870705709354880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.803918:0:93201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.803939:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709354880 00000100:00100000:1.0:1784047520.803943:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709354880 00000100:00100000:1.0:1784047520.803957:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784047520.803962:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:93201:x1870705709354880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047520.804030:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:93201:x1870705709354880:12345-0@lo:502:llog_process_th.0 Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.804037:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784047520.804061:0:93201:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.804071:0:93201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:93201:1870705709354880:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784047520.804088:0:93201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784047520.804132:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1784047520.804146:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784047520.804153:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804164:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047520.804174:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784047520.804176:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784047520.804179:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784047520.804196:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804204:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804212:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047520.804234:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.804257:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.804269:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.804281:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355008 00000100:00100000:1.0:1784047520.804284:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355008 00000100:00100000:1.0:1784047520.804300:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784047520.804305:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709355008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047520.804312:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047520.804322:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbe000/0x4426598c0c77579e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775797 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804338:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbe000/0x4426598c0c77579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775797 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804347:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbe000/0x4426598c0c77579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775797 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804354:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbe000, rc 0) 00000100:00100000:1.0:1784047520.804381:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709355008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.804387:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784047520.804413:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047520.804424:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.804432:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047520.804476:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.804500:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047520.804512:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.804522:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355136 00000100:00100000:1.0:1784047520.804525:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355136 00000100:00100000:1.0:1784047520.804540:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784047520.804546:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709355136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047520.806926:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709355136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2373us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.806940:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784047520.807145:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.807197:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.807254:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047520.807334:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8540 going to sleep for 11 seconds 00000100:00100000:2.0:1784047520.807367:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355264 00000100:00100000:2.0:1784047520.807375:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355264 00000100:00100000:2.0:1784047520.807463:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784047520.807472:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709355264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047520.807667:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709355264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047520.807674:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784047520.807915:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047520.808944:0:93202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784047520.812065:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784047520.812125:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784047520.812137:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.812152:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047520.812164:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784047520.812166:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:3.0:1784047520.812169:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784047520.812210:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.812218:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.812229:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047520.812256:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.812332:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.812385:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9c3cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047520.812454:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355392 00000100:00100000:1.0:1784047520.812462:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355392 00000100:00100000:1.0:1784047520.812511:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784047520.812522:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709355392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047520.812536:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047520.812550:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbec00/0x4426598c0c7757ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c7757a5 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.812575:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbec00/0x4426598c0c7757ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7757a5 expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.812586:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbec00/0x4426598c0c7757ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7757a5 expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.812595:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbec00, rc 0) 00000100:00100000:1.0:1784047520.812670:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709355392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047520.812677:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784047520.814335:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047520.814362:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047520.814375:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047520.814457:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047520.814515:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047520.814565:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc9c3cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047520.814647:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355520 00000100:00100000:0.0:1784047520.814653:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355520 00000100:00100000:0.0:1784047520.814695:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784047520.814703:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709355520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047520.814802:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709355520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (286us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047520.814811:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784047520.814870:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709355520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784047520.814900:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784047520.814907:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047520.814917:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047521.051059:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047521.051818:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047521.051838:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709355648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047521.051905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047521.052039:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355648 00000100:00100000:0.0:1784047521.052049:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355648 00000100:00100000:0.0:1784047521.052102:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1784047521.052111:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709355648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047521.052138:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047521.052185:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709355648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047521.052192:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1784047521.052262:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709355648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784047522.070434:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047522.130969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047522.137338:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689477504 00000100:00100000:3.0:1784047522.137363:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689477504 00000100:00100000:3.0:1784047522.137497:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1375 00000100:00100000:3.0:1784047522.137510:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:71976:x1870705689477504:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:3.0:1784047522.137540:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047522.137568:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae44a expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.137684:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.137703:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.137720:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047522.137803:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047522.137809:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047522.137870:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.137910:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae44a expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.137941:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae44a expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.137979:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047522.137982:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047522.137987:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88000, rc 0) 00000100:00100000:3.0:1784047522.138076:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689477504:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 568us (7128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.138085:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1375 00000100:00080000:1.0:1784047522.138384:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047522.142998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.154308:0:92462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689477632 00000100:00100000:0.0:1784047522.154337:0:92462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689477632 00000100:00100000:0.0:1784047522.154486:0:92462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:0.0:1784047522.154501:0:92462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689477632:12345-192.168.204.40@tcp:700:mkdir.0 00000100:00100000:0.0:1784047522.155345:0:92462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689477632:12345-192.168.204.40@tcp:700:mkdir.0 Request processed in 839us (12354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.155359:0:92462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:2.0:1784047522.166901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047522.167773:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689477888 00000100:00100000:3.0:1784047522.167788:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689477888 00000100:00100000:3.0:1784047522.167868:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1376 00000100:00100000:3.0:1784047522.167881:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689477888:12345-192.168.204.40@tcp:36:mkdir.0 00010000:00010000:3.0:1784047522.167977:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047522.168018:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae44a expref: 7 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.168043:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047522.168050:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047522.168138:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.168167:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.168309:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.168331:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.168348:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.168357:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171335:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171367:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171381:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047522.171401:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000269c459e reply state 000000004d60491c transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171414:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171422:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccec842100) 00010000:00010000:3.0:1784047522.171425:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047522.171431:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784047522.171440:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784047522.171452:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171460:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171467:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171485:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171491:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047522.171496:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171504:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171517:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047522.171520:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047522.171524:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171532:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c7757c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047522.171547:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000269c459e reply state 000000004d60491c transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171558:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.171563:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99ccec842900) 00010000:00010000:3.0:1784047522.171565:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047522.172270:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784047522.172462:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:71976:x1870705689477888:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 4577us (5572us total) trans 120259084292 rc 0/0 00000100:00100000:3.0:1784047522.172475:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1376 00000100:00100000:2.0:1784047522.178275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047522.178437:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689478016 00000100:00100000:3.0:1784047522.178451:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689478016 00000100:00100000:3.0:1784047522.178531:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1377 00000100:00100000:3.0:1784047522.178544:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:71976:x1870705689478016:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:3.0:1784047522.178588:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047522.178663:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae451 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.178751:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7757dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.178771:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7757dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.178784:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7757dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047522.178841:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047522.178845:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047522.178871:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7757dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.178906:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7757d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae451 expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.178926:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7757dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae451 expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.178937:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047522.178941:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047522.178965:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88200, rc 0) 00000100:00100000:3.0:1784047522.179042:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:71976:x1870705689478016:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 501us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.179051:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1377 00000100:00100000:3.0:1784047522.187731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.188080:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689478272 00000100:00100000:0.0:1784047522.188108:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689478272 00000100:00100000:0.0:1784047522.188400:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1378 00000100:00100000:0.0:1784047522.188417:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:71976:x1870705689478272:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:0.0:1784047522.188459:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047522.188487:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600c00/0x4426598c0c7757e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae458 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188638:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188658:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188673:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188685:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188692:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188698:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047522.188859:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784047522.188990:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.188999:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189008:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189032:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189040:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.189046:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189058:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189074:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047522.189078:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.189095:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189103:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7757eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189116:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189123:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189129:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189134:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.189137:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189154:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189163:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99ccec842900) 00010000:00010000:0.0:1784047522.189166:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.189169:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.189175:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7757f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.191399:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600c00/0x4426598c0c7757e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae458 expref: 11 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.191428:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047522.191432:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047522.191438:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600c00/0x4426598c0c7757e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae458 expref: 11 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.191459:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600c00, rc 0) 00000100:00100000:0.0:1784047522.191572:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+10:71976:x1870705689478272:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 3157us (3860us total) trans 120259084293 rc 301/301 00000100:00100000:0.0:1784047522.196134:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1378 00000100:00100000:1.0:1784047522.201207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047522.201302:0:66230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689478400 00000100:00100000:3.0:1784047522.201312:0:66230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689478400 00000100:00100000:3.0:1784047522.201472:0:66230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1784047522.201485:0:66230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c846d7a-6357-4e9c-a620-e35737ede709+5:71976:x1870705689478400:12345-192.168.204.40@tcp:900:mkdir.0 00000100:00100000:3.0:1784047522.201577:0:66230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c846d7a-6357-4e9c-a620-e35737ede709+5:71976:x1870705689478400:12345-192.168.204.40@tcp:900:mkdir.0 Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.201586:0:66230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00080000:1.0:1784047522.202261:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047522.206562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.206661:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689478656 00000100:00100000:0.0:1784047522.206672:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689478656 00000100:00100000:0.0:1784047522.206744:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 239 00000100:00100000:0.0:1784047522.206759:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+10:71976:x1870705689478656:12345-192.168.204.40@tcp:35:mkdir.0 00000100:00100000:0.0:1784047522.207023:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:71976:x1870705689478656:12345-192.168.204.40@tcp:35:mkdir.0 Request processed in 268us (469us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1784047522.207032:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 239 00000100:00100000:3.0:1784047522.214753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.216011:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689478912 00000100:00100000:0.0:1784047522.216028:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689478912 00000100:00100000:0.0:1784047522.216102:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1379 00000100:00100000:0.0:1784047522.216115:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+5:71976:x1870705689478912:12345-192.168.204.40@tcp:36:mkdir.0 00000100:00100000:0.0:1784047522.216256:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709355776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047522.216323:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.216353:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc834c240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.216414:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355776 00000100:00100000:1.0:1784047522.216419:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355776 00000100:00100000:1.0:1784047522.216459:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1784047522.216467:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709355776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.216546:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709355776:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.216554:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1784047522.216603:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709355776:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.216725:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709355904:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.216767:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.216788:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.217022:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709355904 00000100:00100000:0.0:1784047522.217027:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709355904 00000100:00100000:0.0:1784047522.217102:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1784047522.217109:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709355904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047522.217170:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709355904:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.217177:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1784047522.220460:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709355904:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.220553:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356032:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.220894:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.220966:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004940c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.221028:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356032 00000100:00100000:0.0:1784047522.221037:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356032 00000100:00100000:0.0:1784047522.221123:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1784047522.221132:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709356032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047522.221237:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709356032:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (344us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047522.221245:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:1.0:1784047522.221307:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356032:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1784047522.221363:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.221373:0:66220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.221385:0:66220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047522.221397:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356160:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1784047522.221423:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.221497:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047522.221537:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356160 00000100:00100000:2.0:1784047522.221542:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356160 00000100:00100000:2.0:1784047522.221589:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:2.0:1784047522.221863:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709356160:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1784047522.221877:0:23872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047522.221895:0:23872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c775800 expref: -99 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.221916:0:23872:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.221926:0:23872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.221942:0:23872:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1784047522.221979:0:23872:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1784047522.222039:0:23872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.222048:0:23872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccec842100) 00010000:00010000:2.0:1784047522.222051:0:23872:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047522.222054:0:23872:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 9 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.222078:0:23872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47600, rc 0) 00000100:00100000:2.0:1784047522.222123:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356160:12345-0@lo:101:mdt00_001.0 Request processed in 526us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.222129:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1784047522.225059:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356160:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1784047522.225096:0:66220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.225110:0:66220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047522.228059:0:92454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084294 is committed 00000001:00080000:3.0:1784047522.228079:0:92454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084291 is committed 00010000:00010000:0.0:1784047522.228574:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228589:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228598:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228619:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.228624:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228632:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228649:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99ccec842900) 00010000:00010000:0.0:1784047522.228652:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.228656:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228664:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c7757c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228684:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228701:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228707:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228712:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.228715:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228721:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228730:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccec842100) 00010000:00010000:0.0:1784047522.228732:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.228739:0:3632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228750:0:3632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228759:0:3632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.228800:0:3632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 7 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.228815:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3632:1870705709356288:0@lo:105: 00000100:00100000:0.0:1784047522.228877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.228921:0:3632:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd0a98540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.228942:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356288 00000100:00100000:0.0:1784047522.228961:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356288 00000100:00100000:0.0:1784047522.229016:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784047522.229025:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3632:x1870705709356288:12345-0@lo:105: 00010000:00010000:0.0:1784047522.229036:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229045:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229053:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229061:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229068:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229076:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229096:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99ccebdbe800) 00000100:00100000:0.0:1784047522.229135:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3632:x1870705709356288:12345-0@lo:105: Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.229142:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784047522.229178:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3632:1870705709356288:0@lo:105: 00010000:00010000:0.0:1784047522.229207:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229214:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7757cf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229236:0:66220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229245:0:66220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784047522.229266:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1784047522.229304:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229311:0:66220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229321:0:66220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.229337:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356416:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1784047522.229368:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.229390:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.229408:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356416 00000100:00100000:0.0:1784047522.229411:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356416 00000100:00100000:0.0:1784047522.229439:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:0.0:1784047522.229445:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66220:x1870705709356416:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1784047522.229460:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047522.229480:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c77580e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229500:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77580e expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229510:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77580e expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229518:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99cbc6765d00) 00010000:00010000:0.0:1784047522.229520:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.229523:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601c00, rc 0) 00000100:00100000:0.0:1784047522.229554:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356416:12345-0@lo:101:mdt00_001.0 Request processed in 108us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.229560:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:0.0:1784047522.229589:0:66220:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084291 gen 3 00000004:00080000:0.0:1784047522.229594:0:66220:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084291 committed transno 120259084291 00000100:00100000:0.0:1784047522.229629:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356416:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1784047522.229642:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.229651:0:66220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784047522.229662:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:0.0:1784047522.229693:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356544:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784047522.229718:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.229748:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc61c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.230334:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356544 00000100:00100000:1.0:1784047522.230341:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356544 00000100:00100000:1.0:1784047522.230374:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1784047522.230382:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.230454:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356544:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.230461:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1784047522.230506:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356544:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.230556:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.230583:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.230599:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.230643:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356672 00000100:00100000:1.0:1784047522.230648:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356672 00000100:00100000:1.0:1784047522.230671:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1784047522.230678:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.230754:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356672:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (169us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047522.230761:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1784047522.230789:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.230864:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356800:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.230888:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.230901:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.230913:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356800 00000100:00100000:1.0:1784047522.230916:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356800 00000100:00100000:1.0:1784047522.230937:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1784047522.230943:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231005:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356800:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047522.231012:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1784047522.231037:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356800:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231082:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356928:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231104:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.231124:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.231138:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709356928 00000100:00100000:1.0:1784047522.231141:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709356928 00000100:00100000:1.0:1784047522.231162:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1784047522.231167:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231218:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709356928:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.231225:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1784047522.231252:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709356928:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231290:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709357056:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231315:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.231328:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.231340:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357056 00000100:00100000:1.0:1784047522.231343:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357056 00000100:00100000:1.0:1784047522.231364:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1784047522.231370:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709357056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231425:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709357056:12345-0@lo:1000:mdt00_001.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.231431:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1784047522.231456:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709357056:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231493:0:66220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709357184:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231515:0:66220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.231528:0:66220:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.231540:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357184 00000100:00100000:1.0:1784047522.231543:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357184 00000100:00100000:1.0:1784047522.231563:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:1.0:1784047522.231569:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709357184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784047522.231648:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66220:x1870705709357184:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.231655:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:1.0:1784047522.231682:0:66220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66220:1870705709357184:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1784047522.232148:0:66220:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].4, 968 off37320 00000040:00080000:1.0:1784047522.232208:0:66220:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].4, 1120 off37904 00000004:00080000:1.0:1784047522.232215:0:66220:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99cd004940c0 with version 13 00000004:00080000:1.0:1784047522.232233:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 13 rpc_version 13 00000020:00100000:1.0:1784047522.232252:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784047522.232260:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99ccf2eaaa00 x1870705709357440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047522.232276:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709357440:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784047522.232305:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.232318:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc61c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.232331:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357440 00000100:00100000:1.0:1784047522.232335:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357440 00000100:00100000:1.0:1784047522.232355:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1784047522.232360:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75668:x1870705709357440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784047522.232700:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75668:x1870705709357440:12345-0@lo:1000:osp_up0-1.0 Request processed in 336us (391us total) trans 120259084295 rc 0/0 00000100:00100000:1.0:1784047522.232707:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1784047522.232747:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2eaaa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709357440:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784047522.232808:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232822:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232842:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047522.232861:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ea0cca1 reply state 00000000d1e2eebb transno 77309411459 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232873:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232880:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:1.0:1784047522.232883:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047522.232886:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784047522.232892:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:1.0:1784047522.232899:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1784047522.232907:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232916:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232923:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232944:0:66220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784047522.232962:0:66220:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1784047522.232969:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.232976:0:66220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047522.233060:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689478912:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 16946us (18325us total) trans 77309411459 rc 0/0 00000100:00100000:1.0:1784047522.233068:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1379 00010000:00010000:2.0:1784047522.233887:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047522.233897:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.233906:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe800 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:2.0:1784047522.233911:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047522.233920:0:16468:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.233965:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.233973:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047522.234002:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.234010:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccebdbe800/0x4426598c0c775800 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775807 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.234028:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047522.234030:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047522.234039:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047522.234057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047522.234070:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709357568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047522.234112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.234144:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357568 00000100:00100000:2.0:1784047522.234150:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357568 00000100:00100000:2.0:1784047522.234185:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1784047522.234192:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3647:x1870705709357568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047522.234203:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047522.234220:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775807 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775800 expref: 10 pid: 23872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.234232:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccec842100) 00010000:00010000:2.0:1784047522.234241:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047522.234272:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1870705709357568:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.234278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1784047522.234312:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709357568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047522.239921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.248651:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689479168 00000100:00100000:0.0:1784047522.248667:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689479168 00000100:00100000:0.0:1784047522.248733:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1380 00000100:00100000:0.0:1784047522.248746:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689479168:12345-192.168.204.40@tcp:36:mkdir.0 00010000:00010000:0.0:1784047522.248809:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047522.248838:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7757dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae451 expref: 7 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.248855:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047522.248860:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047522.249015:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:71976:x1870705689479168:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 271us (9102us total) trans 0 rc -17/-17 00000100:00100000:0.0:1784047522.249023:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1380 00000100:00100000:3.0:1784047522.260722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047522.260774:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689479296 00000100:00100000:3.0:1784047522.260783:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689479296 00000100:00100000:3.0:1784047522.260843:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1381 00000100:00100000:3.0:1784047522.260857:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+6:71976:x1870705689479296:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:3.0:1784047522.260880:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047522.260902:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c775823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae45f expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.260986:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c77582a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.261001:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c77582a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.261021:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c77582a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047522.261068:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047522.261072:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047522.261090:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c77582a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.261115:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c775823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae45f expref: 8 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.261132:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c77582a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae45f expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.261141:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047522.261144:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047522.261147:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89a00, rc 0) 00000100:00100000:3.0:1784047522.261213:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689479296:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 359us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.261220:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1381 00000100:00100000:3.0:1784047522.265487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047522.265661:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689479424 00000100:00100000:2.0:1784047522.265673:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689479424 00000100:00100000:2.0:1784047522.265733:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1382 00000100:00100000:2.0:1784047522.265747:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689479424:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:2.0:1784047522.265768:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047522.265790:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae466 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.265869:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.265885:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.265896:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.265912:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.265919:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.265925:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266020:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266028:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266036:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047522.266077:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047522.266081:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047522.266103:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266126:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266132:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266139:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266146:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266152:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047522.266156:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266163:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266175:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:2.0:1784047522.266178:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047522.266183:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266189:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c775838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266199:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266206:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266217:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266222:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047522.266225:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266232:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266240:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99ccc34a7f00) 00010000:00010000:2.0:1784047522.266242:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047522.266244:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266249:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47c00/0x4426598c0c77583f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266280:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c775831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 9 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266293:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.266300:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:2.0:1784047522.266302:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047522.266304:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46000, rc 0) 00000100:00100000:2.0:1784047522.266368:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:71976:x1870705689479424:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 626us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.266383:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1382 00000100:00100000:0.0:1784047522.269034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.269071:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689479680 00000100:00100000:0.0:1784047522.269080:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689479680 00000100:00100000:0.0:1784047522.269131:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1383 00000100:00100000:0.0:1784047522.269139:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:71976:x1870705689479680:12345-192.168.204.40@tcp:36:mkdir.0 00000100:00100000:0.0:1784047522.269250:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd32300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709357696:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.269301:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.269325:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8ce8840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.269349:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357696 00000100:00100000:0.0:1784047522.269352:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357696 00000100:00100000:0.0:1784047522.269382:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:0.0:1784047522.269389:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67153:x1870705709357696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.270819:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67153:x1870705709357696:12345-0@lo:1000:mdt00_003.0 Request processed in 1422us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.270845:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd32300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709357696:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.270846:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1784047522.270925:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709357824:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.270984:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.271015:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.271698:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357824 00000100:00100000:0.0:1784047522.271705:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357824 00000100:00100000:0.0:1784047522.271750:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:0.0:1784047522.271759:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67153:x1870705709357824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.271855:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67153:x1870705709357824:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (872us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047522.271862:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1784047522.271893:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709357824:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784047522.271975:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.271985:0:67153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.272069:0:67153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047522.272086:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00417b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709357952:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784047522.272129:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047522.272209:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc8e0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.272238:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709357952 00000100:00100000:0.0:1784047522.272243:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709357952 00000100:00100000:0.0:1784047522.272279:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1784047522.272285:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67153:x1870705709357952:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784047522.272294:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047522.272311:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c77584d expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.272338:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 7 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.272348:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.272373:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 7 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.272386:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 7 pid: 66220 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.272481:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8441:1870705709358080:192.168.204.40@tcp:104: 00000100:00100000:0.0:1784047522.272755:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047522.280868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.280921:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8441:1870705709358080:192.168.204.40@tcp:104: 00010000:00010000:0.0:1784047522.280969:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.280983:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:0.0:1784047522.280987:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.280991:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.281001:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601a00, rc 0) 00000100:00100000:0.0:1784047522.281069:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67153:x1870705709357952:12345-0@lo:101:mdt00_003.0 Request processed in 8783us (8938us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.281080:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1784047522.281117:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00417b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709357952:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784047522.281139:0:67153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.281151:0:67153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047522.282236:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689479808 00000100:00100000:1.0:1784047522.282248:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689479808 00010000:00010000:0.0:1784047522.282327:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 8 pid: 66220 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.282372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2571 00000100:00100000:0.0:1784047522.282383:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:2402:x1870705689479808:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047522.282414:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047522.282422:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 8 pid: 66220 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.282454:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 8 pid: 66220 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.282476:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775846 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae466 expref: 8 pid: 66220 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.282493:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:0.0:1784047522.282499:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.282508:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.282529:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.282561:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.282575:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6505:1870705709358208:0@lo:105: 00000100:00100000:0.0:1784047522.282645:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.282812:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa4ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047522.282984:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358208 00000100:00100000:3.0:1784047522.282990:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358208 00000100:00100000:3.0:1784047522.283043:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784047522.283052:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1870705709358208:12345-0@lo:105: 00010000:00010000:3.0:1784047522.283063:0:6502:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.283074:0:6502:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.283084:0:6502:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.283105:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.283112:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.283122:0:6502:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.283149:0:6502:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99cce3b88600) 00000100:00100000:3.0:1784047522.283209:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1870705709358208:12345-0@lo:105: Request processed in 157us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.283216:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784047522.283250:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6505:1870705709358208:0@lo:105: 00010000:00010000:1.0:1784047522.283267:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047522.283319:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689479808:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 937us (2462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.283326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2571 00010000:00010000:2.0:1784047522.283389:0:67153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.283400:0:67153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047522.283422:0:67153:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1784047522.283457:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.283465:0:67153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.283474:0:67153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047522.283490:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358336:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784047522.283522:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.283548:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.283601:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358336 00000100:00100000:1.0:1784047522.283632:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358336 00000100:00100000:1.0:1784047522.283741:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:1.0:1784047522.283750:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67153:x1870705709358336:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784047522.283765:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047522.283780:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c77585b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.283800:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77585b expref: 11 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.283811:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77585b expref: 11 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.283817:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99cd001e7a00) 00010000:00010000:1.0:1784047522.283827:0:8442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047522.283829:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbfe00, rc 0) 00000100:00100000:1.0:1784047522.283869:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358336:12345-0@lo:101:mdt00_003.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.283875:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:2.0:1784047522.283942:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358336:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784047522.283967:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.283988:0:67153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047522.284004:0:67153:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:2.0:1784047522.284039:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358464:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.284064:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.284088:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.284490:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358464 00000100:00100000:0.0:1784047522.284495:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358464 00000100:00100000:0.0:1784047522.284539:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1784047522.284547:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.284652:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358464:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.284659:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:2.0:1784047522.285054:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358464:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.285108:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358592:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.285145:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.285170:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.285253:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358592 00000100:00100000:1.0:1784047522.285258:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358592 00000100:00100000:1.0:1784047522.285285:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1784047522.285291:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784047522.285385:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358592:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047522.285393:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1784047522.285672:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358592:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784047522.285754:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358720:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784047522.285786:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047522.285806:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3e8300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.286658:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358720 00000100:00100000:0.0:1784047522.286666:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358720 00000100:00100000:0.0:1784047522.286728:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1784047522.286736:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.286838:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358720:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (1050us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784047522.286845:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1784047522.286916:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358720:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784047522.286995:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358848:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784047522.287025:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047522.287104:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3e8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047522.293234:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358848 00000100:00100000:2.0:1784047522.293251:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358848 00000100:00100000:0.0:1784047522.293735:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1784047522.293748:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.293908:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358848:12345-0@lo:1000:mdt00_003.0 Request processed in 163us (6882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.293917:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1784047522.294093:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358848:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.294178:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.294221:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.297566:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:3.0:1784047522.297964:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709358976 00000100:00100000:3.0:1784047522.297974:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709358976 00000100:00100000:0.0:1784047522.298055:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:0.0:1784047522.298069:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.298192:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709358976:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.298199:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1784047522.298312:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709358976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.298387:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709359104:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784047522.298426:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.298451:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.298486:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709359104 00000100:00100000:0.0:1784047522.298491:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709359104 00000100:00100000:0.0:1784047522.298534:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1784047522.298541:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709359104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784047522.298592:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67153:x1870705709359104:12345-0@lo:1000:mdt00_003.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.298881:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1784047522.298913:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67153:1870705709359104:0@lo:1000:mdt00_003.0 00000040:00080000:0.0:1784047522.299444:0:67153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].5, 968 off38288 00000040:00080000:0.0:1784047522.299503:0:67153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].5, 1120 off39024 00000004:00080000:0.0:1784047522.299509:0:67153:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99cbcaa4ea80 with version 14 00000004:00080000:1.0:1784047522.302388:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 14 rpc_version 14 00000020:00100000:1.0:1784047522.302446:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784047522.302459:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99cce3d20380 x1870705709359360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047522.302487:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709359360:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784047522.302555:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.302599:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047522.302729:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709359360 00000100:00100000:2.0:1784047522.302737:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709359360 00000100:00100000:2.0:1784047522.302799:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1784047522.302811:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75668:x1870705709359360:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784047522.303280:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75668:x1870705709359360:12345-0@lo:1000:osp_up0-1.0 Request processed in 471us (723us total) trans 120259084296 rc 0/0 00000100:00100000:2.0:1784047522.303289:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1784047522.303407:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709359360:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1784047522.303542:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303561:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303574:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047522.303595:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036061926 reply state 00000000b0a0190b transno 77309411460 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303651:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303662:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:2.0:1784047522.303665:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047522.303668:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784047522.303675:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:2.0:1784047522.303686:0:67153:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1784047522.303698:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303706:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303714:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303752:0:67153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784047522.303759:0:67153:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1784047522.303764:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.303772:0:67153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.303776:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047522.303784:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.303791:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:0.0:1784047522.303796:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047522.303804:0:15071:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.303832:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.303838:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784047522.303857:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:71976:x1870705689479680:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 34716us (34830us total) trans 77309411460 rc 0/0 00010000:00010000:0.0:1784047522.303859:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047522.303865:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1383 00010000:00010000:0.0:1784047522.303867:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cce3b88600/0x4426598c0c77584d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x4426598c0c775854 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.303886:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047522.303888:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047522.303896:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047522.303904:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047522.303917:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709359488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047522.303969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.307392:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709359488 00000100:00100000:2.0:1784047522.307408:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709359488 00000100:00100000:2.0:1784047522.307497:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1784047522.307509:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3646:x1870705709359488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047522.307526:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047522.307550:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775854 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77584d expref: 12 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.307570:0:25839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:2.0:1784047522.307580:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047522.307838:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3646:x1870705709359488:12345-0@lo:103:ldlm_bl.0 Request processed in 330us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.307846:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1784047522.307930:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709359488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047522.332048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.332962:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689479936 00000100:00100000:0.0:1784047522.332976:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689479936 00000100:00100000:0.0:1784047522.333060:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1384 00000100:00100000:0.0:1784047522.333082:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:71977:x1870705689479936:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047522.333107:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047522.333132:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae46d expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333210:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333228:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333241:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333256:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333264:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333270:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333363:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600800/0x4426598c0c775885 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333387:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600800/0x4426598c0c775885 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333395:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600800/0x4426598c0c775885 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047522.333441:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047522.333445:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047522.333480:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600800/0x4426598c0c775885 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333493:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333500:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333506:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333513:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333518:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.333522:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333530:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333543:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047522.333553:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.333559:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333566:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333581:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333587:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333593:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333598:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.333601:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333663:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333671:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99cbc6765c00) 00010000:00010000:0.0:1784047522.333674:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.333677:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333683:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77587e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333712:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae46d expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333737:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600800/0x4426598c0c775885 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae46d expref: 8 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.333744:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99cbc6765800) 00010000:00010000:0.0:1784047522.333747:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784047522.333749:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600800, rc 0) 00000100:00100000:0.0:1784047522.333824:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:71977:x1870705689479936:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 745us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.333832:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1384 00000100:00100000:1.0:1784047522.344069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.344164:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689480064 00000100:00100000:0.0:1784047522.344175:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689480064 00000100:00100000:0.0:1784047522.344237:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1385 00000100:00100000:0.0:1784047522.344248:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+8:71977:x1870705689480064:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047522.344267:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047522.344290:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c77588c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae474 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344363:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344378:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344388:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344399:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344423:0:68026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77580e expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344431:0:68026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.344466:0:68026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c77580e expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.344483:0:68026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68026:1870705709359616:0@lo:104: 00000100:00100000:0.0:1784047522.344533:0:68026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.344583:0:68026:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047522.344673:0:9519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709359616 00000100:00100000:2.0:1784047522.344678:0:9519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709359616 00000100:00100000:2.0:1784047522.344726:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1784047522.344734:0:9519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:68026:x1870705709359616:12345-0@lo:104: 00010000:00010000:2.0:1784047522.344746:0:9519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.344806:0:9519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784047522.344813:0:9519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:68026:x1870705709359616:12345-0@lo:104: Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.344820:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:1.0:1784047522.344883:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047522.344891:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.344911:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600c00 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:1.0:1784047522.344916:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047522.344924:0:6507:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.344960:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.344967:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047522.344998:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.345006:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99cd00600c00/0x4426598c0c77580e lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775815 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.345024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047522.345026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047522.345028:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047522.345036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047522.345047:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709359744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047522.345078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.345111:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709359744 00000100:00100000:1.0:1784047522.345115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709359744 00010000:00010000:1.0:1784047522.345132:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x4426598c0c77580e expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047522.345168:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1784047522.345175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3645:x1870705709359744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047522.345184:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784047522.345890:0:68026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68026:1870705709359616:0@lo:104: 00010000:00010000:0.0:1784047522.345910:0:68026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047522.347918:0:92454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00010000:00010000:3.0:1784047522.348066:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c775815 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c77580e expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.348096:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99cbc6765d00) 00010000:00010000:3.0:1784047522.348102:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.348111:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.348119:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.348160:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047522.348234:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3645:x1870705709359744:12345-0@lo:103:ldlm_bl.0 Request processed in 3058us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.348244:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00010000:00010000:0.0:1784047522.348325:0:68026:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.348334:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047522.348468:0:68026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68026:1870705709359872:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784047522.348514:0:68026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047522.348546:0:68026:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3481e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047522.348697:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709359744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047522.348780:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709359872 00000100:00100000:3.0:1784047522.348787:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709359872 00000100:00100000:3.0:1784047522.348833:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:3.0:1784047522.348842:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68026:x1870705709359872:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784047522.351055:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68026:x1870705709359872:12345-0@lo:1000:mdt00_004.0 Request processed in 2206us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.351069:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1784047522.351402:0:68026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68026:1870705709359872:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1784047522.351479:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7758a1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351506:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7758a1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351518:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7758a1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047522.351543:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7758a1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351559:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351565:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351571:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351578:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351583:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.351588:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.351595:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352301:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99cbc6765800) 00010000:00010000:0.0:1784047522.352307:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.352313:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352331:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c775893 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352347:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352354:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352360:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352365:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047522.352368:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352374:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352383:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99cbc6765d00) 00010000:00010000:0.0:1784047522.352386:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047522.352389:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352394:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77589a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352438:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c77588c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae474 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352466:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7758a1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae474 expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.352474:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cbc6765c00) 00010000:00010000:0.0:1784047522.352477:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047522.352479:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600200, rc 0) 00000100:00100000:0.0:1784047522.352629:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+9:71977:x1870705689480064:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 8359us (8547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.352639:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1385 00000100:00100000:3.0:1784047522.358578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047522.358917:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689480192 00000100:00100000:2.0:1784047522.358929:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689480192 00000100:00100000:2.0:1784047522.359094:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1386 00000100:00100000:2.0:1784047522.359106:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:71977:x1870705689480192:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047522.359134:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047522.359222:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7758a8 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae47b expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.359289:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c7758af lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.359304:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c7758af lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.359316:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c7758af lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047522.359364:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1784047522.359368:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1784047522.359406:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47200/0x4426598c0c7758a8 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae47b expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.359444:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c7758af lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae47b expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.359453:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:2.0:1784047522.359456:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784047522.359460:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47800, rc 0) 00000100:00100000:2.0:1784047522.359571:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:71977:x1870705689480192:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 466us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047522.359578:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1386 00000100:00100000:3.0:1784047522.364816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047522.365030:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689480448 00000100:00100000:2.0:1784047522.365040:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689480448 00000100:00100000:2.0:1784047522.365104:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1387 00000100:00100000:2.0:1784047522.365115:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+10:71977:x1870705689480448:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047522.365136:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047522.365160:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7758b6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae482 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047522.365264:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784047522.365371:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7758b6 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae482 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.365387:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:2.0:1784047522.365390:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784047522.365395:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46a00/0x4426598c0c7758b6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae482 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.365435:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46a00, rc 0) 00000100:00100000:2.0:1784047522.365489:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:71977:x1870705689480448:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 376us (683us total) trans 77309411461 rc 301/301 00000100:00100000:2.0:1784047522.365496:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1387 00000100:00100000:1.0:1784047522.368102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.371211:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689480704 00000100:00100000:0.0:1784047522.371225:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689480704 00000100:00100000:1.0:1784047522.374913:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1388 00000100:00100000:1.0:1784047522.374929:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:71977:x1870705689480704:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:1.0:1784047522.375011:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047522.375041:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47800/0x4426598c0c7758af lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae47b expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.375061:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:1.0:1784047522.375066:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047522.375086:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.375099:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.375108:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047522.375872:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f393f825 reply state 000000004b7b228c transno 77309411462 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.375908:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.375916:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:1.0:1784047522.375919:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784047522.375922:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784047522.375930:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:1.0:1784047522.376046:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+12:71977:x1870705689480704:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 1120us (7952us total) trans 77309411462 rc 0/0 00000100:00100000:1.0:1784047522.376055:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1388 00000100:00100000:2.0:1784047522.378369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047522.378456:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689480960 00000100:00100000:3.0:1784047522.378467:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689480960 00000100:00100000:3.0:1784047522.378530:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 240 00000100:00100000:3.0:1784047522.378541:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+12:71977:x1870705689480960:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1784047522.378814:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+13:71977:x1870705689480960:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 273us (452us total) trans 77309411463 rc 0/0 00000100:00100000:3.0:1784047522.378822:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 240 00000100:00100000:3.0:1784047522.401469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047522.401571:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689481088 00000100:00100000:2.0:1784047522.401581:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689481088 00000100:00100000:2.0:1784047522.401701:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1389 00000100:00100000:2.0:1784047522.401713:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:71978:x1870705689481088:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047522.401733:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047522.401767:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7758cb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae489 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401839:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401853:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401866:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401879:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401889:0:67153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77585b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401917:0:67153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047522.401962:0:67153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c77585b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047522.401982:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67153:1870705709360000:0@lo:104: 00000100:00100000:2.0:1784047522.402032:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047522.402125:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784047522.402326:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360000 00000100:00100000:0.0:1784047522.402331:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360000 00000100:00100000:0.0:1784047522.402417:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1784047522.402427:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:67153:x1870705709360000:12345-0@lo:104: 00010000:00010000:0.0:1784047522.402440:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.402515:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784047522.402521:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:67153:x1870705709360000:12345-0@lo:104: Request processed in 97us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.402528:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:3.0:1784047522.402574:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047522.402580:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.402589:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1a82ed0) 00010000:00010000:3.0:1784047522.402594:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047522.402626:0:16469:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.402654:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.402661:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047522.402691:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.402699:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47600/0x4426598c0c77585b lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775862 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.402717:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047522.402719:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047522.402720:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047522.402737:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709360128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047522.402779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047522.402811:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360128 00000100:00100000:3.0:1784047522.402815:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360128 00010000:00010000:3.0:1784047522.402831:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x4426598c0c77585b expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047522.402850:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1784047522.402856:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3647:x1870705709360128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047522.402864:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047522.403445:0:26194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99cd001e7a00) 00010000:00010000:3.0:1784047522.403451:0:26194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.403460:0:26194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.403466:0:26194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.403481:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047522.403525:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3647:x1870705709360128:12345-0@lo:103:ldlm_bl.0 Request processed in 668us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.403531:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00010000:00010000:1.0:1784047522.403773:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfe00/0x4426598c0c775862 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c77585b expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047522.403785:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67153:1870705709360000:0@lo:104: 00010000:00010000:1.0:1784047522.403804:0:67153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.403813:0:67153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.403819:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047522.403925:0:67153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67153:1870705709360256:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784047522.403971:0:67153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047522.403997:0:67153:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce753f180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047522.404091:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360256 00000100:00100000:3.0:1784047522.404096:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360256 00000100:00100000:3.0:1784047522.404135:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1784047522.404143:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67153:x1870705709360256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784047522.404218:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67153:x1870705709360256:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.404234:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1784047522.404262:0:67153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67153:1870705709360256:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784047522.404305:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7758e0 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404315:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7758e0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404323:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7758e0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047522.404345:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7758e0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404358:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404364:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404369:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404376:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404381:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047522.404385:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404392:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404409:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99cbc6765800) 00010000:00010000:3.0:1784047522.404411:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047522.404415:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404422:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47200/0x4426598c0c7758d2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404432:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404439:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404444:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404450:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047522.404452:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404458:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404466:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99cd001e7a00) 00010000:00010000:3.0:1784047522.404468:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047522.404471:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404478:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47800/0x4426598c0c7758d9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404525:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c7758cb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae489 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404540:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7758e0 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae489 expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047522.404548:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cceca13200) 00010000:00010000:3.0:1784047522.404550:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784047522.404552:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88000, rc 0) 00000100:00100000:3.0:1784047522.404592:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:71978:x1870705689481088:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2883us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047522.404599:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1389 00000100:00100000:2.0:1784047522.404861:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709360128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047522.407046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.407295:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689481216 00000100:00100000:0.0:1784047522.407304:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689481216 00000100:00100000:0.0:1784047522.407363:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1390 00000100:00100000:0.0:1784047522.407385:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+13:71978:x1870705689481216:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047522.407567:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047522.407588:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601600/0x4426598c0c7758e7 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae490 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.407692:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7758ee lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.407707:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7758ee lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.407718:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7758ee lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047522.407768:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784047522.407773:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1784047522.407808:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601600/0x4426598c0c7758e7 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae490 expref: 15 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.407826:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7758ee lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae490 expref: 14 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047522.407835:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:0.0:1784047522.407838:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784047522.407841:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601a00, rc 0) 00000100:00100000:0.0:1784047522.407894:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+14:71978:x1870705689481216:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 523us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.407902:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1390 00000100:00100000:2.0:1784047522.421044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047522.424489:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689481472 00000100:00100000:1.0:1784047522.424509:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689481472 00000100:00100000:1.0:1784047522.425341:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1391 00000100:00100000:1.0:1784047522.425360:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+14:71978:x1870705689481472:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1784047522.425387:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047522.425416:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfe00/0x4426598c0c7758f5 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae497 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047522.425523:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784047522.425667:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfe00/0x4426598c0c7758f5 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae497 expref: 16 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.425852:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99cd02171f00) 00010000:00010000:1.0:1784047522.425855:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784047522.425870:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfe00/0x4426598c0c7758f5 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae497 expref: 16 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.425890:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbfe00, rc 0) 00000100:00100000:1.0:1784047522.426040:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+15:71978:x1870705689481472:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 687us (5004us total) trans 77309411464 rc 301/301 00000100:00100000:1.0:1784047522.426049:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1391 00000100:00100000:3.0:1784047522.430578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047522.430797:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689481728 00000100:00100000:1.0:1784047522.430808:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689481728 00000100:00100000:1.0:1784047522.430865:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1392 00000100:00100000:1.0:1784047522.430874:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+15:71978:x1870705689481728:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:1.0:1784047522.430941:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047522.430981:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7758ee lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae490 expref: 15 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.431029:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:1.0:1784047522.431033:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047522.431056:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.431070:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.431079:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047522.431246:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004917fdb reply state 00000000b42840e8 transno 77309411465 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.431259:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047522.431266:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:1.0:1784047522.431268:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784047522.431271:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784047522.431279:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:1.0:1784047522.431350:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+16:71978:x1870705689481728:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 476us (781us total) trans 77309411465 rc 0/0 00000100:00100000:1.0:1784047522.431357:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1392 00000100:00100000:3.0:1784047522.436502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.436977:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689481984 00000100:00100000:0.0:1784047522.436999:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689481984 00000100:00100000:0.0:1784047522.437078:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 241 00000100:00100000:0.0:1784047522.437088:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+16:71978:x1870705689481984:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1784047522.437502:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+17:71978:x1870705689481984:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 414us (1012us total) trans 77309411466 rc 0/0 00000100:00100000:0.0:1784047522.437510:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 241 00000100:00100000:0.0:1784047522.440394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047522.440471:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482112 00000100:00100000:1.0:1784047522.440483:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482112 00000100:00100000:1.0:1784047522.440544:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:1.0:1784047522.440556:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689482112:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047522.440682:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689482112:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047522.440703:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:3.0:1784047522.448026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047522.448278:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482240 00000100:00100000:0.0:1784047522.448289:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482240 00000100:00100000:0.0:1784047522.448368:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2615 00000100:00100000:0.0:1784047522.448381:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689482240:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047522.448471:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689482240:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 93us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047522.448479:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2615 00000100:00080000:1.0:1784047522.448634:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047523.093365:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709360384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047523.093441:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047523.093505:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360384 00000100:00100000:2.0:1784047523.093515:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360384 00000100:00100000:2.0:1784047523.093578:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:2.0:1784047523.093590:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709360384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047523.093645:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047523.093692:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709360384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047523.093699:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00080000:2.0:1784047523.093720:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047523.093754:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709360384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047523.096439:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709360512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047523.096530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047523.096597:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047523.097320:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360512 00000100:00100000:3.0:1784047523.097333:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360512 00000100:00100000:3.0:1784047523.097410:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1784047523.097422:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709360512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047523.097456:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047523.097524:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709360512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047523.097531:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00080000:2.0:1784047523.097596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047523.097658:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709360512:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1784047523.347925:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411466 is committed 00010000:00010000:0.0:1784047523.349032:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349047:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349055:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349061:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbea00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047523.349066:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349083:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349121:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:0.0:1784047523.349124:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047523.349129:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349144:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbea00/0x4426598c0c77581c lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349167:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349173:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349179:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349183:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047523.349186:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349192:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349198:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:0.0:1784047523.349201:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047523.349203:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349208:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c47c00/0x4426598c0c775869 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349228:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349234:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349239:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349244:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047523.349247:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349252:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349259:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cd001e7500) 00010000:00010000:0.0:1784047523.349261:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047523.349264:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349268:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf800/0x4426598c0c7758c4 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349286:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349292:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349297:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349308:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047523.349310:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349317:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349326:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99ccc34a7e00) 00010000:00010000:0.0:1784047523.349328:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047523.349331:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047523.349336:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf200/0x4426598c0c775903 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047523.409089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047523.409435:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482368 00000100:00100000:3.0:1784047523.409447:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482368 00000100:00100000:3.0:1784047523.409521:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1393 00000100:00100000:3.0:1784047523.409532:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+10:71987:x1870705689482368:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047523.409574:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:3.0:1784047523.409674:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+10:71987:x1870705689482368:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 143us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047523.409681:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1393 00000100:00100000:3.0:1784047523.416505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047523.416541:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482496 00000100:00100000:3.0:1784047523.416549:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482496 00000100:00100000:3.0:1784047523.416597:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1394 00000100:00100000:3.0:1784047523.416618:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+5:71987:x1870705689482496:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047523.416658:0:68026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047523.416721:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+5:71987:x1870705689482496:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 116us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047523.416729:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1394 00000100:00100000:3.0:1784047523.422980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047523.423057:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482624 00000100:00100000:2.0:1784047523.423068:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482624 00000100:00100000:2.0:1784047523.423150:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2136 00000100:00100000:2.0:1784047523.423164:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+5:71987:x1870705689482624:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047523.423201:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047523.423286:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+5:71987:x1870705689482624:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047523.423294:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2136 00000100:00100000:3.0:1784047523.427251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047523.427381:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482752 00000100:00100000:0.0:1784047523.427390:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482752 00000100:00100000:0.0:1784047523.427437:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4998 00000100:00100000:0.0:1784047523.427445:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2398:x1870705689482752:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:0.0:1784047523.427478:0:26190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3621 last 0 00000020:00000080:0.0:1784047523.427508:0:26190:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c77590a 00002000:00100000:0.0:1784047523.427520:0:26190:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccff385800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047523.427531:0:26190:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784047523.427637:0:26190:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784047523.427668:0:26190:0:(import.c:65:import_set_state_nolock()) ffff99ccff382000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047523.427734:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689482752:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 287us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047523.427753:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4998 00000100:00100000:3.0:1784047523.435275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047523.435432:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689482880 00000100:00100000:0.0:1784047523.435443:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689482880 00000100:00100000:0.0:1784047523.435525:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2137 00000100:00100000:0.0:1784047523.435536:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:71987:x1870705689482880:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047523.435563:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047523.435651:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:71987:x1870705689482880:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 117us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047523.435660:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2137 00000100:00080000:1.0:1784047523.435736:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047523.518564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047523.518632:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483136 00000100:00100000:3.0:1784047523.518643:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483136 00000100:00100000:3.0:1784047523.518700:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1395 00000100:00100000:3.0:1784047523.518711:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+10:71994:x1870705689483136:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00010000:3.0:1784047523.518777:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047523.518813:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c77582a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae45f expref: 10 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.518847:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047523.518853:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047523.518916:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.518942:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.518953:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.518968:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.518976:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.518983:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519371:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519380:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519386:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519392:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519409:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047523.519413:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519421:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519430:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047523.519433:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047523.519436:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519442:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775911 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047523.519452:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030bd8957 reply state 0000000057dda3e4 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519464:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.519470:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13a00) 00010000:00010000:3.0:1784047523.519472:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047523.519475:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047523.519578:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:71994:x1870705689483136:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 867us (1017us total) trans 120259084297 rc 0/0 00000100:00100000:3.0:1784047523.519587:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1395 00000100:00100000:1.0:1784047523.551827:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047523.551910:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483264 00000100:00100000:2.0:1784047523.551919:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483264 00000100:00100000:2.0:1784047523.551978:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1396 00000100:00100000:2.0:1784047523.551988:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:71997:x1870705689483264:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:2.0:1784047523.552015:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047523.552039:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c77591f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae49e expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.552110:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775926 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.552127:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.552209:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047523.552271:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047523.552275:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047523.552297:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.552321:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47600/0x4426598c0c77591f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae49e expref: 13 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.552336:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae49e expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.552345:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:2.0:1784047523.552348:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047523.552351:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46000, rc 0) 00000100:00100000:2.0:1784047523.552413:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+12:71997:x1870705689483264:12345-192.168.204.40@tcp:101:rm.0 Request processed in 425us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047523.552420:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1396 00000100:00100000:3.0:1784047523.555453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047523.555529:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483392 00000100:00100000:1.0:1784047523.555538:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483392 00000100:00100000:1.0:1784047523.555588:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1397 00000100:00100000:1.0:1784047523.555596:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+12:71997:x1870705689483392:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1784047523.555627:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047523.555644:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf000/0x4426598c0c77592d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4a5 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555698:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555711:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555724:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555734:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555741:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555748:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555871:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555880:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555887:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047523.555943:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:1.0:1784047523.555948:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047523.555968:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555978:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555985:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555989:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555994:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.555998:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556002:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbfa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047523.556006:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556021:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556035:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047523.556038:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047523.556043:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556050:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbfa00/0x4426598c0c775934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556064:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556070:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556076:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556086:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047523.556088:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556094:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556101:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13a00) 00010000:00010000:1.0:1784047523.556104:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047523.556107:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556124:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf600/0x4426598c0c77593b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556152:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbf000/0x4426598c0c77592d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4a5 expref: 14 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556166:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4a5 expref: 13 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047523.556173:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99ccef89ed00) 00010000:00010000:1.0:1784047523.556176:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047523.556179:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbe600, rc 0) 00000100:00100000:1.0:1784047523.556255:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+13:71997:x1870705689483392:12345-192.168.204.40@tcp:101:rm.0 Request processed in 658us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047523.556263:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1397 00000100:00100000:0.0:1784047523.564056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047523.564181:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483648 00000100:00100000:3.0:1784047523.564206:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483648 00000100:00100000:3.0:1784047523.564265:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1398 00000100:00100000:3.0:1784047523.564276:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+13:71997:x1870705689483648:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:3.0:1784047523.564336:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784047523.564367:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbe600/0x4426598c0c775942 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4a5 expref: 13 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564385:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99ccef89ed00) 00010000:00010000:3.0:1784047523.564402:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46000/0x4426598c0c775926 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae49e expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564412:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047523.564415:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047523.564435:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564448:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564458:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564469:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564476:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564483:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564584:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564594:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564601:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564873:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564883:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564891:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564899:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564907:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564912:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.564979:0:66221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047523.565002:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565009:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565023:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565030:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047523.565035:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565044:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565054:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99cceca13500) 00010000:00010000:3.0:1784047523.565057:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784047523.565060:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565067:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c775957 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565087:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565093:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565098:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565104:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565109:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047523.565119:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565126:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565134:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047523.565137:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047523.565139:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565146:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88600/0x4426598c0c775949 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047523.565156:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097f47676 reply state 00000000a7521bdd transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565168:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047523.565174:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13a00) 00010000:00010000:3.0:1784047523.565176:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047523.565179:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047523.565299:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+13:71997:x1870705689483648:12345-192.168.204.40@tcp:36:rm.0 Request processed in 1024us (1252us total) trans 120259084298 rc 0/0 00000100:00100000:3.0:1784047523.565309:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1398 00010000:00010000:2.0:1784047523.565412:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047523.565419:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.565425:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:2.0:1784047523.565428:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.565435:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.565444:0:16468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99cceca13500) 00010000:00010000:2.0:1784047523.565453:0:16468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784047523.565456:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.565461:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89800/0x4426598c0c77595e lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047523.565477:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047523.565479:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047523.565481:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047524.114755:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047525.138823:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047525.650979:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709360640:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.651072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.651112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709361152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.651305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.651322:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709361664:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.651343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.651357:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709362176:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.651378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.651401:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784047525.651407:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709361024:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.651431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.651446:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709361536:0@lo:400:kworker.0 00000100:00100000:1.0:1784047525.651560:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360640 00000100:00100000:1.0:1784047525.651569:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360640 00000100:00100000:1.0:1784047525.651639:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784047525.651651:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047525.651782:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361152 00000100:00100000:3.0:1784047525.651786:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361152 00000100:00100000:3.0:1784047525.651822:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361664 00000100:00100000:3.0:1784047525.651824:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361664 00000100:00100000:3.0:1784047525.651834:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362176 00000100:00100000:3.0:1784047525.651849:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362176 00000100:00100000:3.0:1784047525.651861:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361024 00000100:00100000:3.0:1784047525.651863:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361024 00000100:00100000:3.0:1784047525.651877:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1784047525.651883:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709361152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047525.651950:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709361152:12345-0@lo:400:kworker.0 Request processed in 67us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047525.651958:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1784047525.651978:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1784047525.651984:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709361664:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047525.651998:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0d500 x1870705709361664/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1784047536 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047525.652309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.652333:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709362048:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.652359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.652404:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709361152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.652438:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709360768:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.652464:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1784047525.652476:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709362176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.652487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:0.0:1784047525.652493:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c3e300 x1870705709362176/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1784047536 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047525.652504:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709361280:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.652541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047525.652547:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709362176:12345-0@lo:400:kworker.0 Request processed in 72us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.652556:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1784047525.652568:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709361792:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.652574:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360768 00000100:00100000:0.0:1784047525.652580:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360768 00000100:00100000:2.0:1784047525.652628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047525.652630:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1784047525.652640:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709361024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.652653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709362304:0@lo:13:osp-pre-1-0.0 00010000:00000080:0.0:1784047525.652655:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a25c00 x1870705709361024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1784047536 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047525.652687:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709361024:12345-0@lo:400:kworker.0 Request processed in 49us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.652700:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1784047525.652714:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1784047525.652720:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709360768:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784047525.652731:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a27480 x1870705709360768/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1784047536 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047525.652760:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709360768:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.652767:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1784047525.652790:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709360640:12345-0@lo:400:kworker.0 Request processed in 1141us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047525.652799:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784047525.652829:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709361024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047525.652839:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361536 00000100:00100000:1.0:1784047525.652845:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361536 00000100:00100000:0.0:1784047525.652845:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709360640:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.652865:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709362176:0@lo:400:kworker.0 00000100:00100000:1.0:1784047525.652879:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362048 00000100:00100000:1.0:1784047525.652896:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362048 00000100:00100000:0.0:1784047525.652916:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361280 00000100:00100000:0.0:1784047525.652921:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361280 00000100:00100000:1.0:1784047525.652924:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1784047525.652943:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709361536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.652956:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361792 00000100:00100000:0.0:1784047525.652960:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361792 00000100:00100000:1.0:1784047525.652989:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709361536:12345-0@lo:400:kworker.0 Request processed in 48us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.652991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1784047525.653005:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709361280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047525.653006:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00010000:00000080:0.0:1784047525.653026:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a24380 x1870705709361280/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1784047536 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047525.653058:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709361280:12345-0@lo:400:kworker.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.653064:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1784047525.653077:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1784047525.653082:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709361792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.653116:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709361792:12345-0@lo:400:kworker.0 Request processed in 33us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.653122:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1784047525.653153:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709361536:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.653195:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1784047525.653202:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709362048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.653237:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709362048:12345-0@lo:400:kworker.0 Request processed in 35us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.653244:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:3.0:1784047525.653377:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709361664:12345-0@lo:400:kworker.0 Request processed in 1392us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047525.653385:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00080000:1.0:1784047525.653550:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047525.653554:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047525.653557:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047525.653634:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709362048:0@lo:400:kworker.0 00000100:00100000:1.0:1784047525.653646:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709361664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047525.653795:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709362560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047525.653828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047525.653862:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362560 00000100:00100000:3.0:1784047525.653866:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362560 00000100:00100000:3.0:1784047525.653905:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1784047525.653911:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709362560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047525.653936:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00010000:00000080:3.0:1784047525.653949:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf2c16a00 x1870705709362560/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:656/0 lens 224/368 e 0 to 0 dl 1784047536 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047525.653983:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709362560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047525.654002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:0.0:1784047525.654235:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709360896:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.654274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047525.654299:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709361408:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.654313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047525.654329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047525.654355:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709360768:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.654358:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709361920:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.654372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709361280:0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.654389:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709361792:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.654390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047525.654416:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709362432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047525.654427:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362304 00000100:00100000:2.0:1784047525.654433:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362304 00000100:00100000:0.0:1784047525.654445:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047525.654479:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361408 00000100:00100000:0.0:1784047525.654484:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361408 00000100:00100000:2.0:1784047525.654487:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:2.0:1784047525.654498:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709362304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047525.654523:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047525.654526:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709361920 00000100:00100000:0.0:1784047525.654529:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709361920 00000100:00100000:0.0:1784047525.654557:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1784047525.654565:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709361408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047525.654571:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709362304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047525.654579:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:0.0:1784047525.654632:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709361408:12345-0@lo:400:kworker.0 Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.654649:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1784047525.654664:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1784047525.654904:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709362304:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784047525.654989:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047525.655003:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362432 00000100:00100000:1.0:1784047525.655018:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362432 00000100:00100000:1.0:1784047525.655053:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1784047525.655061:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709362432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047525.655098:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047525.655506:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709362560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047525.655934:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709362432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 872us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047525.655942:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1784047525.655963:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709360896 00000100:00100000:1.0:1784047525.655968:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709360896 00000100:00100000:1.0:1784047525.656122:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:1.0:1784047525.656327:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709360896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047525.656374:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709360896:12345-0@lo:400:kworker.0 Request processed in 245us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047525.656381:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1784047525.656508:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709361920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.656548:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709361920:12345-0@lo:400:kworker.0 Request processed in 1878us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047525.656555:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1784047525.656602:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709360896:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.656634:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709361408:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.656644:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709361920:0@lo:400:kworker.0 00000100:00100000:0.0:1784047525.656662:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709362432:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1784047525.658168:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047526.163716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709362688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047526.163833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047526.164007:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362688 00000100:00100000:0.0:1784047526.164018:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362688 00000100:00100000:0.0:1784047526.164218:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1784047526.164228:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709362688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047526.164272:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047526.164344:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709362688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047526.164354:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00010000:00010000:0.0:1784047526.164388:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047526.164454:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709362688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784047527.202014:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047527.557595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047527.557716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047527.557748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047527.557787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047527.557810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047527.557920:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483776 00000100:00100000:2.0:1784047527.557934:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483776 00000100:00100000:2.0:1784047527.558008:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 175 00000100:00100000:2.0:1784047527.558021:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689483776:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047527.558129:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689483776:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 110us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047527.558160:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 175 00000100:00100000:0.0:1784047527.560088:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483904 00000100:00100000:0.0:1784047527.560125:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483904 00000100:00100000:0.0:1784047527.560209:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484032 00000100:00100000:0.0:1784047527.560213:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484032 00000100:00100000:0.0:1784047527.560245:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1366 00000100:00100000:0.0:1784047527.560257:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+13:2402:x1870705689483904:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:0.0:1784047527.560298:0:66219:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf2c15500 x1870705689483904/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:658/0 lens 224/224 e 0 to 0 dl 1784047538 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047527.561039:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484160 00000100:00100000:2.0:1784047527.561048:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484160 00000100:00100000:2.0:1784047527.561101:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484288 00000100:00100000:2.0:1784047527.561105:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484288 00000100:00100000:2.0:1784047527.561128:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2620 00000100:00100000:2.0:1784047527.561136:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689484160:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047527.561209:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689484160:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 74us (3493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047527.561218:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2620 00000100:00100000:2.0:1784047527.561239:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2621 00000100:00100000:2.0:1784047527.561246:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689484288:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047527.561270:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689484288:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047527.561276:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2621 00000100:00100000:0.0:1784047527.561641:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+13:2402:x1870705689483904:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1385us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047527.561650:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1366 00000100:00100000:0.0:1784047527.561670:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1367 00000100:00100000:0.0:1784047527.561678:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689484032:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047527.561709:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689484032:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 33us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047527.561716:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1367 00000100:00080000:0.0:1784047527.561736:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047527.561741:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047527.561744:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047527.561747:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784047528.211221:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047528.211728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709362816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047528.211791:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709362944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047528.211826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047528.211877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047528.211917:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362816 00000100:00100000:0.0:1784047528.211931:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362816 00000100:00100000:3.0:1784047528.211947:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709362944 00000100:00100000:3.0:1784047528.211953:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709362944 00000100:00100000:0.0:1784047528.212044:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1784047528.212057:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709362816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047528.212096:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047528.212157:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709362816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047528.212165:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:3.0:1784047528.219506:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00080000:2.0:1784047528.219785:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047528.219793:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047528.219876:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709362816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047528.221518:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709362944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047528.221716:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047528.221851:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709362944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2318us (9960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047528.221864:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:0.0:1784047528.222003:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709362944:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1784047528.724379:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00010000:00010000:3.0:1784047529.235959:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784047529.747077:0:92454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:2.0:1784047529.747894:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.747910:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.747928:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.747936:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047529.747951:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.747960:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.747980:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13a00) 00010000:00010000:2.0:1784047529.747982:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047529.747988:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.747994:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c775918 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748014:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748020:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748025:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748030:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047529.748032:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748048:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748057:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cceca13a00) 00010000:00010000:2.0:1784047529.748060:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047529.748063:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047529.748068:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c775950 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1784047530.044185:0:93650:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1784047530.150325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.150397:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484416 00000100:00100000:0.0:1784047530.150414:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484416 00000100:00080000:1.0:1784047530.150491:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047530.150510:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1399 00000100:00100000:0.0:1784047530.150523:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:72065:x1870705689484416:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047530.150547:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047530.150574:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600000/0x4426598c0c775965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4ac expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.150660:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c77596c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.150677:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c77596c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.150694:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c77596c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047530.150763:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047530.150768:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047530.150831:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c77596c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.150861:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600000/0x4426598c0c775965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4ac expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.150902:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c77596c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4ac expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.150914:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047530.150918:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047530.150922:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601e00, rc 0) 00010000:00000080:0.0:1784047530.150933:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce4539500 x1870705689484416/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:661/0 lens 576/688 e 0 to 0 dl 1784047541 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047530.151033:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:72065:x1870705689484416:12345-192.168.204.40@tcp:101:touch.0 Request processed in 512us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047530.151042:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1399 00000100:00100000:2.0:1784047530.157776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.162923:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484544 00000100:00100000:0.0:1784047530.162954:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484544 00000100:00100000:0.0:1784047530.163053:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1400 00000100:00100000:0.0:1784047530.163064:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+10:72065:x1870705689484544:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047530.163089:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047530.163111:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600e00/0x4426598c0c775973 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4b3 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163203:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163217:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163229:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163261:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163269:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163276:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163337:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775988 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163346:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775988 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163353:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775988 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047530.163374:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775988 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163389:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163396:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163403:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163410:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163428:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047530.163433:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163441:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163455:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99cbc6765800) 00010000:00010000:0.0:1784047530.163458:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047530.163462:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163468:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c77597a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163479:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163484:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163491:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163496:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047530.163498:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163505:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163524:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99cbc6765500) 00010000:00010000:0.0:1784047530.163527:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047530.163529:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163535:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c775981 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163569:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600e00/0x4426598c0c775973 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4b3 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163584:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775988 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4b3 expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.163592:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cbc6765c00) 00010000:00010000:0.0:1784047530.163594:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047530.163597:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600400, rc 0) 00010000:00000080:0.0:1784047530.163639:0:66220:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a25180 x1870705689484544/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:661/0 lens 576/584 e 0 to 0 dl 1784047541 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047530.163736:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:72065:x1870705689484544:12345-192.168.204.40@tcp:101:touch.0 Request processed in 672us (5973us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047530.163744:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1400 00000100:00100000:0.0:1784047530.173655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.173698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.173744:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484800 00000100:00100000:0.0:1784047530.173756:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484800 00000100:00100000:0.0:1784047530.173830:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 736 00000100:00100000:0.0:1784047530.173850:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689484800:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047530.173866:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047530.173891:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c775988 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4b3 expref: 11 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.173913:0:10393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cbc6765c00) 00010000:00010000:0.0:1784047530.173918:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047530.173974:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:2400:x1870705689484800:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047530.173983:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 736 00000100:00100000:3.0:1784047530.174166:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689484672 00000100:00100000:3.0:1784047530.174172:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689484672 00000100:00100000:3.0:1784047530.174229:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1401 00000100:00100000:3.0:1784047530.174237:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+5:72065:x1870705689484672:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047530.174324:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047530.174347:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89e00/0x4426598c0c77598f lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4ba expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.174429:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88600/0x4426598c0c775996 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.174442:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88600/0x4426598c0c775996 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.174455:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88600/0x4426598c0c775996 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047530.174514:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1784047530.174519:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784047530.174585:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89e00/0x4426598c0c77598f lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4ba expref: 7 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.174603:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88600/0x4426598c0c775996 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4ba expref: 6 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.174636:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99ccc37b6800) 00010000:00010000:3.0:1784047530.174638:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784047530.174641:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88600, rc 0) 00000100:00100000:3.0:1784047530.174673:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+6:72065:x1870705689484672:12345-192.168.204.40@tcp:101:touch.0 Request processed in 436us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.174679:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1401 00000100:00080000:0.0:1784047530.174815:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047530.180533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047530.181633:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689485056 00000100:00100000:2.0:1784047530.181648:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689485056 00000100:00100000:1.0:1784047530.181834:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1402 00000100:00100000:1.0:1784047530.181848:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:72065:x1870705689485056:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047530.181875:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047530.181901:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf000/0x4426598c0c77599d lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4c1 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.182034:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.182050:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.182063:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.182083:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.182090:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.182096:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047530.182357:0:68026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68026:1870705709363072:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784047530.182435:0:68026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.182473:0:68026:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8d2db40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047530.182576:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363072 00000100:00100000:3.0:1784047530.182583:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363072 00000100:00100000:3.0:1784047530.182654:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1784047530.182662:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68026:x1870705709363072:12345-0@lo:1000:mdt00_004.0 00010000:00000080:3.0:1784047530.182709:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce4539c00 x1870705709363072/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 328/4320 e 0 to 0 dl 1784047541 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_004.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047530.183684:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68026:x1870705709363072:12345-0@lo:1000:mdt00_004.0 Request processed in 1021us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.183694:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1784047530.185469:0:68026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68026:1870705709363072:0@lo:1000:mdt00_004.0 00000004:00080000:1.0:1784047530.185964:0:68026:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x89:0x0], count =409 00000004:00080000:1.0:1784047530.185973:0:68026:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x89:0x0]+409 in llog 00000004:00080000:1.0:1784047530.185985:0:68026:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x222:0x0], index 1: 0 00010000:00010000:1.0:1784047530.186200:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe600/0x4426598c0c7759b2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.186218:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe600/0x4426598c0c7759b2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.186230:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe600/0x4426598c0c7759b2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188562:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188579:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188587:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188594:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188600:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047530.188633:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188642:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188659:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99ccc37b6800) 00010000:00010000:1.0:1784047530.188670:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047530.188675:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.188682:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf600/0x4426598c0c7759a4 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047530.188695:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008206ce2e reply state 00000000676c2b47 transno 77309411467 ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.189985:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.190009:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff99cce7ec2e00) 00010000:00010000:1.0:1784047530.190012:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047530.190017:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047530.190083:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbf000/0x4426598c0c77599d lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4c1 expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.190105:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe600/0x4426598c0c7759b2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4c1 expref: 8 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.190114:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99cce7ec2d00) 00010000:00010000:1.0:1784047530.190116:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047530.190119:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbe600, rc 0) 00000100:00100000:1.0:1784047530.190822:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+9:72065:x1870705689485056:12345-192.168.204.40@tcp:101:touch.0 Request processed in 8972us (10298us total) trans 77309411467 rc 0/0 00000100:00100000:1.0:1784047530.190832:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1402 00000100:00100000:3.0:1784047530.206573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.206693:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689485312 00000100:00100000:0.0:1784047530.206706:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689485312 00000100:00100000:0.0:1784047530.206780:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1403 00000100:00100000:0.0:1784047530.206792:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:72065:x1870705689485312:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047530.206868:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047530.206898:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbe600/0x4426598c0c7759b2 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4c1 expref: 9 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.206921:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99cce7ec2d00) 00010000:00010000:0.0:1784047530.206934:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047530.206999:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.207013:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.207022:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047530.207147:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d260ccf8 reply state 00000000c07a8a0b transno 77309411468 ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.207160:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.207167:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99cbc6765500) 00010000:00010000:0.0:1784047530.207169:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047530.207172:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047530.207593:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+10:72065:x1870705689485312:12345-192.168.204.40@tcp:36:touch.0 Request processed in 800us (1030us total) trans 77309411468 rc 0/0 00000100:00100000:0.0:1784047530.207601:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1403 00000100:00100000:1.0:1784047530.213011:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047530.214636:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689485440 00000100:00100000:2.0:1784047530.214653:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689485440 00000100:00100000:2.0:1784047530.214753:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1404 00000100:00100000:2.0:1784047530.214766:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:72065:x1870705689485440:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047530.214794:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047530.214827:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46000/0x4426598c0c7759c7 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4c8 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047530.214900:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46000/0x4426598c0c7759c7 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4c8 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047530.214919:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccf6c46000/0x4426598c0c7759c7 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4c8 expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047530.214972:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99cbc6765500) 00010000:00010000:2.0:1784047530.214975:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047530.214980:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46000, rc 0) 00000100:00100000:2.0:1784047530.215058:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:72065:x1870705689485440:12345-192.168.204.40@tcp:101:touch.0 Request processed in 294us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047530.215066:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1404 00000100:00100000:1.0:1784047530.220955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047530.224812:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689485568 00000100:00100000:3.0:1784047530.224828:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689485568 00000100:00100000:2.0:1784047530.225045:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4999 00000100:00100000:2.0:1784047530.225056:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689485568:12345-192.168.204.40@tcp:2:touch.0 00000100:00080000:3.0:1784047530.225378:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047530.225452:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+6:2401:x1870705689485568:12345-192.168.204.40@tcp:2:touch.0 Request processed in 396us (4513us total) trans 4294968755 rc 0/0 00000100:00100000:2.0:1784047530.225460:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4999 00000100:00100000:3.0:1784047530.230048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.230501:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689485824 00000100:00100000:0.0:1784047530.230511:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689485824 00000100:00100000:0.0:1784047530.230575:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 242 00000100:00100000:0.0:1784047530.230588:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:72065:x1870705689485824:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047530.230940:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+12:72065:x1870705689485824:12345-192.168.204.40@tcp:35:touch.0 Request processed in 353us (908us total) trans 77309411469 rc 0/0 00000100:00100000:0.0:1784047530.230948:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 242 00000100:00100000:2.0:1784047530.249732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047530.250706:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689485952 00000100:00100000:3.0:1784047530.250719:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689485952 00000100:00100000:3.0:1784047530.250791:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1405 00000100:00100000:3.0:1784047530.250812:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:72066:x1870705689485952:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047530.250835:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047530.250860:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7759ce lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4cf expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.250943:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.250959:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.250973:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.250990:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251020:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251027:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251088:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c7759e3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251096:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c7759e3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251102:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c7759e3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047530.251125:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c7759e3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251138:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251146:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251152:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251158:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251164:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047530.251168:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251181:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251204:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99cbc6765800) 00010000:00010000:3.0:1784047530.251208:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047530.251213:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251220:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88400/0x4426598c0c7759d5 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251233:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251240:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251245:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251686:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047530.251690:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251697:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251707:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99ccc2b81200) 00010000:00010000:3.0:1784047530.251709:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047530.251712:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251729:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c7759dc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251771:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7759ce lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4cf expref: 12 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251787:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c7759e3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4cf expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.251794:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cceca13200) 00010000:00010000:3.0:1784047530.251808:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784047530.251810:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89000, rc 0) 00010000:00000080:3.0:1784047530.251819:0:68026:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a25f80 x1870705689485952/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:661/0 lens 576/584 e 0 to 0 dl 1784047541 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047530.251905:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:72066:x1870705689485952:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1105us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.251914:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1405 00000100:00100000:3.0:1784047530.255527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047530.255567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047530.255692:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689486208 00000100:00100000:1.0:1784047530.255703:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689486208 00000100:00100000:1.0:1784047530.255778:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 737 00000100:00100000:1.0:1784047530.255789:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:2401:x1870705689486208:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784047530.255816:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047530.255848:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c7759e3 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4cf expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047530.255877:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cceca13200) 00010000:00010000:1.0:1784047530.255883:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047530.255944:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c846d7a-6357-4e9c-a620-e35737ede709+10:2401:x1870705689486208:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047530.255951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 737 00000100:00100000:0.0:1784047530.256142:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689486080 00000100:00100000:0.0:1784047530.256147:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689486080 00000100:00100000:0.0:1784047530.256185:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1406 00000100:00100000:0.0:1784047530.256193:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+12:72066:x1870705689486080:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047530.256212:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047530.256233:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7759ea lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4d6 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.256457:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600000/0x4426598c0c7759f1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.256469:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600000/0x4426598c0c7759f1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.256480:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600000/0x4426598c0c7759f1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047530.256526:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784047530.256530:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1784047530.256563:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00601a00/0x4426598c0c7759ea lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4d6 expref: 14 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.256577:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600000/0x4426598c0c7759f1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4d6 expref: 13 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047530.256585:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cbc6765e00) 00010000:00010000:0.0:1784047530.256588:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1784047530.256590:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600000, rc 0) 00000100:00100000:0.0:1784047530.256652:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+13:72066:x1870705689486080:12345-192.168.204.40@tcp:101:touch.0 Request processed in 459us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047530.256658:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1406 00010000:00010000:3.0:1784047530.258932:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047530.267316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047530.267353:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689486464 00000100:00100000:3.0:1784047530.267362:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689486464 00000100:00100000:3.0:1784047530.267424:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1407 00000100:00100000:3.0:1784047530.267434:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+13:72066:x1870705689486464:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047530.267458:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047530.267499:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c7759f8 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4dd expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.267646:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.267661:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.267672:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.267685:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.267692:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.267697:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047530.268053:0:66219:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x223:0x0], index 1: 0 00010000:00010000:3.0:1784047530.268202:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88200/0x4426598c0c775a0d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268211:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88200/0x4426598c0c775a0d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268218:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88200/0x4426598c0c775a0d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268251:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268270:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268276:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268283:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268289:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047530.268294:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268302:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268316:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cbc6765e00) 00010000:00010000:3.0:1784047530.268318:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047530.268323:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268330:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c7759ff lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047530.268342:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f11837e5 reply state 00000000ef59bd45 transno 77309411470 ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268354:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268360:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff99ccc2b81800) 00010000:00010000:3.0:1784047530.268368:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047530.268371:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784047530.268408:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c7759f8 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4dd expref: 16 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268424:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88200/0x4426598c0c775a0d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4dd expref: 15 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.268432:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99ccc2b81500) 00010000:00010000:3.0:1784047530.268434:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047530.268436:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88200, rc 0) 00000100:00100000:3.0:1784047530.268497:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+16:72066:x1870705689486464:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1064us (1193us total) trans 77309411470 rc 0/0 00000100:00100000:3.0:1784047530.268506:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1407 00000100:00100000:3.0:1784047530.283931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047530.283967:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689486720 00000100:00100000:3.0:1784047530.283976:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689486720 00000100:00100000:3.0:1784047530.284032:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1408 00000100:00100000:3.0:1784047530.284043:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+16:72066:x1870705689486720:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:3.0:1784047530.284118:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047530.284146:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b88200/0x4426598c0c775a0d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4dd expref: 16 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.284163:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99ccc2b81500) 00010000:00010000:3.0:1784047530.284174:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047530.284238:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.285378:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.285390:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047530.285513:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009de0244e reply state 0000000004929893 transno 77309411471 ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.285527:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.285535:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:3.0:1784047530.285538:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047530.285542:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047530.285673:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+17:72066:x1870705689486720:12345-192.168.204.40@tcp:36:touch.0 Request processed in 1629us (1751us total) trans 77309411471 rc 0/0 00000100:00100000:3.0:1784047530.285683:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1408 00000100:00100000:0.0:1784047530.288552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047530.288968:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689486848 00000100:00100000:3.0:1784047530.288982:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689486848 00000100:00100000:3.0:1784047530.289053:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1409 00000100:00100000:3.0:1784047530.289064:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+17:72066:x1870705689486848:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047530.289093:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047530.289120:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c775a22 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4e4 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.289199:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c775a22 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4e4 expref: 18 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.289235:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89600/0x4426598c0c775a22 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4e4 expref: 18 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047530.289329:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:3.0:1784047530.289333:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047530.289337:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89600, rc 0) 00000100:00100000:3.0:1784047530.289401:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+18:72066:x1870705689486848:12345-192.168.204.40@tcp:101:touch.0 Request processed in 338us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.289408:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1409 00000100:00100000:3.0:1784047530.292296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.292356:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689486976 00000100:00100000:0.0:1784047530.292367:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689486976 00000100:00100000:0.0:1784047530.292423:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5000 00000100:00100000:0.0:1784047530.292433:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+6:2399:x1870705689486976:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:0.0:1784047530.292688:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689486976:12345-192.168.204.40@tcp:2:touch.0 Request processed in 254us (398us total) trans 4294968756 rc 0/0 00000100:00100000:0.0:1784047530.292697:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5000 00000100:00100000:3.0:1784047530.297421:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047530.297702:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689487232 00000100:00100000:0.0:1784047530.297713:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689487232 00000100:00100000:0.0:1784047530.297786:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 243 00000100:00100000:0.0:1784047530.297806:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+18:72066:x1870705689487232:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047530.298183:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+19:72066:x1870705689487232:12345-192.168.204.40@tcp:35:touch.0 Request processed in 387us (773us total) trans 77309411472 rc 0/0 00000100:00100000:0.0:1784047530.298208:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 243 00000100:00100000:1.0:1784047530.770877:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709363200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047530.770964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047530.771066:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363200 00000100:00100000:1.0:1784047530.771084:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047530.771093:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709363328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047530.771119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.771157:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363328 00000100:00100000:1.0:1784047530.771161:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363328 00000100:00100000:1.0:1784047530.771206:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:1.0:1784047530.771215:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709363328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047530.771250:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1784047530.771302:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709363328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047530.771310:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:1.0:1784047530.771398:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709363328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047530.771633:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363200 00000100:00100000:2.0:1784047530.771937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709363456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047530.771970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047530.772006:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363456 00000100:00100000:2.0:1784047530.772010:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363456 00000100:00100000:2.0:1784047530.772049:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:2.0:1784047530.772056:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709363456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047530.772075:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047530.772109:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709363456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047530.772115:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:2.0:1784047530.772146:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709363456:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784047530.772219:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047530.772254:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:3.0:1784047530.772264:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709363200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784047530.772287:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00010000:00000080:3.0:1784047530.772299:0:83733:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce4538a80 x1870705709363200/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/368 e 0 to 0 dl 1784047541 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047530.772347:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709363200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047530.774024:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709363200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047530.775420:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709363584:0@lo:400:kworker.0 00000100:00100000:2.0:1784047530.775500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047530.775774:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:2.0:1784047530.776015:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047530.776024:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709363968:0@lo:400:kworker.0 00000100:00100000:2.0:1784047530.776060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047530.776099:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709363712:0@lo:400:kworker.0 00000100:00100000:2.0:1784047530.776128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047530.776147:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047530.776151:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709363840:0@lo:400:kworker.0 00000100:00100000:2.0:1784047530.776171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047530.776318:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363968 00000100:00100000:3.0:1784047530.776326:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363968 00000100:00100000:3.0:1784047530.776387:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363712 00000100:00100000:3.0:1784047530.776390:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363712 00000100:00100000:3.0:1784047530.776409:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363840 00000100:00100000:3.0:1784047530.776428:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363840 00000100:00100000:3.0:1784047530.776450:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1784047530.776459:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709363968:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047530.776485:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a26300 x1870705709363968/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1784047541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047530.776530:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709363968:12345-0@lo:400:kworker.0 Request processed in 72us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.776537:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1784047530.776549:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1784047530.776555:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709363712:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047530.776566:0:66221:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a24a80 x1870705709363712/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1784047541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047530.776595:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709363712:12345-0@lo:400:kworker.0 Request processed in 40us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.778276:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1784047530.778308:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1784047530.778321:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709363840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047530.778386:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709363840:12345-0@lo:400:kworker.0 Request processed in 70us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.778392:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1784047530.778458:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709363968:0@lo:400:kworker.0 00000100:00100000:3.0:1784047530.778493:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709363840:0@lo:400:kworker.0 00000100:00100000:3.0:1784047530.778506:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709363712:0@lo:400:kworker.0 00000100:00080000:2.0:1784047530.778599:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047530.778625:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047530.778946:0:92458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709363584 00000100:00100000:1.0:1784047530.778954:0:92458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709363584 00000100:00100000:1.0:1784047530.779003:0:92458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784047530.779010:0:92458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709363584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779054:0:92458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef53ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3648:x1870705709363584:12345-0@lo:400:kworker.0 Request processed in 45us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047530.779060:0:92458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784047530.779097:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709364352:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.779163:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784047530.779169:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709364224:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.779215:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709364736:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.779269:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364352 00000100:00100000:1.0:1784047530.779273:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364352 00000100:00100000:1.0:1784047530.779306:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364224 00000100:00100000:1.0:1784047530.779309:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364224 00000100:00100000:1.0:1784047530.779330:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1784047530.779336:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709364352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779371:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709364352:12345-0@lo:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047530.779377:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1784047530.779390:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1784047530.779396:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709364224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779442:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709364224:12345-0@lo:400:kworker.0 Request processed in 46us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047530.779448:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1784047530.779478:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709364224:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779487:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709364352:0@lo:400:kworker.0 00000100:00080000:1.0:1784047530.779505:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047530.779509:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047530.779517:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709364480:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.779556:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784047530.779562:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709364096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047530.779597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709364608:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.779806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047530.779887:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364608 00000100:00100000:2.0:1784047530.779892:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364608 00000100:00100000:2.0:1784047530.779942:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1784047530.779950:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709364608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047530.779988:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709364608:12345-0@lo:400:kworker.0 Request processed in 39us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047530.779995:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:3.0:1784047530.780302:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364736 00000100:00100000:3.0:1784047530.780316:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364736 00000100:00100000:3.0:1784047530.780350:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364480 00000100:00100000:3.0:1784047530.780353:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364480 00000100:00100000:3.0:1784047530.780370:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364096 00000100:00100000:3.0:1784047530.780373:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364096 00000100:00100000:3.0:1784047530.780389:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1784047530.780395:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709364736:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047530.780409:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc482f100 x1870705709364736/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1784047541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047530.780448:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709364736:12345-0@lo:400:kworker.0 Request processed in 53us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.780454:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1784047530.780468:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1784047530.780475:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709364480:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784047530.780485:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc482ed80 x1870705709364480/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1784047541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047530.780511:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709364480:12345-0@lo:400:kworker.0 Request processed in 37us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.780517:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1784047530.780528:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:3.0:1784047530.780534:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047530.780560:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709364096:12345-0@lo:400:kworker.0 Request processed in 27us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047530.780565:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:3.0:1784047530.780602:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709364736:0@lo:400:kworker.0 00000100:00100000:3.0:1784047530.780671:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709363584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.781117:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709364096:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.781129:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce453a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709364608:0@lo:400:kworker.0 00000100:00100000:1.0:1784047530.781139:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709364480:0@lo:400:kworker.0 00000100:00080000:0.0:1784047530.781679:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047530.781685:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784047531.282804:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047531.283894:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709364864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047531.283972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047531.284041:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364864 00000100:00100000:2.0:1784047531.284050:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364864 00000100:00100000:2.0:1784047531.284122:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1784047531.284132:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709364864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047531.284162:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047531.284247:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709364864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047531.284254:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:3.0:1784047531.284486:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709364864:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1784047532.054195:0:93747:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784047532.054250:0:93747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.054265:0:93747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.054273:0:93747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.054280:0:93747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.054452:0:93747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784047532.054458:0:93747:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784047532.054498:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047532.054503:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784047532.054508:0:93747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784047532.054535:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccec807800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784047532.055122:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709364992:0@lo:39:umount.0 00000100:00100000:1.0:1784047532.055197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047532.055311:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784047532.055320:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709364992 00010000:00010000:0.0:1784047532.055322:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047532.055330:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709364992 00010000:00010000:0.0:1784047532.055335:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047532.055341:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047532.055352:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047532.055360:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047532.055366:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047532.055382:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784047532.055384:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784047532.055416:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047532.055423:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784047532.055431:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1784047532.055442:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709364992:12345-0@lo:39:umount.0 00010000:00010000:0.0:1784047532.055459:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047532.055468:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77573c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784047532.055470:0:67153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775392 00010000:00010000:0.0:1784047532.055485:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047532.055487:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784047532.055490:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccc5024800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784047532.055490:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:3.0:1784047532.055522:0:67153:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc482c700 x1870705709364992/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:663/0 lens 224/224 e 0 to 0 dl 1784047543 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047532.055576:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870705709364992:12345-0@lo:39:umount.0 Request processed in 136us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047532.055585:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000020:00000080:3.0:1784047532.055598:0:67153:0:(genops.c:906:class_export_put()) final put ffff99cce74a1000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1784047532.055716:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709365120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784047532.055749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047532.056009:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784047532.056017:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce74a1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784047532.056070:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc5024800 for lustre-MDT0000 00000100:00080000:3.0:1784047532.056103:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccec807800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784047532.056120:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709364992:0@lo:39:umount.0 00000100:00080000:1.0:1784047532.056202:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784047532.056206:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784047532.056210:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784047532.057396:0:93747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057424:0:93747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057431:0:93747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057438:0:93747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057462:0:93747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047532.057469:0:93747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057475:0:93747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057481:0:93747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057486:0:93747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057499:0:93747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047532.057506:0:93747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057512:0:93747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057527:0:93747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057533:0:93747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057543:0:93747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784047532.057549:0:93747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057555:0:93747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057561:0:93747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057567:0:93747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.057575:0:93747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1784047532.057578:0:93747:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1784047532.057634:0:93747:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784047532.057639:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1784047532.057643:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1784047532.057650:0:93747:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1784047532.059068:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047532.059081:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059091:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbfc00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047532.059096:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059120:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047532.059128:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047532.059133:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047532.059136:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1784047532.059139:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1784047532.059178:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059185:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047532.059214:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059222:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbfc00/0x4426598c0c775743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c77574a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059236:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047532.059240:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059246:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047532.059249:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059256:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047532.059272:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047532.059277:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047532.059279:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784047532.059281:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784047532.059296:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059301:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047532.059317:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059323:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbde00/0x4426598c0c7752b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7752b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059334:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047532.059337:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059343:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047532.059346:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059352:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047532.059358:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047532.059371:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784047532.059374:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784047532.059376:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784047532.059389:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059395:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047532.059401:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059407:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce200/0x4426598c0c775281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c775288 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059416:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047532.059420:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059426:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047532.059429:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059435:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047532.059441:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047532.059447:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784047532.059449:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784047532.059450:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784047532.059471:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059477:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047532.059483:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059488:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46c00/0x4426598c0c7751a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c7751a8 expref: -99 pid: 92453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059497:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047532.059499:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047532.059501:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047532.059508:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047532.059524:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709365376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.059585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047532.059642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047532.059648:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709365504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.059671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047532.059711:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365120 00000100:00100000:3.0:1784047532.059717:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365120 00000100:00100000:3.0:1784047532.059777:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365376 00000100:00100000:3.0:1784047532.059781:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365376 00000100:00100000:3.0:1784047532.059801:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365504 00000100:00100000:3.0:1784047532.059806:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365504 00000100:00100000:3.0:1784047532.059828:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1784047532.059837:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+26:3647:x1870705709365120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047532.059851:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047532.059866:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600600/0x4426598c0c77573c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775735 expref: 26 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059889:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047532.059920:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709365120:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047532.059927:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1784047532.059947:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1784047532.059953:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709365376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047532.059960:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047532.059969:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47000/0x4426598c0c7752b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7752b2 expref: 24 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.059977:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047532.060002:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709365376:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047532.060008:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1784047532.060021:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1784047532.060026:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+22:3645:x1870705709365504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047532.060033:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047532.060042:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd7ea00/0x4426598c0c775288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775281 expref: 22 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.060051:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047532.060073:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+21:3645:x1870705709365504:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047532.060079:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1784047532.060115:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709365248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.060138:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047532.060164:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047532.060170:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709365632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.060194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047532.060219:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365248 00000100:00100000:3.0:1784047532.060224:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365248 00000100:00100000:3.0:1784047532.060245:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365632 00000100:00100000:3.0:1784047532.060248:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365632 00000100:00100000:3.0:1784047532.060265:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1784047532.060270:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+22:3648:x1870705709365248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047532.060278:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047532.060287:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47a00/0x4426598c0c77574a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775743 expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.060296:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047532.060322:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+21:3648:x1870705709365248:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047532.060328:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1784047532.060341:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1784047532.060347:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+20:3648:x1870705709365632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047532.060354:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047532.060363:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cec00/0x4426598c0c7751a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7751a1 expref: 20 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.060371:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047532.060391:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+19:3648:x1870705709365632:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047532.060398:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1784047532.060464:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709365120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.060594:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709365632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.060602:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709365248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.060641:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709365504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047532.060669:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709365376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047532.061317:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047532.061324:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1784047532.062117:0:93747:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1784047532.062327:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1784047532.062335:0:93747:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd001b000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047532.062341:0:93747:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd001a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047532.062358:0:93747:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccd897d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047532.062365:0:93747:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccfe664800 0c846d7a-6357-4e9c-a620-e35737ede709 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:1.0:1784047532.062370:0:93747:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ccfe667800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084296 stale:0 00000020:00080000:1.0:1784047532.062375:0:93747:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff99cbc76ccd40) has exports, disconnecting them 00000020:00080000:1.0:1784047532.062380:0:93747:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd001b000), last request at 1784047505 00000020:00000080:1.0:1784047532.062387:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77538b 00000100:00080000:1.0:1784047532.062398:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d87800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047532.062466:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd001b000): rc 0 00000020:00000080:1.0:1784047532.062468:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccd001b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1784047532.062486:0:93747:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd001a800), last request at 1784047530 00000020:00000080:1.0:1784047532.062489:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775384 00000100:00080000:1.0:1784047532.062494:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccd001c000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047532.062527:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd001b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047532.062590:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc1d87800 for lustre-MDT0000 00010000:00010000:3.0:1784047532.062818:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047532.062938:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd001a800): rc 0 00000020:00000080:1.0:1784047532.062941:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccd001a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784047532.062956:0:93747:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccd897d800), last request at 1784047530 00000020:00000080:1.0:1784047532.062960:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77537d 00000100:00080000:1.0:1784047532.062964:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccd897c800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784047532.063006:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd001a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047532.063034:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd001c000 for lustre-MDT0000 00010000:00010000:3.0:1784047532.063127:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047532.063385:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd897d800): rc 0 00000020:00000080:1.0:1784047532.063388:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccd897d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784047532.063434:0:93747:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.40@tcp (ffff99ccfe664800), last request at 1784047530 00000020:00000080:1.0:1784047532.063444:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775203 00000020:00010000:1.0:1784047532.063459:0:93747:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccfe664800: total 1 00000100:00080000:1.0:1784047532.063462:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccd897e800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1784047532.063481:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccfe664800: total 1 00010000:00010000:3.0:1784047532.063557:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccfe664800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1784047532.063598:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c7758e0 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae489 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.063663:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c77596c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4ac expref: 7 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.063679:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600200/0x4426598c0c7758a1 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae474 expref: 6 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.063697:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600800/0x4426598c0c775885 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae46d expref: 5 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047532.063709:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccfe664800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1784047532.067093:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd897d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047532.067184:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897c800 for lustre-MDT0000 00010000:00010000:0.0:1784047532.067336:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784047532.067474:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccfe664800): rc 0 00000020:00080000:0.0:1784047532.067481:0:93747:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ccfe667800), last request at 1784047499 00000020:00000080:0.0:1784047532.067489:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7751fc 00000020:00010000:0.0:1784047532.067503:0:93747:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccfe667800: total 0 00000100:00080000:0.0:1784047532.067508:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccd0019800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784047532.067531:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccfe667800): rc 0 00000004:00000080:0.0:1784047532.067537:0:93747:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc914168fae0 00000100:00080000:0.0:1784047532.067561:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784047532.067565:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784047532.068443:0:93747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784047532.068471:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99cbcad88800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784047532.068536:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709365760:0@lo:39:umount.0 00000100:00100000:2.0:1784047532.068624:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047532.068789:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365760 00000100:00100000:1.0:1784047532.068798:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365760 00000100:00100000:1.0:1784047532.068847:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1784047532.068857:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709365760:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784047532.068893:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775242 00000100:00080000:1.0:1784047532.068900:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d77800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784047532.068933:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411472 00000020:00010000:0.0:1784047532.071783:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccfe667800: total 0 00010000:00010000:0.0:1784047532.071875:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccfe667800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784047532.071918:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7753ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7753a7 expref: 2 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047532.071942:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccfe667800, canceled 1 locks, left on hash table 0. 00000100:00100000:1.0:1784047532.075115:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3644:x1870705709365760:12345-0@lo:39:umount.0 Request processed in 6249us (6498us total) trans 77309411473 rc 0/0 00000100:00100000:1.0:1784047532.075132:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00010000:00010000:1.0:1784047532.075181:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047532.075744:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784047532.075750:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968755 gen 3 00000004:00080000:1.0:1784047532.075785:0:93747:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784047532.075847:0:93747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784047532.075878:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccfe78d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784047532.075891:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784047532.075894:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968754 gen 3 00000004:00080000:1.0:1784047532.075903:0:93747:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784047532.075960:0:93747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784047532.075980:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99cbcadfa000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784047532.076034:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cbc76ccd40) has no exports 00000100:00080000:2.0:1784047532.080357:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcad88800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784047532.080377:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709365760:0@lo:39:umount.0 00000100:00100000:2.0:1784047532.080499:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709365888:0@lo:9:umount.0 00000100:00100000:2.0:1784047532.080564:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047532.080601:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709366016:0@lo:9:umount.0 00000100:00100000:2.0:1784047532.080645:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784047532.081064:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cbc76ccd40) has no exports 00000100:00100000:2.0:1784047532.085903:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709365888 00000100:00100000:2.0:1784047532.085923:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709365888 00000100:00100000:2.0:1784047532.086073:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366016 00000100:00100000:2.0:1784047532.086077:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366016 00000100:00100000:2.0:1784047532.086107:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5001 00000100:00100000:2.0:1784047532.086120:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709365888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784047532.086153:0:26181:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77525e 00000100:00080000:2.0:1784047532.086163:0:26181:0:(import.c:65:import_set_state_nolock()) ffff99ccec98c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784047532.086209:0:26181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968756 00000100:00100000:2.0:1784047532.086423:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709365888:12345-0@lo:9:umount.0 Request processed in 307us (5858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047532.086431:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5001 00000100:00100000:2.0:1784047532.086448:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5002 00000100:00100000:2.0:1784047532.086454:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709366016:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784047532.086467:0:26181:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77526c 00000100:00080000:2.0:1784047532.086473:0:26181:0:(import.c:65:import_set_state_nolock()) ffff99cbc7656000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784047532.086499:0:26181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968756 00000100:00100000:2.0:1784047532.086594:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3644:x1870705709366016:12345-0@lo:9:umount.0 Request processed in 140us (5948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047532.086600:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5002 00000100:00080000:2.0:1784047532.086664:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccfe78d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784047532.086675:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784047532.086677:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047532.086681:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709365888:0@lo:9:umount.0 00000100:00080000:2.0:1784047532.086702:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcadfa000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784047532.086712:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784047532.086713:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047532.086716:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709366016:0@lo:9:umount.0 00010000:00010000:2.0:1784047532.089670:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047532.090839:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047532.090856:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1784047532.099240:0:6507:0:(genops.c:906:class_export_put()) final put ffff99ccfe664800/0c846d7a-6357-4e9c-a620-e35737ede709 00010000:00010000:3.0:1784047532.099358:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047532.099361:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047532.099364:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047532.099670:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784047532.100075:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe664800/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-MDT0000 00000020:00000080:2.0:1784047532.100149:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897e800 for lustre-MDT0000 00000020:00000080:0.0:1784047532.122151:0:6506:0:(genops.c:906:class_export_put()) final put ffff99ccfe667800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784047532.122246:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe667800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784047532.122310:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd0019800 for lustre-MDT0000 00010000:00010000:2.0:1784047532.122322:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047532.122324:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047532.122328:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047532.142962:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775218 00000020:00000080:1.0:1784047532.143047:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbcd4b7800/lustre-QMT0000_UUID 00000020:01000000:1.0:1784047532.143071:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784047532.143185:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047532.143202:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047532.143207:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99ccc4ac3380) has no exports 00000020:00000080:3.0:1784047532.143322:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcd4b7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784047532.143803:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775211 00000020:00000080:2.0:1784047532.143810:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cce74a5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784047532.143847:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cce74a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047532.144091:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047532.144102:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784047532.144106:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccf756f800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784047532.144108:0:93747:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf756f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784047532.144125:0:93747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1784047532.144557:0:93747:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc10b6e40 - data ffff99ccf3360798/ffff99ccfddc8000 00000020:01000000:2.0:1784047532.144941:0:93747:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc10b6960 - data ffff99ccf79e1438/ffff99cbc9bfc000 00000100:00080000:2.0:1784047532.200531:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784047532.200540:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784047532.200557:0:93747:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99ccc44f2680 x1870705709365760/t77309411473(77309411473) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047542 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047532.200584:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784047532.207877:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047532.207885:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968755 gen 4 00000004:00080000:2.0:1784047532.207900:0:93747:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047532.207902:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047532.208286:0:92473:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047532.208292:0:92473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:1.0:1784047532.208304:0:92473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:2.0:1784047532.210080:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047532.210087:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968754 gen 4 00000004:00080000:2.0:1784047532.210104:0:93747:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047532.210107:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784047532.210448:0:92475:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784047532.210453:0:92475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:1.0:1784047532.210465:0:92475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:2.0:1784047532.211774:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7751cb 00000020:00000080:2.0:1784047532.211786:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c03800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784047532.212419:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7751e0 00000020:00000080:2.0:1784047532.212425:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c01000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047532.212436:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784047532.212441:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047532.212451:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784047532.212455:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99cbc76cb380) has no exports 00000004:01000000:2.0:1784047532.212682:0:93747:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784047532.212691:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775265 00000020:00000080:2.0:1784047532.212769:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c05000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047532.212774:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784047532.212778:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047532.212785:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784047532.212788:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99ccc5e499c0) has no exports 00000020:00000080:2.0:1784047532.212806:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775257 00000020:00000080:2.0:1784047532.212809:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbcadfd000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047532.213031:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c03800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047532.213046:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c01000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784047532.213051:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c05000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784047532.213056:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcadfd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784047532.213500:0:93747:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784047532.213505:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784047532.213509:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968754 gen 5 00000004:00080000:2.0:1784047532.213514:0:93747:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047532.213517:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047532.213562:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047532.213571:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047532.213576:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775249 00000020:00000080:2.0:1784047532.213581:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbc64cd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047532.213584:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784047532.213588:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047532.213591:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784047532.213594:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99cd00d799c0) has no exports 00000020:00000080:2.0:1784047532.213597:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77523b 00000020:00000080:2.0:1784047532.213600:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c00800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047532.213777:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcadfa000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784047532.213784:0:52247:0:(genops.c:906:class_export_put()) final put ffff99ccf2d70000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047532.213786:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d70000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784047532.213792:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047532.213866:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc64cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784047532.213871:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c00800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784047532.214689:0:93747:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784047532.214695:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784047532.214698:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968755 gen 5 00000004:00080000:2.0:1784047532.214714:0:93747:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784047532.214716:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784047532.214754:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047532.214771:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1784047532.214786:0:93747:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784047532.214792:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77522d 00000020:00000080:2.0:1784047532.214797:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbd0b6d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784047532.214803:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1784047532.214807:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047532.214812:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784047532.214815:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99cd00100000) has no exports 00000020:00000080:2.0:1784047532.214820:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775226 00000020:00000080:2.0:1784047532.214833:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbcad8d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784047532.215046:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccfe78d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784047532.215053:0:52247:0:(genops.c:906:class_export_put()) final put ffff99cbd0b6e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784047532.215055:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbd0b6e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784047532.215065:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784047532.215132:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbd0b6d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784047532.215137:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcad8d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784047532.216787:0:93747:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784047532.216795:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784047532.216799:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784047532.216805:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784047532.216866:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047532.216885:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047532.216915:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047532.216918:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047532.216923:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccd0018000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047532.216926:0:93747:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd0018000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784047532.216933:0:93747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784047532.217028:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7751e7 00000020:00000080:1.0:1784047532.217035:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c05800/lustre-MDD0000_UUID 00000020:01000000:1.0:1784047532.217040:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784047532.217044:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047532.217048:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784047532.217052:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cbc76c8000) has no exports 00000020:00000080:1.0:1784047532.217071:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047532.217075:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784047532.217079:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7751ee 00000020:00000080:1.0:1784047532.217093:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c07800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784047532.217100:0:93747:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccc832f800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784047532.217103:0:93747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc832f800 3 00000020:01000004:1.0:1784047532.217106:0:93747:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccc832f800 from lustre-MDT0000 00000020:00000080:1.0:1784047532.217123:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047532.217128:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784047532.217130:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5c07000/lustre-MDT0000_UUID 00000020:00000080:1.0:1784047532.217132:0:93747:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c07000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784047532.217139:0:93747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784047532.217167:0:93747:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784047532.217171:0:93747:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784047532.217173:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784047532.217176:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784047532.217178:0:93747:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784047532.217184:0:93747:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccd8437800 6e36843b-2016-43fe-8842-da5818d68597 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047532.217193:0:93747:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ccf759b000 4f88e784-1ed8-4645-9d2f-1081095d1f30 192.168.204.40@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784047532.217198:0:93747:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff99cceff3cd40) has exports, disconnecting them 00000020:00080000:1.0:1784047532.217202:0:93747:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ccd8437800), last request at 1784047499 00000020:00000080:1.0:1784047532.217223:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775193 00000020:00010000:1.0:1784047532.217227:0:93747:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccd8437800: total 2 00000100:00080000:1.0:1784047532.217231:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccd8436000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047532.217242:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccd8437800): rc 0 00000020:00080000:1.0:1784047532.217245:0:93747:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.40@tcp (ffff99ccf759b000), last request at 1784047493 00000020:00010000:1.0:1784047532.217283:0:16468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccd8437800: total 2 00010000:00010000:1.0:1784047532.217307:0:16468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccd8437800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784047532.217337:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce000/0x4426598c0c775368 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775361 expref: 14 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217359:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601400/0x4426598c0c775782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77577b expref: 13 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217383:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775789 expref: 12 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217394:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbe000/0x4426598c0c77579e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775797 expref: 11 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217404:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbcc00/0x4426598c0c7752d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7752ce expref: 10 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217412:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbec00/0x4426598c0c7757ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7757a5 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217423:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46400/0x4426598c0c7752ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7752f8 expref: 8 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217434:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775751 expref: 7 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217443:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbc400/0x4426598c0c7752f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c7752ea expref: 6 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217455:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cf000/0x4426598c0c775329 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775322 expref: 5 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217465:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c775766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77575f expref: 4 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217474:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbda00/0x4426598c0c77535a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775353 expref: 3 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217497:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88a00/0x4426598c0c775774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77576d expref: 2 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047532.217506:0:16468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccd8437800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784047532.217525:0:16468:0:(genops.c:906:class_export_put()) final put ffff99ccd8437800/6e36843b-2016-43fe-8842-da5818d68597 00010000:00010000:1.0:1784047532.217530:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047532.217532:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047532.217534:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047532.217546:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775170 00000020:00010000:1.0:1784047532.217549:0:93747:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccf759b000: total 3 00000100:00080000:1.0:1784047532.217552:0:93747:0:(import.c:65:import_set_state_nolock()) ffff99ccf7598000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047532.217560:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccf759b000): rc 0 00000020:00080000:1.0:1784047532.217564:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99cceff3cd40) has no exports 00000100:00100000:1.0:1784047532.217642:0:92458:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99cbc9bace00:92458] 0 exiting: rc = 1 00000020:00000080:2.0:1784047532.217780:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcad88800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784047532.217787:0:52247:0:(genops.c:906:class_export_put()) final put ffff99cbc6537800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784047532.217789:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc6537800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1784047532.217798:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047532.217854:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c05800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1784047532.217857:0:52247:0:(genops.c:906:class_export_put()) final put ffff99ccc5c06800/lustre-MDD0000_UUID 00000020:00000080:2.0:1784047532.217859:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c06800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784047532.217862:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1784047532.217884:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5c07800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784047532.217888:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd8437800/6e36843b-2016-43fe-8842-da5818d68597 for MGS 00000020:00000080:2.0:1784047532.217917:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd8436000 for MGS 00000020:00010000:2.0:1784047532.217927:0:15071:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccf759b000: total 0 00010000:00010000:2.0:1784047532.217944:0:15071:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccf759b000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1784047532.217962:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600a00/0x4426598c0c775727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae43c expref: 5 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.217974:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88c00/0x4426598c0c77572e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae443 expref: 4 pid: 92466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.217984:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9cfa00/0x4426598c0c775185 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3d3 expref: 3 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.217996:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccef9ce800/0x4426598c0c77533e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae3e1 expref: 2 pid: 92458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047532.218004:0:15071:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccf759b000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1784047532.218014:0:15071:0:(genops.c:906:class_export_put()) final put ffff99ccf759b000/4f88e784-1ed8-4645-9d2f-1081095d1f30 00010000:00010000:2.0:1784047532.218021:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047532.218029:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047532.218030:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047532.218057:0:92461:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ccef9b7a00:92461] 2 exiting: rc = 0 00000100:00100000:2.0:1784047532.218121:0:92466:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff99cce59c1800:92466] 3 exiting: rc = 0 00000020:00000080:2.0:1784047532.218154:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf759b000/4f88e784-1ed8-4645-9d2f-1081095d1f30 for MGS 00000020:00000080:2.0:1784047532.218168:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf7598000 for MGS 00000100:00100000:1.0:1784047532.290953:0:92459:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99cce7534600:92459] 1 exiting: rc = 0 00000100:00100000:2.0:1784047532.291159:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291168:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291177:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291183:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291190:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291195:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291202:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291208:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291215:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291220:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291226:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291231:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291236:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291241:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291246:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291251:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291258:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291264:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291270:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291275:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291280:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291285:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291291:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291296:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291301:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291307:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291312:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291317:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291338:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291343:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291349:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291354:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291359:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291364:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291370:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291376:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291380:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291386:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291392:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291397:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291402:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291407:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291411:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291416:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291421:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291426:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291431:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291436:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291441:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291447:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291454:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291460:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291465:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291470:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291476:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291481:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291487:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291492:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291498:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291503:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291509:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291514:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291519:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784047532.291531:0:93747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784047532.292365:0:93747:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccc559ade0 - data ffff99ccf32b5798/ffff99ccf288b000 00000020:01000000:2.0:1784047532.292488:0:93747:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cbc781a540 - data ffff99ccf3363ca8/ffff99ccef587800 00000020:00000080:2.0:1784047532.293142:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775169 00000020:00000080:2.0:1784047532.293151:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbc912b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784047532.293169:0:93747:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccc832f800 from MGS, refs=2 00000020:01000004:2.0:1784047532.293173:0:93747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc832f800 2 00000020:01000004:2.0:1784047532.293176:0:93747:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccc832f800 from MGS 00000020:00000080:2.0:1784047532.293196:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047532.293203:0:93747:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784047532.293206:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbc912f000/MGS 00000020:00000080:2.0:1784047532.293208:0:93747:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc912f000/MGS for MGS 00000020:01000000:2.0:1784047532.293215:0:93747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784047532.293283:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784047532.293288:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047532.293298:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784047532.293305:0:93747:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ccc5e51800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047532.293310:0:93747:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99ccc5e4cd40) has exports, disconnecting them 00000020:00080000:2.0:1784047532.293315:0:93747:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ccc5e51800), last request at 1784047499 00000020:00000080:2.0:1784047532.293319:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7752a4 00000020:00080000:2.0:1784047532.293329:0:93747:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc5e51800): rc 0 00000020:00000080:2.0:1784047532.293334:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5e51800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784047532.293381:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc912b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784047532.293393:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e51800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784047532.298394:0:93747:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784047532.298404:0:93747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784047532.298409:0:93747:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784047532.298416:0:93747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784047532.298483:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec807800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784047532.298583:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047532.298598:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784047532.298622:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccc5e57800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784047532.298627:0:93747:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc5e57800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784047532.298637:0:93747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784047532.299504:0:93747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc832f800 1 00000020:00000080:0.0:1784047532.299512:0:93747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77515b 00000020:00000080:0.0:1784047532.299519:0:93747:0:(genops.c:906:class_export_put()) final put ffff99cbc912e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784047532.299539:0:93747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784047532.299545:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047532.299551:0:93747:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784047532.299555:0:93747:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99cceff38000) has no exports 00000020:00000080:1.0:1784047532.299596:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc912e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1784047532.306966:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047532.346849:0:93747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784047532.346864:0:93747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784047532.346870:0:93747:0:(genops.c:906:class_export_put()) final put ffff99ccca573000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784047532.346875:0:93747:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccca573000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784047532.346885:0:93747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784047532.347056:0:93747:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ccc832d800 00000020:02000400:1.0:1784047532.347118:0:93747:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1784047532.677047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047532.677109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:0.0:1784047532.677134:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689487360 offset 0 length 224: 4 00000100:00100000:0.0:1784047532.677152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047532.677187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047532.677217:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689487488 00000100:00100000:0.0:1784047532.677226:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689487488 00000100:00100000:0.0:1784047532.677269:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689487616 00000100:00100000:0.0:1784047532.677272:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689487616 00000100:00100000:0.0:1784047532.677311:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1374 00000100:00100000:0.0:1784047532.677322:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+19:2400:x1870705689487616:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047532.677414:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+19:2400:x1870705689487616:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047532.677422:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1374 00000100:00100000:0.0:1784047532.677442:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1411 00000100:00100000:0.0:1784047532.677446:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870705689487488:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:0.0:1784047532.677452:0:66221:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:0.0:1784047532.677475:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870705689487488:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (440us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047532.677481:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1411 00000100:00100000:0.0:1784047532.677500:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689487744 00000100:00100000:0.0:1784047532.677504:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689487744 00000100:00100000:0.0:1784047532.677532:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689487872 00000100:00100000:0.0:1784047532.677535:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689487872 00000100:00100000:0.0:1784047532.677556:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2625 00000100:00100000:0.0:1784047532.677563:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689487744:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047532.677589:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689487744:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047532.677646:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2625 00000100:00100000:0.0:1784047532.677660:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2626 00000100:00100000:0.0:1784047532.677666:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689487872:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047532.677693:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689487872:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047532.677699:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2626 00000100:00080000:0.0:1784047532.677718:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047532.677722:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047532.677724:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047532.681699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047532.681867:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689488000 00000100:00100000:0.0:1784047532.681877:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689488000 00000100:00100000:0.0:1784047532.681930:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1412 00000100:00100000:0.0:1784047532.681938:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689488000:12345-192.168.204.40@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784047532.681972:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047532.682042:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870705689488000:12345-192.168.204.40@tcp:38:ptlrpcd_00_01.0 Request processed in 103us (353us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047532.682050:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1412 00000100:00100000:0.0:1784047533.334394:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709366144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047533.334471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047533.334545:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047533.334564:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366144 00000100:00100000:0.0:1784047533.334572:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366144 00000100:00100000:0.0:1784047533.334648:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1784047533.334659:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709366144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047533.334689:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047533.334757:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709366144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047533.334766:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00080000:0.0:1784047533.334798:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047533.334845:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709366144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047533.335357:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047533.335370:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709366272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047533.335412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047533.335450:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366272 00000100:00100000:3.0:1784047533.335456:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366272 00000100:00100000:3.0:1784047533.335495:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:3.0:1784047533.335503:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709366272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047533.335523:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047533.335662:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709366272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047533.335670:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:3.0:1784047533.335711:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709366272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784047533.336103:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784047534.360213:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047535.380931:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047535.890991:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709366400:0@lo:400:kworker.0 00000400:00000100:3.0:1784047535.891132:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709366400 offset 0 length 224: 4 00000100:00100000:3.0:1784047535.891190:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709366912:0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.891236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047535.891318:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709367424:0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.891345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047535.891383:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784047535.891390:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709366784:0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.891413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047535.891459:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367424 00000100:00100000:1.0:1784047535.891478:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367424 00000100:00100000:0.0:1784047535.891546:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709366528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047535.891589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047535.891635:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709367040:0@lo:400:kworker.0 00000100:00100000:0.0:1784047535.891668:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709366656:0@lo:400:kworker.0 00000100:00080000:0.0:1784047535.891715:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047535.891742:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366528 00000100:00100000:0.0:1784047535.891747:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366528 00000100:00100000:0.0:1784047535.891801:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:0.0:1784047535.891813:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1870705709366528:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1784047535.891824:0:8442:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784047535.891881:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1870705709366528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (290us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047535.891890:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1784047535.891975:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1784047535.891984:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709367424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047535.892042:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709367424:12345-0@lo:400:kworker.0 Request processed in 60us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047535.892051:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1784047535.902183:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709367296:0@lo:400:kworker.0 00000100:00100000:1.0:1784047535.902251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047535.903188:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047535.903289:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709367424:0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.903380:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367296 00000100:00100000:3.0:1784047535.903388:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367296 00000100:00100000:3.0:1784047535.903473:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1784047535.903484:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709367296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.903569:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709367296:12345-0@lo:400:kworker.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047535.903578:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00080000:3.0:1784047535.903627:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047535.903653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709367296:0@lo:400:kworker.0 00000100:00100000:2.0:1784047535.909558:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366912 00000100:00100000:2.0:1784047535.909580:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366912 00000100:00100000:1.0:1784047535.912637:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709367552:0@lo:400:kworker.0 00000100:00100000:1.0:1784047535.912764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047535.913334:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366784 00000100:00100000:3.0:1784047535.913344:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366784 00000100:00100000:3.0:1784047535.913424:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367040 00000100:00100000:3.0:1784047535.913428:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367040 00000100:00100000:3.0:1784047535.913444:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367552 00000100:00100000:3.0:1784047535.913446:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367552 00000100:00100000:3.0:1784047535.913465:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1784047535.913475:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709366784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.913575:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709366784:12345-0@lo:400:kworker.0 Request processed in 101us (22160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047535.913584:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1784047535.913634:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1784047535.913642:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709367040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.913676:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709367040:12345-0@lo:400:kworker.0 Request processed in 36us (11428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047535.913721:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1784047535.913734:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1784047535.913739:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1870705709367552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784047535.913759:0:68026:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784047535.913793:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1870705709367552:12345-0@lo:400:kworker.0 Request processed in 52us (1030us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047535.913800:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00080000:3.0:1784047535.913831:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047535.913849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047535.913918:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047535.913927:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047535.913932:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047535.913941:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047535.913946:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3603 00000100:00080000:1.0:1784047535.913955:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047535.913998:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482fb80 x1870705709367680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047535.914043:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709367552:0@lo:400:kworker.0 00000100:02020000:1.0:1784047535.914094:0:3647:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1784047535.914099:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784047535.914102:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784047535.914106:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784047535.914111:0:3647:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784047535.914115:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3603 00000100:00080000:1.0:1784047535.914130:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047535.914145:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc482f800 x1870705709367808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047535.914175:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709367040:0@lo:400:kworker.0 00000001:00100000:1.0:1784047535.914283:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784047535.914296:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411473 is committed 00000020:00000080:1.0:1784047535.914300:0:75662:0:(genops.c:906:class_export_put()) final put ffff99ccf2d74800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784047535.914334:0:75662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411472 is committed 00010000:00010000:1.0:1784047535.914716:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914731:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914741:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914748:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbfa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047535.914755:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914764:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914793:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff99cce7ec2e00) 00010000:00010000:1.0:1784047535.914797:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047535.914804:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914812:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebdbfa00/0x4426598c0c7759ab lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914934:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914942:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914949:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914955:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047535.914958:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914964:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914974:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99cbc6765500) 00010000:00010000:1.0:1784047535.914977:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047535.914980:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914986:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cd00600e00/0x4426598c0c7759c0 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.914999:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915006:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915013:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915026:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047535.915029:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915037:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915046:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff99ccc2b81800) 00010000:00010000:1.0:1784047535.915049:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047535.915052:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915059:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89a00/0x4426598c0c775a06 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915079:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915085:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915090:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915095:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047535.915098:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915104:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915126:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:1.0:1784047535.915128:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047535.915131:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047535.915138:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cce3b89200/0x4426598c0c775a1b lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047535.915201:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366656 00000100:00100000:1.0:1784047535.915210:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366656 00000100:00100000:1.0:1784047535.915257:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1784047535.915265:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1870705709366656:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784047535.915275:0:67153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047535.915339:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1870705709366656:12345-0@lo:400:kworker.0 Request processed in 73us (1488us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784047535.915347:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1784047535.915501:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709366784:0@lo:400:kworker.0 00000020:00000080:1.0:1784047535.915803:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccf2d74800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1784047535.915976:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccf2d77800 for lustre-MDT0001 00000100:00100000:1.0:1784047535.916003:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709367680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784047535.916043:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1784047535.916068:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1870705709366912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047535.916068:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784047535.916078:0:67153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784047535.916102:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc482f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709367808:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784047535.916130:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367680 00000100:00100000:2.0:1784047535.916133:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1870705709366912:12345-0@lo:400:kworker.0 Request processed in 68us (24897us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047535.916139:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367680 00000100:00100000:2.0:1784047535.916142:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1784047535.916149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047535.916197:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1784047535.916198:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367808 00000100:00100000:0.0:1784047535.916204:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367808 00000100:00080000:2.0:1784047535.916207:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784047535.916213:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1784047535.916218:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00080000:2.0:1784047535.916221:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784047535.916227:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709367680:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1784047535.916229:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3603 00000100:00080000:2.0:1784047535.916240:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00010000:00020000:1.0:1784047535.916255:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047535.916273:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3ea00 x1870705709367936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047535.916301:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709367680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 75us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047535.916309:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1784047535.916333:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709367936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784047535.916359:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047535.916448:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:0.0:1784047535.916455:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709367808:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1784047535.916469:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047535.917438:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709367168:0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.917494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047535.917552:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784047535.917557:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784047535.917561:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784047535.917566:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047535.917570:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3603 00000100:00080000:3.0:1784047535.917578:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047535.917634:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef514000 x1870705709368064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047535.918384:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709366656:0@lo:400:kworker.0 00000100:00100000:3.0:1784047535.918449:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367168 00000100:00100000:3.0:1784047535.918457:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367168 00000100:00100000:3.0:1784047535.918506:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1784047535.918515:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1870705709367168:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784047535.918545:0:8442:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784047535.918651:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1870705709367168:12345-0@lo:400:kworker.0 Request processed in 135us (1155us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047535.918659:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1784047535.918700:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709367936 00000100:00100000:3.0:1784047535.918704:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709367936 00000100:00100000:3.0:1784047535.918724:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1784047535.918729:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709367936:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784047535.918753:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047535.918788:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709367936:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 58us (2427us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047535.918795:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00080000:3.0:1784047535.918829:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784047535.918834:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99cbc6531800 already not connected (conn 73, was 73): CONNECTING 00000100:00100000:3.0:1784047535.918840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709367168:0@lo:400:kworker.0 00000001:00100000:3.0:1784047535.918963:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047535.918969:0:9510:0:(genops.c:906:class_export_put()) final put ffff99cbc7656800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784047535.919001:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968756 is committed 00000020:00000080:3.0:1784047535.919032:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc7656800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784047535.919100:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc7656000 for lustre-OST0001 00000100:00080000:1.0:1784047535.922728:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047535.922752:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047535.922759:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709367680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784047535.922916:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709367808:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 6456us (6762us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047535.922932:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00080000:1.0:1784047535.923110:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047535.923116:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047535.923119:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc482f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709367808:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784047535.923305:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709368064:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784047535.923308:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709366912:0@lo:400:kworker.0 00000100:00100000:1.0:1784047535.924003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047535.924076:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047535.924083:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047535.924087:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709367936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784047535.924302:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368064 00000100:00100000:3.0:1784047535.924312:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368064 00000100:00100000:3.0:1784047535.924441:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1784047535.924452:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709368064:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1784047535.924487:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047535.925665:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709368064:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1203us (1654us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047535.925712:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00080000:1.0:1784047535.925794:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047535.925801:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047535.925805:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709368064:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1784047536.403093:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047537.428507:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047537.803487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:0.0:1784047537.803526:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689488128 offset 0 length 224: 4 00000100:00100000:0.0:1784047537.803548:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047537.803578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047537.803665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047537.803793:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689488512 00000100:00100000:1.0:1784047537.803818:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689488512 00000100:00100000:1.0:1784047537.804069:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689488640 00000100:00100000:1.0:1784047537.804074:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689488640 00000100:00100000:1.0:1784047537.804101:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2629 00000100:00080000:0.0:1784047537.804208:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047537.804214:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047537.804253:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2630 00000100:00100000:0.0:1784047537.804264:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689488640:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047537.804443:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689488640:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 180us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047537.804452:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2630 00000100:00100000:1.0:1784047537.804521:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689488512:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047537.804582:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689488512:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 472us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047537.804590:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2629 00000100:00100000:2.0:1784047537.804758:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689488256 00000100:00100000:2.0:1784047537.804765:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689488256 00000100:00100000:2.0:1784047537.804800:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689488384 00000100:00100000:2.0:1784047537.804803:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689488384 00000100:00100000:2.0:1784047537.805039:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1377 00000100:00100000:2.0:1784047537.805049:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689488384:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047537.805087:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689488384:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 41us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047537.805095:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1377 00000100:00100000:2.0:1784047537.805109:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1419 00000100:00100000:2.0:1784047537.805196:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689488256:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047537.805223:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047537.805257:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689488256:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 140us (1786us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047537.805278:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1419 00000100:00080000:1.0:1784047537.805470:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1784047537.946557:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784047537.946573:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccd8416800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784047537.947111:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd8416800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784047537.947358:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccec98c800 for lustre-OST0000 00010000:00010000:0.0:1784047538.451250:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047538.451422:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709368192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047538.451521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047538.451795:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368192 00000100:00100000:3.0:1784047538.451806:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368192 00000100:00100000:3.0:1784047538.451881:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1784047538.451893:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709368192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047538.451939:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047538.452001:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709368192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047538.452010:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00080000:1.0:1784047538.452148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047538.452197:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709368192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047538.452799:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709368320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047538.452853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047538.452912:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368320 00000100:00100000:0.0:1784047538.452918:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368320 00000100:00100000:0.0:1784047538.452983:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:0.0:1784047538.452993:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709368320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047538.453018:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047538.453060:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709368320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047538.453067:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:0.0:1784047538.453137:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709368320:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047538.453280:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784047539.475043:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047540.501466:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784047541.012524:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047541.012534:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047541.012539:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047541.012552:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1784047541.012560:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047541.012570:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047541.012631:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef514700 x1870705709368576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047541.012672:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047541.012676:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047541.012678:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047541.012682:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1784047541.012684:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047541.012707:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047541.012721:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef515880 x1870705709368832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047541.012739:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047541.012742:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047541.012744:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047541.012747:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1784047541.012750:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047541.012754:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047541.012764:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef516d80 x1870705709369088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047541.012785:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047541.012788:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047541.012790:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047541.012793:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1784047541.012795:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784047541.012799:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047541.012810:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfa3eb800 x1870705709369472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047541.013024:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709369216:0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013133:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047541.013179:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784047541.013187:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709368448:0@lo:400:kworker.0 00000400:00000100:0.0:1784047541.013213:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709368448 offset 0 length 224: 4 00000100:00100000:0.0:1784047541.013242:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709369344:0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047541.013306:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709368704:0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013315:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369216 00000100:00100000:0.0:1784047541.013339:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369216 00000100:00100000:2.0:1784047541.013355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047541.013387:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047541.013394:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709368960:0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013410:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369344 00000100:00100000:0.0:1784047541.013416:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369344 00000100:00100000:2.0:1784047541.013426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047541.013454:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1784047541.013468:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1784047541.013469:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709369216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047541.013492:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709369344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013548:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709369216:12345-0@lo:400:kworker.0 Request processed in 83us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047541.013550:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709369344:12345-0@lo:400:kworker.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047541.013561:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:0.0:1784047541.013659:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709369344:0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013674:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709369216:0@lo:400:kworker.0 00000100:00100000:0.0:1784047541.013710:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368704 00000100:00100000:0.0:1784047541.013714:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368704 00000100:00080000:1.0:1784047541.013728:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047541.013737:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047541.013740:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047541.013749:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368960 00000100:00100000:0.0:1784047541.013753:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368960 00000100:00100000:1.0:1784047541.013761:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709368576:0@lo:38:kworker.0 00000100:00100000:0.0:1784047541.013782:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:0.0:1784047541.013791:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709368704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047541.013804:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047541.013832:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709368832:0@lo:38:kworker.0 00000100:00100000:0.0:1784047541.013841:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709368704:12345-0@lo:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047541.013862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047541.013864:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1784047541.013879:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709369088:0@lo:38:kworker.0 00000100:00100000:0.0:1784047541.013881:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368576 00000100:00100000:0.0:1784047541.013887:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368576 00000100:00100000:0.0:1784047541.013898:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709368832 00000100:00100000:0.0:1784047541.013902:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709368832 00000100:00100000:0.0:1784047541.013913:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1784047541.013921:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047541.013932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047541.013962:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709369472:0@lo:38:kworker.0 00000100:00100000:0.0:1784047541.013967:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709368960:12345-0@lo:400:kworker.0 Request processed in 45us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047541.013976:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1784047541.013989:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1784047541.013998:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709368576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784047541.014000:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1784047541.014023:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047541.014035:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369088 00000100:00100000:1.0:1784047541.014041:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369088 00000100:00100000:0.0:1784047541.014062:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709368576:12345-0@lo:38:kworker.0 Request processed in 65us (258us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047541.014070:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1784047541.014084:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369472 00000100:00100000:1.0:1784047541.014086:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1784047541.014089:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369472 00000100:00100000:1.0:1784047541.014094:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709369088:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047541.014108:0:8442:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047541.014111:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1784047541.014117:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709368832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047541.014128:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047541.014161:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709369088:12345-0@lo:38:kworker.0 Request processed in 65us (228us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047541.014168:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709368832:12345-0@lo:38:kworker.0 Request processed in 47us (306us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047541.014173:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1784047541.014181:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1784047541.014197:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1784047541.014202:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709369472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047541.014217:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784047541.014243:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047541.014244:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709369472:12345-0@lo:38:kworker.0 Request processed in 40us (247us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047541.014255:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00080000:1.0:1784047541.014290:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047541.014297:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047541.014301:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709368576:0@lo:38:kworker.0 00000100:00080000:1.0:1784047541.014311:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047541.014315:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047541.014318:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709368832:0@lo:38:kworker.0 00000100:00080000:1.0:1784047541.014327:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047541.014330:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047541.014333:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709369088:0@lo:38:kworker.0 00000100:00080000:1.0:1784047541.014341:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047541.014344:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047541.014346:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709369472:0@lo:38:kworker.0 00000100:00100000:3.0:1784047541.014589:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709368960:0@lo:400:kworker.0 00000100:00100000:3.0:1784047541.014642:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709368704:0@lo:400:kworker.0 00000100:00100000:2.0:1784047541.022416:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00010000:00010000:2.0:1784047541.522917:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047542.548740:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047542.919759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047542.919827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047542.919865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:1.0:1784047542.919890:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689488768 offset 0 length 224: 4 00000100:00100000:1.0:1784047542.919917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047542.919988:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489024 00000100:00100000:0.0:1784047542.920003:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489024 00000100:00100000:2.0:1784047542.920095:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489280 00000100:00100000:0.0:1784047542.920101:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689488896 00000100:00100000:2.0:1784047542.920102:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489280 00000100:00100000:0.0:1784047542.920108:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689488896 00000100:00100000:3.0:1784047542.920144:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1380 00000100:00100000:2.0:1784047542.920149:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489152 00000100:00100000:2.0:1784047542.920152:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489152 00000100:00100000:0.0:1784047542.920157:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1423 00000100:00100000:3.0:1784047542.920163:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689489024:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047542.920170:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689488896:12345-192.168.204.40@tcp:38:kworker.0 00000100:00100000:2.0:1784047542.920181:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2633 00000100:00100000:2.0:1784047542.920188:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689489280:12345-192.168.204.40@tcp:400:kworker.0 00010000:00020000:0.0:1784047542.920207:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784047542.920274:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047542.920280:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689489280:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 90us (412us total) trans 0 rc 0/0 00000100:00080000:1.0:1784047542.920282:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047542.920286:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047542.920293:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2633 00000100:00100000:2.0:1784047542.920314:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2634 00000100:00100000:2.0:1784047542.920334:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689489152:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047542.929345:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689489024:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 9167us (9580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047542.929368:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1380 00000100:00100000:0.0:1784047542.929716:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689488896:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 9544us (9884us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047542.929727:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1423 00000100:00100000:2.0:1784047542.935403:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689489152:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 15062us (15464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047542.935449:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2634 00010000:00010000:0.0:1784047543.570902:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047543.571375:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709369600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047543.571484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047543.572297:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709369728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047543.572369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047543.572389:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369600 00000100:00100000:3.0:1784047543.572401:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369600 00000100:00100000:1.0:1784047543.572409:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369728 00000100:00100000:1.0:1784047543.572417:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369728 00000100:00100000:3.0:1784047543.572516:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:3.0:1784047543.572541:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709369600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047543.572592:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047543.572947:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709369600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 408us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047543.572964:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1784047543.573362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709369600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047543.578094:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:1.0:1784047543.578124:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709369728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047543.578174:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047543.578309:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709369728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 197us (5939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047543.578319:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00080000:2.0:1784047543.579508:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784047543.579520:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047543.581732:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709369728:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047544.594977:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047545.618811:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047546.132891:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047546.132900:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047546.132905:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047546.132917:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3639 00000100:00100000:3.0:1784047546.132924:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784047546.132926:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047546.132938:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047546.132955:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709369856:0@lo:400:kworker.0 00000100:00100000:2.0:1784047546.132974:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3d500 x1870705709369984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047546.133011:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047546.133015:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047546.133017:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047546.133021:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1784047546.133024:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047546.133029:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000400:00000100:3.0:1784047546.133034:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709369856 offset 0 length 224: 4 00000100:00100000:2.0:1784047546.133044:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3ea00 x1870705709370240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047546.133077:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047546.133082:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047546.133084:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784047546.133094:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709370112:0@lo:400:kworker.0 00000100:00080000:2.0:1784047546.133102:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1784047546.133106:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047546.133111:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047546.133130:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c3d880 x1870705709370496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047546.133141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047546.133170:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784047546.133170:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047546.133176:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784047546.133180:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709370752:0@lo:400:kworker.0 00000100:00080000:2.0:1784047546.133180:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047546.133189:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1784047546.133192:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784047546.133196:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047546.133210:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec97aa00 x1870705709370880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047546.133221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133241:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709369984:0@lo:38:kworker.0 00000100:00100000:2.0:1784047546.133276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133303:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709370240:0@lo:38:kworker.0 00000100:00100000:2.0:1784047546.133324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133348:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709370496:0@lo:38:kworker.0 00000100:00100000:2.0:1784047546.133373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133391:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709370880:0@lo:38:kworker.0 00000100:00100000:2.0:1784047546.133410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133458:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709370368:0@lo:400:kworker.0 00000100:00100000:2.0:1784047546.133484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133517:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047546.133532:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709370624:0@lo:400:kworker.0 00000100:00100000:2.0:1784047546.133558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047546.133597:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370112 00000100:00100000:2.0:1784047546.133635:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370112 00000100:00100000:2.0:1784047546.133708:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709369984 00000100:00100000:2.0:1784047546.133712:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709369984 00000100:00100000:2.0:1784047546.133724:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370240 00000100:00100000:2.0:1784047546.133727:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370240 00000100:00100000:2.0:1784047546.133736:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370880 00000100:00100000:2.0:1784047546.133738:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370880 00000100:00100000:2.0:1784047546.133751:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370368 00000100:00100000:2.0:1784047546.133754:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370368 00000100:00100000:3.0:1784047546.133762:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1784047546.133779:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709370112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047546.133780:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:2.0:1784047546.133793:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709370368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047546.133862:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709370112:12345-0@lo:400:kworker.0 Request processed in 88us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047546.133864:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709370368:12345-0@lo:400:kworker.0 Request processed in 73us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047546.133879:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1784047546.133966:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:2.0:1784047546.133983:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1784047546.133988:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709369984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047546.134009:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047546.134048:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709369984:12345-0@lo:38:kworker.0 Request processed in 58us (770us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047546.134055:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1784047546.134067:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1784047546.134071:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709370240:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047546.134079:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047546.134104:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709370240:12345-0@lo:38:kworker.0 Request processed in 31us (778us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047546.134117:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1784047546.134129:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1784047546.134133:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709370880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047546.134143:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047546.134168:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870705709370880:12345-0@lo:38:kworker.0 Request processed in 34us (757us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047546.134174:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1784047546.134198:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370496 00000100:00100000:2.0:1784047546.134203:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370496 00000100:00100000:2.0:1784047546.134227:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1784047546.134232:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709370496:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047546.134242:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047546.134268:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709370496:12345-0@lo:38:kworker.0 Request processed in 35us (894us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047546.134275:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1784047546.134302:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370752 00000100:00100000:2.0:1784047546.134305:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370752 00000100:00100000:2.0:1784047546.134334:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709370624 00000100:00100000:2.0:1784047546.134337:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709370624 00000100:00100000:2.0:1784047546.134360:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1784047546.134369:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709370752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047546.134409:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709370752:12345-0@lo:400:kworker.0 Request processed in 43us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047546.134414:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709370112:0@lo:400:kworker.0 00000100:00100000:2.0:1784047546.134420:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1784047546.134453:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709370752:0@lo:400:kworker.0 00000100:00100000:0.0:1784047546.134569:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1784047546.134580:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709370624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047546.134635:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709370624:12345-0@lo:400:kworker.0 Request processed in 59us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047546.134642:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00080000:0.0:1784047546.134692:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047546.134697:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047546.134699:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047546.134719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709370624:0@lo:400:kworker.0 00000100:00100000:0.0:1784047546.134730:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709370368:0@lo:400:kworker.0 00000100:00080000:0.0:1784047546.134768:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047546.134780:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047546.134783:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709369984:0@lo:38:kworker.0 00000100:00080000:0.0:1784047546.134797:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047546.134800:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047546.134803:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709370240:0@lo:38:kworker.0 00000100:00080000:0.0:1784047546.134813:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047546.134818:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047546.134821:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709370496:0@lo:38:kworker.0 00000100:00080000:0.0:1784047546.134831:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047546.134835:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047546.134841:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709370880:0@lo:38:kworker.0 00010000:00010000:0.0:1784047546.643276:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047547.666903:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047548.059035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000400:00000100:3.0:1784047548.059081:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689489408 offset 0 length 224: 4 00000100:00100000:3.0:1784047548.059105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047548.059131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047548.059153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047548.059189:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489664 00000100:00100000:3.0:1784047548.059200:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489664 00000100:00100000:3.0:1784047548.059273:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489536 00000100:00100000:3.0:1784047548.059276:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489536 00000100:00100000:3.0:1784047548.060863:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1383 00000100:00100000:3.0:1784047548.060895:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689489664:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047548.061042:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689489664:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 164us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047548.061052:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1383 00000100:00100000:3.0:1784047548.061076:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1427 00000100:00100000:3.0:1784047548.061082:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689489536:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:3.0:1784047548.061107:0:66220:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047548.061138:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1870705689489536:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 54us (2004us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047548.061145:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1427 00000100:00100000:3.0:1784047548.061180:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489920 00000100:00100000:3.0:1784047548.061188:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489920 00000100:00100000:3.0:1784047548.061238:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689489792 00000100:00100000:3.0:1784047548.061250:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689489792 00000100:00100000:3.0:1784047548.061275:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2637 00000100:00100000:3.0:1784047548.061281:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689489920:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047548.061825:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5003 00000100:00100000:0.0:1784047548.061838:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689489792:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1784047548.061981:0:26180:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c7753d1 00000100:00080000:0.0:1784047548.061994:0:26180:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784047548.062056:0:26180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968756 00000100:00100000:0.0:1784047548.062251:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+2:2398:x1870705689489792:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 416us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047548.062266:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5003 00000100:00100000:3.0:1784047548.063730:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689489920:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2435us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047548.063746:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2637 00010000:00010000:1.0:1784047548.064086:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047548.067817:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047548.067832:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047548.067836:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1784047548.079841:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.40@tcp portal 26 match 1870705689490048 offset 0 length 520: 4 00000100:00100000:0.0:1784047548.691833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709371008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047548.691977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047548.692130:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1784047548.692136:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047548.692160:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709371136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047548.692169:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371008 00000100:00100000:3.0:1784047548.692179:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371008 00000100:00100000:2.0:1784047548.692196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047548.692246:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371136 00000100:00100000:2.0:1784047548.692250:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371136 00000100:00100000:3.0:1784047548.692295:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1784047548.692309:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709371008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047548.692354:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047548.693501:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709371008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1189us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047548.693518:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1784047548.693561:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:3.0:1784047548.693577:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709371136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047548.693624:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047548.693689:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709371136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047548.693710:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:1.0:1784047548.693909:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709371136:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784047548.695002:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047548.695022:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047548.697399:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709371008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784047549.718212:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047550.741002:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047551.251203:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047551.251211:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047551.251215:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047551.251223:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3644 00000100:00080000:2.0:1784047551.251229:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047551.251236:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047551.251261:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec979880 x1870705709371392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047551.251298:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047551.251301:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047551.251303:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047551.251306:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3644 00000100:00080000:2.0:1784047551.251309:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047551.251312:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047551.251322:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec97aa00 x1870705709371648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047551.251335:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047551.251339:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047551.251340:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047551.251344:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3644 00000100:00080000:2.0:1784047551.251346:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047551.251364:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047551.251380:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec97b100 x1870705709371904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047551.251413:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709371264:0@lo:400:kworker.0 00000100:00080000:2.0:1784047551.251426:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047551.251431:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047551.251432:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047551.251435:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3644 00000100:00080000:2.0:1784047551.251438:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784047551.251442:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047551.251454:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00d04e00 x1870705709372288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1784047551.251471:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709371264 offset 0 length 224: 4 00000100:00100000:2.0:1784047551.251495:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709372032:0@lo:400:kworker.0 00000100:00100000:1.0:1784047551.251521:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709372160:0@lo:400:kworker.0 00000100:00100000:2.0:1784047551.251544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047551.251575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047551.251597:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709371392:0@lo:38:kworker.0 00000100:00100000:1.0:1784047551.251643:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372032 00000100:00100000:1.0:1784047551.251650:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372032 00000100:00100000:1.0:1784047551.251708:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372160 00000100:00100000:1.0:1784047551.251712:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372160 00000100:00100000:1.0:1784047551.251736:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1784047551.251745:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709372032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047551.251797:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709372032:12345-0@lo:400:kworker.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047551.251813:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1784047551.251847:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1784047551.251856:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709372160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047551.251912:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709372160:12345-0@lo:400:kworker.0 Request processed in 57us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047551.251919:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1784047551.251957:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709372160:0@lo:400:kworker.0 00000100:00100000:2.0:1784047551.253774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047551.253824:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709371648:0@lo:38:kworker.0 00000100:00100000:2.0:1784047551.253854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047551.253989:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709371904:0@lo:38:kworker.0 00000100:00100000:2.0:1784047551.254022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047551.254044:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709372288:0@lo:38:kworker.0 00000100:00100000:2.0:1784047551.254068:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047551.254116:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709371520:0@lo:400:kworker.0 00000100:00100000:2.0:1784047551.254149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047551.254234:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047551.254240:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047551.254255:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047551.254274:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709371776:0@lo:400:kworker.0 00000100:00100000:1.0:1784047551.254277:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371392 00000100:00100000:1.0:1784047551.254286:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371392 00000100:00100000:2.0:1784047551.254310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047551.255073:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371648 00000100:00100000:2.0:1784047551.255074:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372288 00000100:00100000:2.0:1784047551.255081:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372288 00000100:00100000:1.0:1784047551.255081:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371648 00000100:00100000:1.0:1784047551.255108:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371520 00000100:00100000:2.0:1784047551.255111:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371776 00000100:00100000:1.0:1784047551.255113:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371520 00000100:00100000:2.0:1784047551.255116:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371776 00000100:00100000:1.0:1784047551.255166:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1784047551.255176:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709371520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047551.255238:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709371520:12345-0@lo:400:kworker.0 Request processed in 64us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047551.255245:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1784047551.255261:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1784047551.255267:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709371776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047551.255294:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709371776:12345-0@lo:400:kworker.0 Request processed in 27us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047551.255301:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1784047551.255314:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1784047551.255322:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709371392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047551.255340:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047551.255411:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709371392:12345-0@lo:38:kworker.0 Request processed in 91us (1642us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047551.255417:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1784047551.255429:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1784047551.255433:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709371648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047551.255444:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784047551.255481:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.255487:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047551.255491:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709371392:0@lo:38:kworker.0 00000100:00100000:2.0:1784047551.255600:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1784047551.255622:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709372288:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047551.255636:0:66221:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047551.255659:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709371648:12345-0@lo:38:kworker.0 Request processed in 223us (1804us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047551.255667:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00080000:0.0:1784047551.255669:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.255674:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047551.255677:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709371648:0@lo:38:kworker.0 00000100:00080000:0.0:1784047551.255693:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.255698:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047551.255701:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870705709372288:12345-0@lo:38:kworker.0 Request processed in 91us (1628us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047551.255701:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709371776:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.255702:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709372288:0@lo:38:kworker.0 00000100:00100000:2.0:1784047551.255715:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1784047551.255720:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709371520:0@lo:400:kworker.0 00000100:00100000:2.0:1784047551.255751:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709371904 00000100:00100000:2.0:1784047551.255756:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709371904 00000100:00100000:2.0:1784047551.255782:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1784047551.255786:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709371904:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047551.255797:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047551.255848:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709371904:12345-0@lo:38:kworker.0 Request processed in 60us (1825us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047551.255855:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1784047551.255901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709372032:0@lo:400:kworker.0 00000100:00080000:0.0:1784047551.256904:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047551.258215:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047551.258224:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047551.258230:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709371904:0@lo:38:kworker.0 00000100:00000400:0.0:1784047551.752494:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047535/real 1784047535] req@ffff99cbc5a27800 x1870705709366400/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047551 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047551.752533:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99cbc5a27800 x1870705709366400/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047551.752543:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784047551.752565:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1784047551.752569:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784047551.752571:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784047551.752575:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cbc5a27800 x1870705709366400/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1784047551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047551.752584:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccef514380 x1870705709368448/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047551.752632:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccfa3e8000 x1870705709369856/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047551.752642:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccec97b480 x1870705709371264/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784047551.752656:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784047551.752659:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784047551.752660:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784047551.752662:0:3646:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1784047551.752696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709369856:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.752702:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709366400:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.752744:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709368448:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.752771:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709371264:0@lo:400:kworker.0 00000100:00080000:0.0:1784047551.752791:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047551.752795:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784047551.752798:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047551.752803:0:45180:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3597 00000100:00080000:0.0:1784047551.752812:0:45180:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047551.752848:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef514380 x1870705709372416/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047551.752880:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047551.752884:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047551.752886:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047551.752890:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3649 00000100:00080000:0.0:1784047551.752894:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047551.752898:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047551.752916:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef516d80 x1870705709372544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047551.752938:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047551.752942:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047551.752944:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047551.752947:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3649 00000100:00080000:0.0:1784047551.752949:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047551.752953:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047551.752963:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef514700 x1870705709372800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047551.752978:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047551.752981:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047551.752984:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047551.752988:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3649 00000100:00080000:0.0:1784047551.752991:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047551.752994:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047551.753004:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef514000 x1870705709373056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047551.753045:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047551.753048:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784047551.753049:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047551.753053:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3649 00000100:00080000:0.0:1784047551.753055:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784047551.753059:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047551.753069:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccec97b480 x1870705709373440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047551.753095:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709372416:0@lo:250:kworker.0 00000400:00000100:0.0:1784047551.753142:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705709372416 offset 0 length 520: 4 00000100:00100000:0.0:1784047551.753176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709372544:0@lo:38:kworker.0 00000100:00100000:0.0:1784047551.753211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.753232:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709372800:0@lo:38:kworker.0 00000100:00100000:0.0:1784047551.753252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.753268:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709373056:0@lo:38:kworker.0 00000100:00100000:0.0:1784047551.753297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.753314:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709373440:0@lo:38:kworker.0 00000100:00100000:0.0:1784047551.753334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.753362:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709373184:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.753400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.753423:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047551.753430:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709373312:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.753453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.753496:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372544 00000100:00100000:0.0:1784047551.753504:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372544 00000100:00100000:0.0:1784047551.753537:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372800 00000100:00100000:0.0:1784047551.753540:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372800 00000100:00100000:0.0:1784047551.753561:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373440 00000100:00100000:0.0:1784047551.753565:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373440 00000100:00100000:0.0:1784047551.753579:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1784047551.753586:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709372544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047551.753627:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047551.753669:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709372544:12345-0@lo:38:kworker.0 Request processed in 82us (457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047551.753677:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1784047551.753693:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1784047551.753697:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709372800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047551.753706:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047551.753729:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709372800:12345-0@lo:38:kworker.0 Request processed in 31us (476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047551.753735:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1784047551.753747:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1784047551.753750:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709373440:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047551.753759:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047551.753783:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709373440:12345-0@lo:38:kworker.0 Request processed in 30us (448us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047551.753789:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1784047551.753806:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373184 00000100:00100000:0.0:1784047551.753809:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373184 00000100:00100000:0.0:1784047551.753839:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373312 00000100:00100000:0.0:1784047551.753848:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373312 00000100:00100000:0.0:1784047551.753871:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:0.0:1784047551.753877:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709373184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.753919:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709373184:12345-0@lo:400:kworker.0 Request processed in 41us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047551.753926:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:0.0:1784047551.753938:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1784047551.753944:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709373312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.753970:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709373312:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047551.753976:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1784047551.754004:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709372672:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.754050:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047551.754055:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709372928:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047551.754111:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709373312:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754122:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709373184:0@lo:400:kworker.0 00000100:00080000:0.0:1784047551.754156:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.754160:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047551.754163:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709372544:0@lo:38:kworker.0 00000100:00080000:0.0:1784047551.754170:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.754173:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047551.754176:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709372800:0@lo:38:kworker.0 00000100:00080000:0.0:1784047551.754196:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.754199:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047551.754202:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709373440:0@lo:38:kworker.0 00000100:00100000:0.0:1784047551.754224:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372672 00000100:00100000:0.0:1784047551.754227:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372672 00000100:00100000:0.0:1784047551.754244:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709372928 00000100:00100000:0.0:1784047551.754246:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709372928 00000100:00100000:0.0:1784047551.754256:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1784047551.754260:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709372672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754295:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709372672:12345-0@lo:400:kworker.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047551.754301:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1784047551.754311:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1784047551.754317:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709372928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754342:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709372928:12345-0@lo:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047551.754347:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1784047551.754370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709372928:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754378:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709372672:0@lo:400:kworker.0 00000100:00100000:0.0:1784047551.754438:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373056 00000100:00100000:0.0:1784047551.754442:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373056 00000100:00100000:0.0:1784047551.754465:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:0.0:1784047551.754470:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc1d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709373056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784047551.754480:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047551.754510:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc1d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709373056:12345-0@lo:38:kworker.0 Request processed in 39us (1212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047551.754523:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00080000:0.0:1784047551.754920:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047551.754925:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047551.754928:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709373056:0@lo:38:kworker.0 00010000:00010000:3.0:1784047551.764548:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047552.787980:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047553.162827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047553.162884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047553.164211:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490176 00000100:00100000:0.0:1784047553.164224:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490176 00000100:00100000:2.0:1784047553.164512:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490304 00000100:00100000:2.0:1784047553.164516:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490304 00000100:00100000:2.0:1784047553.164580:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1388 00000100:00100000:2.0:1784047553.164591:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689490304:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047553.164720:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689490304:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 130us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047553.164728:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1388 00000100:00100000:2.0:1784047553.164747:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1434 00000100:00100000:2.0:1784047553.164752:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689490176:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:2.0:1784047553.164773:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047553.164795:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1870705689490176:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 42us (1985us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047553.164801:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1434 00000100:00080000:1.0:1784047553.165148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047553.171707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047553.172068:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490432 00000100:00100000:3.0:1784047553.172096:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490432 00000100:00100000:3.0:1784047553.172230:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5004 00000100:00100000:3.0:1784047553.172242:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689490432:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:3.0:1784047553.172274:0:26183:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c77590a 00000100:00080000:3.0:1784047553.172284:0:26183:0:(import.c:65:import_set_state_nolock()) ffff99ccff382000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784047553.172340:0:26183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968756 00000100:00100000:3.0:1784047553.173306:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+2:2398:x1870705689490432:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 1061us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047553.173318:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5004 00010000:00010000:2.0:1784047553.173698:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784047553.175543:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047553.810899:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709373568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047553.810979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047553.811051:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373568 00000100:00100000:3.0:1784047553.811060:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373568 00010000:00010000:0.0:1784047553.811095:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047553.811139:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:3.0:1784047553.811149:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709373568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047553.811178:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047553.811225:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709373568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047553.811233:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00080000:3.0:1784047553.811255:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047553.811302:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709373568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047553.811410:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709373696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047553.811443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047553.811553:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373696 00000100:00100000:3.0:1784047553.811558:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373696 00000100:00100000:3.0:1784047553.811708:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1784047553.811723:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709373696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047553.811740:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047553.811778:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709373696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047553.811785:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1784047553.811806:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709373696:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047553.811917:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1784047553.812454:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:0.0:1784047553.812459:0:8425:0:(genops.c:906:class_export_put()) final put ffff99ccfddd5800/0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:1.0:1784047553.812564:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfddd5800/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-OST0000 00000020:00000080:1.0:1784047553.813407:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccfddd3800 for lustre-OST0000 00010000:00010000:0.0:1784047554.834787:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784047555.445534:0:94367:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784047555.445543:0:94367:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784047555.445545:0:94367:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784047555.445754:0:94367:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cbc79c6800 00000020:01000004:2.0:1784047555.445778:0:94367:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784047555.445800:0:94367:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784047555.452421:0:94367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cceff38000) 00000020:00000080:3.0:1784047555.452471:0:94367:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784047555.662587:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784047555.668077:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784047555.681151:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.690517:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784047555.691985:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.692326:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.692805:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.693593:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1784047555.694082:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784047555.695467:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.696517:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.697067:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784047555.697432:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1784047555.697867:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1784047555.698401:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784047555.699391:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784047555.700601:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784047555.702264:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784047555.703112:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784047555.703439:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784047555.703793:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784047555.710462:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784047555.711044:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784047555.712592:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784047555.715184:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784047555.716102:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784047555.716416:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.720736:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.722584:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.723331:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.723658:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.724046:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.724278:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.724504:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.724982:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.725196:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.725432:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.725975:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.728559:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.730557:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.731843:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.732131:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.733310:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.734744:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784047555.737576:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.739125:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784047555.742714:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1784047555.767261:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.767307:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.767351:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.768269:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.769070:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.769363:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.770146:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.770427:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1784047555.771162:0:94367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1784047555.776923:0:94367:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784047555.777269:0:94367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784047555.777282:0:94367:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784047555.777302:0:94367:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775a30 00000020:01000004:0.0:1784047555.777322:0:94367:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784047555.777354:0:94367:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784047555.777361:0:94367:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbc79c6800 from MGS 00000020:01000004:0.0:1784047555.777365:0:94367:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784047555.777379:0:94367:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99ccc5e4cd40) 00000020:00000080:0.0:1784047555.777396:0:94367:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:0.0:1784047555.777486:0:94367:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc79c6800 from MGS, refs=2 00080000:01000000:0.0:1784047555.777493:0:94367:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784047555.777509:0:94367:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775a3e 00010000:00010000:0.0:1784047555.778430:0:94367:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1784047555.800454:0:94367:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1784047555.803163:0:94371:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784047555.803249:0:94367:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784047555.803334:0:94367:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784047555.804535:0:94367:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784047555.804988:0:94367:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784047555.805188:0:94367:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784047555.805197:0:94367:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784047555.807215:0:94367:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784047555.807232:0:94367:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784047555.807823:0:94367:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784047555.807831:0:94367:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784047555.809007:0:94367:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784047555.809043:0:94367:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1784047555.809045:0:94367:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1784047555.809049:0:94367:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1784047555.809055:0:94367:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 73, was 0): CONNECTING 00000100:00100000:0.0:1784047555.809062:0:94367:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:3.0:1784047555.859065:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047556.883377:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047556.883953:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047556.883961:0:45180:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784047556.883965:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047556.883969:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047556.883975:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047556.883987:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3650 00000100:00080000:2.0:1784047556.883995:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047556.884006:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047556.884076:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00d04a80 x1870705709373824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047556.884149:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047556.884153:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047556.884155:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047556.884158:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3650 00000100:00080000:2.0:1784047556.884161:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047556.884164:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047556.884167:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709373824:0@lo:38:kworker.0 00000100:00100000:2.0:1784047556.884179:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00d07800 x1870705709374080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047556.884218:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047556.884221:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047556.884222:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047556.884226:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3650 00000100:00080000:2.0:1784047556.884228:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047556.884232:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047556.884243:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cd00d05180 x1870705709374336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047556.884257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047556.884276:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047556.884279:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047556.884281:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047556.884284:0:45180:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3650 00000100:00080000:2.0:1784047556.884286:0:45180:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047556.884301:0:45180:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047556.884313:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef505180 x1870705709374720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047556.884316:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709374080:0@lo:38:kworker.0 00000100:00100000:1.0:1784047556.884341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047556.884357:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709374336:0@lo:38:kworker.0 00000100:00100000:2.0:1784047556.884375:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373824 00000100:00100000:2.0:1784047556.884384:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373824 00000100:00100000:2.0:1784047556.884424:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374080 00000100:00100000:2.0:1784047556.884427:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374080 00000100:00100000:2.0:1784047556.884446:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1784047556.884455:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709373824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047556.884481:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047556.884543:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709373824:12345-0@lo:38:kworker.0 Request processed in 87us (284us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047556.884561:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1784047556.884586:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1784047556.884591:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709374080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047556.884603:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047556.884665:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709374080:12345-0@lo:38:kworker.0 Request processed in 72us (323us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047556.884672:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1784047556.885695:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709374208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.885760:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047556.885828:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047556.885835:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709373952:0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.885862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047556.885906:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709374464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.886118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047556.886148:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047556.886155:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709374592:0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.886182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047556.886223:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374208 00000100:00100000:3.0:1784047556.886238:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374208 00000100:00100000:3.0:1784047556.886316:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709373952 00000100:00100000:3.0:1784047556.886320:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709373952 00000100:00100000:3.0:1784047556.886395:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1784047556.886403:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709374208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.886468:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709374208:12345-0@lo:400:kworker.0 Request processed in 64us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047556.886491:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1784047556.886511:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1784047556.886517:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709373952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.886548:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709373952:12345-0@lo:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047556.886555:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1784047556.886669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709373952:0@lo:400:kworker.0 00000100:00100000:3.0:1784047556.886684:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709374208:0@lo:400:kworker.0 00000100:00080000:3.0:1784047556.886738:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047556.886851:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374464 00000100:00100000:0.0:1784047556.886857:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374464 00000100:00100000:0.0:1784047556.886906:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374592 00000100:00100000:0.0:1784047556.886910:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374592 00000100:00100000:0.0:1784047556.886931:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1784047556.886939:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709374464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047556.886987:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709374464:12345-0@lo:400:kworker.0 Request processed in 50us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047556.886994:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1784047556.887008:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1784047556.887015:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709374592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047556.887057:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709374592:12345-0@lo:400:kworker.0 Request processed in 44us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047556.887064:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1784047556.887113:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709374592:0@lo:400:kworker.0 00000100:00100000:0.0:1784047556.887125:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709374464:0@lo:400:kworker.0 00000100:00080000:3.0:1784047556.888164:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047556.888173:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047556.889793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047556.889883:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047556.889889:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047556.889893:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709373824:0@lo:38:kworker.0 00000100:00100000:1.0:1784047556.889931:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709374720:0@lo:38:kworker.0 00000100:00100000:1.0:1784047556.889984:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784047556.890023:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047556.890027:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047556.890031:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709374080:0@lo:38:kworker.0 00000100:00100000:2.0:1784047556.890237:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374336 00000100:00100000:2.0:1784047556.890245:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374336 00000100:00100000:2.0:1784047556.890288:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:2.0:1784047556.890312:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709374336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784047556.890337:0:83733:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047556.890403:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709374336:12345-0@lo:38:kworker.0 Request processed in 90us (617us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047556.890411:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00080000:1.0:1784047556.890530:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047556.890535:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047556.890714:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374720 00000100:00100000:3.0:1784047556.890719:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374720 00000100:00100000:3.0:1784047556.890755:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1784047556.890761:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709374720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784047556.890775:0:68026:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047556.890806:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709374720:12345-0@lo:38:kworker.0 Request processed in 44us (821us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047556.890812:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1784047556.890865:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709374336:0@lo:38:kworker.0 00000100:00080000:1.0:1784047556.890885:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047556.890889:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784047556.890892:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709374720:0@lo:38:kworker.0 00010000:00010000:3.0:1784047557.910294:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047558.278654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047558.278755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047558.278824:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047558.278875:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490560 00000100:00100000:3.0:1784047558.278885:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490560 00000100:00100000:3.0:1784047558.278920:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1784047558.278929:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1870705689490560:12345-192.168.204.40@tcp:250:kworker.0 00010000:00080000:3.0:1784047558.278956:0:94372:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp t0 exp 0000000000000000 cur 3656 last 0 00000020:00000080:3.0:1784047558.278982:0:94372:0:(genops.c:1406:class_connect()) connect: client 4f88e784-1ed8-4645-9d2f-1081095d1f30, cookie 0x4426598c0c775a45 00000100:00080000:3.0:1784047558.279112:0:94372:0:(import.c:65:import_set_state_nolock()) ffff99ccd001b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784047558.279172:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+5:2398:x1870705689490560:12345-192.168.204.40@tcp:250:kworker.0 Request processed in 243us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047558.279180:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1784047558.284111:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490816 00000100:00100000:0.0:1784047558.284126:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490816 00000100:00100000:0.0:1784047558.284326:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490688 00000100:00100000:0.0:1784047558.284330:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490688 00000100:00100000:0.0:1784047558.284362:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1391 00000100:00100000:0.0:1784047558.284373:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689490816:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047558.284453:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689490816:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 82us (5851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047558.284460:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1391 00000100:00100000:0.0:1784047558.284478:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1438 00000100:00100000:0.0:1784047558.284482:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689490688:12345-192.168.204.40@tcp:38:kworker.0 00010000:00020000:0.0:1784047558.284503:0:66219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047558.284701:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870705689490688:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 215us (5875us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047558.284708:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1438 00000100:00080000:3.0:1784047558.284943:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047558.930960:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1784047558.931075:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047558.931287:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709374848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047558.931929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047558.931948:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709374976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047558.932031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1784047558.932663:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000020:00000080:0.0:1784047558.932674:0:9510:0:(genops.c:906:class_export_put()) final put ffff99ccff385800/0c846d7a-6357-4e9c-a620-e35737ede709 00000100:00100000:1.0:1784047558.933190:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374976 00000100:00100000:1.0:1784047558.933203:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374976 00000100:00100000:1.0:1784047558.933295:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1784047558.933305:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709374976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047558.933336:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047558.933399:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709374976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047558.933410:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:2.0:1784047558.933653:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709374976:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1784047558.933690:0:45180:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccff385800/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-OST0001 00000020:00000080:2.0:1784047558.933762:0:45180:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccff382000 for lustre-OST0001 00000100:00100000:3.0:1784047558.933937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784047558.934043:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047558.934098:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709374848 00000100:00100000:2.0:1784047558.934121:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709374848 00000100:00100000:2.0:1784047558.935018:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1784047558.935031:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709374848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784047558.935067:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047558.935147:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709374848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047558.935156:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1784047558.936600:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709374848:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784047558.947155:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047559.684953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047559.685117:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689490944 00000100:00100000:2.0:1784047559.685141:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689490944 00000100:00100000:2.0:1784047559.685219:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:2.0:1784047559.685233:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+5:70965:x1870705689490944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047559.685264:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047559.685294:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4eb expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047559.685329:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 6 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047559.685341:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 6 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047559.685352:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46800, rc 0) 00000100:00100000:2.0:1784047559.685507:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689490944:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 212us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047559.685517:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:2.0:1784047559.690701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047559.691996:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491072 00000100:00100000:1.0:1784047559.692027:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491072 00000100:00100000:1.0:1784047559.692110:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:1.0:1784047559.692134:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689491072:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784047559.692271:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689491072:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 149us (1585us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047559.692279:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:0.0:1784047559.711284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047559.711375:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491200 00000100:00100000:3.0:1784047559.711385:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491200 00000100:00100000:3.0:1784047559.711448:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:3.0:1784047559.711473:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+6:70965:x1870705689491200:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047559.711490:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047559.711513:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4f2 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047559.711542:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 7 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047559.711553:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 7 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047559.711562:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88000, rc 0) 00000100:00100000:3.0:1784047559.711666:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+7:70965:x1870705689491200:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 195us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047559.711673:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1784047559.714978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047559.715174:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491328 00000100:00100000:2.0:1784047559.715185:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491328 00000100:00100000:2.0:1784047559.715266:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1784047559.715277:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+7:70965:x1870705689491328:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784047559.716141:0:94377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784047559.716391:0:94375:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 125 20000000:01000000:2.0:1784047559.717743:0:94378:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784047559.717752:0:94378:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784047559.717756:0:94378:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784047559.717758:0:94378:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784047559.717777:0:94378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:1.0:1784047559.722876:0:94375:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784047559.724750:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689491328:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 9247us (9552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047559.724765:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1784047559.729314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047559.729939:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491456 00000100:00100000:1.0:1784047559.729951:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491456 00000100:00100000:1.0:1784047559.730015:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1784047559.730026:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689491456:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047559.730204:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689491456:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 178us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047559.730212:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1784047559.749495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047559.750118:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491584 00000100:00100000:1.0:1784047559.750129:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491584 00000100:00100000:1.0:1784047559.750470:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1784047559.750482:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689491584:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047559.750497:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047559.750520:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbfe00/0x4426598c0c775a5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae4f9 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047559.750554:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbfe00/0x4426598c0c775a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f9 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047559.750564:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbfe00/0x4426598c0c775a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f9 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047559.750572:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbfe00, rc 0) 00000100:00100000:1.0:1784047559.750667:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689491584:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 187us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047559.750693:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:0.0:1784047559.755687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047559.755809:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491712 00000100:00100000:3.0:1784047559.755819:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491712 00000100:00100000:3.0:1784047559.755871:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1784047559.755881:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689491712:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047559.756079:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689491712:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 199us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047559.756088:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1784047559.767366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047559.767633:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491840 00000100:00100000:1.0:1784047559.767644:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491840 00000100:00100000:1.0:1784047559.767711:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1784047559.767723:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689491840:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047559.767875:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689491840:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 153us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047559.767884:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:0.0:1784047559.775797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047559.777022:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689491968 00000100:00100000:2.0:1784047559.777033:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689491968 00000100:00100000:2.0:1784047559.777215:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1784047559.777230:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689491968:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047559.777256:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047559.777436:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae500 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047559.777789:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 10 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047559.777800:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 10 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047559.777810:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47e00, rc 0) 00000100:00100000:2.0:1784047559.777932:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689491968:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 704us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047559.777940:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:3.0:1784047559.784187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047559.784291:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492096 00000100:00100000:2.0:1784047559.784302:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492096 00000100:00100000:2.0:1784047559.784384:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:2.0:1784047559.784396:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689492096:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047559.785429:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689492096:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 1029us (1245us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784047559.785441:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00010000:00010000:0.0:1784047559.954901:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047560.981753:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047562.002761:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047562.002774:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784047562.002778:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047562.002782:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047562.002786:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784047562.002789:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784047551/real 1784047551] req@ffff99ccef514380 x1870705709372416/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047562.002795:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3655 00000100:00080000:2.0:1784047562.002812:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047562.002821:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047562.002827:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ccef514380 x1870705709372416/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784047561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047562.002857:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784047562.002868:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef506680 x1870705709375104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784047562.002881:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784047562.002892:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709372416:0@lo:250:kworker.0 00000100:00080000:2.0:1784047562.002916:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047562.002921:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047562.002923:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784047562.002925:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709375104:0@lo:38:kworker.0 00000100:00080000:2.0:1784047562.002931:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3655 00000100:00080000:2.0:1784047562.002935:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047562.002939:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 10000000:01000000:0.0:1784047562.002950:0:94367:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:2.0:1784047562.002956:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef507480 x1870705709375360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784047562.002978:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047562.002980:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:0.0:1784047562.002995:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.002997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047562.003010:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047562.003017:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:01000000:0.0:1784047562.003017:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:2.0:1784047562.003031:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3655 00000100:00080000:2.0:1784047562.003035:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047562.003042:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00010000:00010000:0.0:1784047562.003045:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1784047562.003047:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709375360:0@lo:38:kworker.0 00010000:00010000:0.0:1784047562.003061:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cea00/0x4426598c0c775361 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775368 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.003067:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef504a80 x1870705709375616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047562.003086:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047562.003113:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.003123:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.003129:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784047562.003133:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709375616:0@lo:38:kworker.0 00010000:00010000:0.0:1784047562.003138:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1784047562.003140:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:0.0:1784047562.003147:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf400/0x4426598c0c775751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775758 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047562.003148:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784047562.003153:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047562.003169:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3655 00010000:00010000:0.0:1784047562.003172:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047562.003174:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784047562.003188:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047562.003216:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef505180 x1870705709376000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047562.003237:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375104 10000000:00010000:0.0:1784047562.003240:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003246:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375104 00000100:00080000:2.0:1784047562.003261:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 10000000:01000000:0.0:1784047562.003263:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1784047562.003276:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00010000:00010000:0.0:1784047562.003279:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1784047562.003280:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047562.003289:0:52247:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3650 00010000:00010000:0.0:1784047562.003290:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cce3b88800/0x4426598c0c77575f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775766 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047562.003294:0:52247:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1784047562.003297:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375360 00000100:00100000:1.0:1784047562.003304:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375360 00000100:00080000:2.0:1784047562.003306:0:52247:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00010000:00010000:0.0:1784047562.003315:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.003324:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef507100 x1870705709376128/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:0.0:1784047562.003326:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003341:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1784047562.003363:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709375104:12345-0@lo:38:kworker.0 10000000:01000000:0.0:1784047562.003366:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047562.003385:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047562.003393:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46600/0x4426598c0c77576d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775774 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1784047562.003402:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784047562.003413:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709376000:0@lo:38:kworker.0 00010000:00010000:0.0:1784047562.003419:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.003440:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.003449:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784047562.003457:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709375104:12345-0@lo:38:kworker.0 Request processed in 94us (457us total) trans 0 rc -19/-19 00010000:00010000:0.0:1784047562.003465:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1784047562.003472:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00010000:00010000:0.0:1784047562.003473:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cce3b89400/0x4426598c0c77577b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775782 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003497:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1784047562.003503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.003512:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709375360:12345-0@lo:38:kworker.0 00010000:00010000:0.0:1784047562.003515:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1784047562.003526:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:00010000:0.0:1784047562.003527:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:2.0:1784047562.003537:0:3644:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff99ccef507100 x1870705709376128/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784047562.003539:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047562.003553:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047562.003563:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775790 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003574:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709375360:12345-0@lo:38:kworker.0 Request processed in 58us (491us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047562.003599:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00010000:00010000:0.0:1784047562.003599:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003654:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376000 00000100:00100000:1.0:1784047562.003661:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376000 10000000:00010000:0.0:1784047562.003670:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.003677:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047562.003685:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1784047562.003691:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00010000:00010000:0.0:1784047562.003693:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe400/0x4426598c0c775797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77579e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003706:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709376000:12345-0@lo:38:kworker.0 00010000:00010000:0.0:1784047562.003725:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1784047562.003729:0:67153:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:00010000:0.0:1784047562.003745:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.003751:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047562.003767:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047562.003776:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cce3b89c00/0x4426598c0c7757a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7757ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.003778:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709376000:12345-0@lo:38:kworker.0 Request processed in 73us (296us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047562.003813:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00010000:00010000:0.0:1784047562.003821:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.003831:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.003838:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1784047562.003841:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709375872:0@lo:400:kworker.0 00010000:00010000:0.0:1784047562.003845:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1784047562.003873:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.003898:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047562.003904:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709375744:0@lo:400:kworker.0 00000100:00100000:1.0:1784047562.003935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.003966:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375616 00000100:00100000:1.0:1784047562.003970:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375616 00000100:00100000:1.0:1784047562.003993:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:1.0:1784047562.003998:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709375616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784047562.004007:0:23872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047562.004033:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709375616:12345-0@lo:38:kworker.0 Request processed in 34us (866us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047562.004039:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:1.0:1784047562.004102:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375872 00000100:00100000:1.0:1784047562.004106:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375872 00010000:00010000:3.0:1784047562.004124:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047562.004158:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375744 00000100:00100000:1.0:1784047562.004164:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375744 00000100:00100000:1.0:1784047562.004204:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00010000:00010000:0.0:1784047562.004212:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9ce600/0x4426598c0c7752ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7752d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.004219:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709375872:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1784047562.004251:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.004261:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.004267:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784047562.004284:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1784047562.004285:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709375872:12345-0@lo:400:kworker.0 Request processed in 69us (410us total) trans 0 rc 0/0 00010000:00010000:0.0:1784047562.004291:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf400/0x4426598c0c7752ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7752f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.004302:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:1.0:1784047562.004330:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:1.0:1784047562.004338:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709375744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047562.004358:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709375232:0@lo:400:kworker.0 00000100:00100000:1.0:1784047562.004374:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709375744:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.004381:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:0.0:1784047562.004435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.004473:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784047562.004481:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709375488:0@lo:400:kworker.0 00000100:00100000:0.0:1784047562.004519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.004562:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375232 00000100:00100000:0.0:1784047562.004569:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375232 00000100:00100000:0.0:1784047562.004640:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709375488 00000100:00100000:0.0:1784047562.004644:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709375488 00000100:00100000:0.0:1784047562.004666:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1784047562.004673:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709375232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047562.004723:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709375232:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.004730:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1784047562.004746:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1784047562.004751:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709375488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047562.004777:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709375488:12345-0@lo:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.004783:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1784047562.004827:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709375488:0@lo:400:kworker.0 00000100:00100000:0.0:1784047562.004838:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709375232:0@lo:400:kworker.0 00010000:00010000:0.0:1784047562.004888:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.004897:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.004903:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047562.004912:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047562.004918:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccef9cf200/0x4426598c0c7752f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c7752ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.004940:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.004946:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.004951:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047562.004967:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047562.004972:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd200/0x4426598c0c775322 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c775329 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.004982:0:94367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047562.004989:0:94367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.004994:0:94367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784047562.005008:0:94367:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784047562.005012:0:94367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd7e000/0x4426598c0c775353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x4426598c0c77535a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784047562.007967:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047562.007986:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047562.007993:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047562.008113:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709375744:0@lo:400:kworker.0 00000100:00100000:3.0:1784047562.008134:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709375872:0@lo:400:kworker.0 00000100:00080000:0.0:1784047562.039709:0:94367:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99cce74a5800 already not connected (conn 74, was 0): CONNECTING 00000100:00080000:0.0:1784047562.039727:0:94367:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1784047562.042804:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047562.042845:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1784047562.042864:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:0:1870705709376128:0@lo:250:kworker.0 00000100:00080000:2.0:1784047562.042907:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047562.042912:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047562.042916:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709375616:0@lo:38:kworker.0 00000100:00080000:1.0:1784047562.042918:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784047562.042925:0:45180:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784047562.042929:0:45180:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784047562.042932:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047562.042938:0:45180:0:(import.c:510:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 3660 00000100:00080000:2.0:1784047562.042939:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047562.042943:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709375360:0@lo:38:kworker.0 00000100:00080000:2.0:1784047562.042958:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047562.042964:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1784047562.042966:0:45180:0:(import.c:589:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1784047562.042969:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709375104:0@lo:38:kworker.0 00000100:00080000:1.0:1784047562.042977:0:45180:0:(import.c:624:import_select_connection()) MGC192.168.204.140@tcp: import ffff99cce74a5800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1784047562.046204:0:45180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc79f3b80 x1870705709376256/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047562.046314:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047562.046322:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784047562.046326:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709376000:0@lo:38:kworker.0 00000100:00100000:2.0:1784047562.046344:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709376256:0@lo:250:kworker.0 00000100:00100000:2.0:1784047562.046409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.047001:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376256 00000100:00100000:1.0:1784047562.047009:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376256 00000100:00100000:1.0:1784047562.047052:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784047562.047059:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3644:x1870705709376256:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1784047562.047086:0:94374:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6e36843b-2016-43fe-8842-da5818d68597@0@lo t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:1.0:1784047562.047373:0:94374:0:(genops.c:1406:class_connect()) connect: client 6e36843b-2016-43fe-8842-da5818d68597, cookie 0x4426598c0c775a68 00000100:00080000:1.0:1784047562.047532:0:94374:0:(import.c:65:import_set_state_nolock()) ffff99ccc832a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047562.047634:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+5:3644:x1870705709376256:12345-0@lo:250:kworker.0 Request processed in 573us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.047644:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784047562.047756:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 29 00000100:00080000:3.0:1784047562.047774:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1784047562.047786:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784047562.047792:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784047562.047797:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cce74a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784047562.047801:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784047562.047846:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784047562.047861:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e36843b-2016-43fe-8842-da5818d68597:3644:1870705709376256:0@lo:250:kworker.0 00000100:00080000:0.0:1784047562.047949:0:94367:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1784047562.047966:0:94367:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784047562.048015:0:94367:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784047562.048023:0:94367:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784047562.048177:0:94367:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784047562.048246:0:94367:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784047562.048251:0:94367:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784047562.048253:0:94367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047562.048254:0:94367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047562.048255:0:94367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047562.048256:0:94367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047562.048258:0:94367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047562.048260:0:94367:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047562.048261:0:94367:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047562.048263:0:94367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047562.048265:0:94367:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784047562.048268:0:94367:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784047562.048270:0:94367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784047562.048271:0:94367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047562.048273:0:94367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047562.048274:0:94367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047562.048275:0:94367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047562.048276:0:94367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047562.048277:0:94367:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047562.048278:0:94367:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047562.048279:0:94367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047562.048280:0:94367:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784047562.048307:0:94367:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784047562.048331:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709376384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784047562.048408:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.048469:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047562.048546:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376384 00000100:00100000:3.0:1784047562.048554:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376384 00000100:00100000:3.0:1784047562.048648:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784047562.048660:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+5:94367:x1870705709376384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784047562.048712:0:94372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784047562.048716:0:94372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784047562.048719:0:94372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784047562.048728:0:94372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784047562.049119:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+5:94367:x1870705709376384:12345-0@lo:253:mount.lustre.0 Request processed in 456us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.049131:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784047562.049487:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709376384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784047562.049503:0:94367:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784047562.049505:0:94367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784047562.049507:0:94367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784047562.049509:0:94367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784047562.049510:0:94367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784047562.049511:0:94367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784047562.049513:0:94367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784047562.049514:0:94367:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784047562.049516:0:94367:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784047562.049517:0:94367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784047562.049529:0:94367:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784047562.049561:0:94367:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbc79c6800 from lustre-MDT0000 10000000:01000000:0.0:1784047562.049598:0:94367:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784047562.049601:0:94367:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784047562.049650:0:94367:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cbc79c6800 10000000:01000000:0.0:1784047562.049656:0:94367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784047562.049662:0:94367:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cbc79c6800 10000000:01000000:0.0:1784047562.049666:0:94367:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784047562.049670:0:94367:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99cbc79c6800 from 1 10000000:01000000:0.0:1784047562.049673:0:94367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784047562.049716:0:94367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.049727:0:94367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.049737:0:94367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047562.049758:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709376512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047562.049807:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.049846:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047562.049864:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376512 00000100:00100000:2.0:1784047562.049876:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376512 00000100:00100000:2.0:1784047562.049935:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784047562.049944:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+5:94367:x1870705709376512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047562.049970:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047562.049989:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46400/0x4426598c0c775a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775a6f expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.050014:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46400/0x4426598c0c775a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775a6f expref: 6 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.050025:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46400/0x4426598c0c775a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775a6f expref: 6 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.050033:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46400, rc 0) 00000100:00100000:2.0:1784047562.050113:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+6:94367:x1870705709376512:12345-0@lo:101:mount.lustre.0 Request processed in 169us (304us total) trans 0 rc 0/0 00000020:01000000:1.0:1784047562.050121:0:45180:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.140@tcp 00000100:00100000:2.0:1784047562.050129:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:1.0:1784047562.050148:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784047562.050153:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047562.050156:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784047562.050157:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047562.050159:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047562.050160:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047562.050162:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047562.050164:0:45180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047562.050165:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047562.050167:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047562.050231:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784047562.050240:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784047562.050242:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047562.050243:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784047562.050245:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047562.050246:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047562.050246:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047562.050255:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047562.050256:0:45180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047562.050257:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047562.050258:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047562.050274:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784047562.050279:0:45180:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784047562.050281:0:45180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784047562.050282:0:45180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784047562.050284:0:45180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047562.050285:0:45180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047562.050286:0:45180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047562.050287:0:45180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047562.050288:0:45180:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047562.050289:0:45180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047562.050290:0:45180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784047562.050312:0:45180:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784047562.050343:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709376768:0@lo:253:kworker.0 00000100:00100000:1.0:1784047562.050385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.050407:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047562.050412:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709376640:0@lo:253:kworker.0 00000100:00100000:1.0:1784047562.050438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.050461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709376896:0@lo:253:kworker.0 00000100:00100000:1.0:1784047562.050488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.050580:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709376512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047562.050600:0:94367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775a76 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.050648:0:94367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775a76 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.050667:0:94367:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784047562.050685:0:94367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775a76 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.050694:0:94367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601800/0x4426598c0c775a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775a76 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.050702:0:94367:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784047562.050706:0:94367:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784047562.050712:0:94367:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cbc79c6800 10000000:01000000:0.0:1784047562.050715:0:94367:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784047562.050719:0:94367:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784047562.050721:0:94367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784047562.050742:0:94367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.050750:0:94367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.050757:0:94367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047562.050769:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709377024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047562.050797:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.050812:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd000f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047562.050895:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376768 00000100:00100000:2.0:1784047562.050902:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376768 00000100:00100000:2.0:1784047562.050932:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376640 00000100:00100000:2.0:1784047562.050935:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376640 00000100:00100000:2.0:1784047562.050944:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709376896 00000100:00100000:2.0:1784047562.050946:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709376896 00000100:00100000:2.0:1784047562.050956:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377024 00000100:00100000:2.0:1784047562.050958:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377024 00000100:00100000:2.0:1784047562.050972:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784047562.050980:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:3646:x1870705709376768:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784047562.051009:0:94374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784047562.051026:0:94374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784047562.051189:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784047562.051208:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:3646:x1870705709376640:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784047562.051228:0:94375:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784047562.055807:0:94374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784047562.055831:0:94374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784047562.056032:0:94377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784047562.056038:0:94377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784047562.056068:0:94377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.056095:0:94377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.056104:0:94377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.056184:0:94377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.056212:0:94377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 9 pid: 94375 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.056233:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709377152:192.168.204.40@tcp:104: 00000100:00100000:1.0:1784047562.056357:0:94377:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d600 going to sleep for 11 seconds 20000000:01000000:0.0:1784047562.056445:0:94375:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784047562.058164:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:3646:x1870705709376768:12345-0@lo:253:kworker.0 Request processed in 7173us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047562.058183:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784047562.058258:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784047562.058273:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709376896:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784047562.058331:0:94374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:1.0:1784047562.058524:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784047562.058528:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784047562.058530:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047562.058531:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047562.058532:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047562.058533:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047562.058535:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047562.058537:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047562.058538:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047562.058544:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709376768:0@lo:253:kworker.0 20000000:01000000:2.0:1784047562.065072:0:94375:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784047562.065080:0:94375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784047562.065265:0:94374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784047562.065975:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:3646:x1870705709376640:12345-0@lo:253:kworker.0 Request processed in 14762us (15528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.065988:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784047562.066049:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784047562.066060:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+7:94367:x1870705709377024:12345-0@lo:101:mount.lustre.0 00000020:01000004:1.0:1784047562.066063:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784047562.066071:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784047562.066074:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:3.0:1784047562.066075:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:01000004:1.0:1784047562.066076:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047562.066081:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047562.066084:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047562.066086:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047562.066089:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047562.066091:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1784047562.066097:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775a7d expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.066099:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709376640:0@lo:253:kworker.0 00010000:00010000:3.0:1784047562.066139:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775a7d expref: 8 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047562.066150:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775a7d expref: 8 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047562.066161:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88200, rc 0) 00000100:00100000:3.0:1784047562.066498:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:94367:x1870705709377024:12345-0@lo:101:mount.lustre.0 Request processed in 440us (15699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.066505:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784047562.066731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047562.067298:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709377024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047562.067320:0:94367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.067355:0:94367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.067445:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709377280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047562.067485:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.067516:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047562.067795:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377280 00000100:00100000:3.0:1784047562.067802:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377280 00000100:00100000:3.0:1784047562.067849:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784047562.067858:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:94367:x1870705709377280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047562.068007:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:94367:x1870705709377280:12345-0@lo:501:mount.lustre.0 Request processed in 148us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.068014:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784047562.068586:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492224 00000100:00100000:0.0:1784047562.068593:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492224 00010000:00010000:0.0:1784047562.068739:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 10 pid: 94375 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.069015:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709377280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047562.069055:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709377408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047562.069107:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.069133:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfa60d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.069226:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2574 00000100:00100000:0.0:1784047562.069386:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689492224:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047562.069410:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784047562.069541:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709377152:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047562.069567:0:94377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069806:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 10 pid: 94375 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069819:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 10 pid: 94375 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069841:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46800/0x4426598c0c775a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4eb expref: 10 pid: 94375 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069860:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069868:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047562.069883:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013845937s 00010000:00010000:0.0:1784047562.069887:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069893:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069899:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069905:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069910:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047562.069921:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069929:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069941:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.069950:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047562.070001:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2401:x1870705689492224:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 619us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.070010:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2574 00000100:00100000:3.0:1784047562.071219:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377408 00000100:00100000:3.0:1784047562.071231:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377408 00000100:00100000:3.0:1784047562.071296:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784047562.071304:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:94367:x1870705709377408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047562.071544:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:94367:x1870705709377408:12345-0@lo:503:mount.lustre.0 Request processed in 239us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.071562:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1784047562.072310:0:94377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.072324:0:94377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.072332:0:94377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbf000/0x4426598c0c775a84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.072777:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709377408:0@lo:503:mount.lustre.0 20000000:01000000:3.0:1784047562.074350:0:94374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784047562.074368:0:94374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784047562.074544:0:94377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784047562.074549:0:94377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784047562.074571:0:94377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074586:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047562.074596:0:94377:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013845937s 00010000:00010000:1.0:1784047562.074601:0:94377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074708:0:94377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074715:0:94377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074733:0:94377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074739:0:94377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047562.074743:0:94377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074752:0:94377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074764:0:94377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074772:0:94377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.074778:0:94377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbe600/0x4426598c0c775a92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047562.075413:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:3647:x1870705709376896:12345-0@lo:253:kworker.0 Request processed in 17140us (24918us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.075528:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000004:1.0:1784047562.075852:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784047562.075855:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784047562.075857:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047562.075858:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047562.075859:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047562.075860:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047562.075861:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784047562.075863:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047562.075864:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784047562.075868:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709376896:0@lo:253:kworker.0 00000100:00100000:1.0:1784047562.076358:0:94379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94379:1870705709377536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047562.076860:0:94379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.076909:0:94379:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00494900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.076959:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377536 00000100:00100000:0.0:1784047562.076966:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377536 00000100:00100000:0.0:1784047562.077010:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784047562.077019:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:94379:x1870705709377536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047562.077917:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:94379:x1870705709377536:12345-0@lo:502:llog_process_th.0 Request processed in 896us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.077927:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784047562.078011:0:94379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94379:1870705709377536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047562.078043:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047562.078054:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047562.078057:0:94379:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784047562.078061:0:94379:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784047562.078064:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047562.078078:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cd001019c0) 00000020:00000080:1.0:1784047562.078102:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1784047562.078108:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784047562.078204:0:94379:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784047562.078212:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775aa0 00000020:00000080:1.0:1784047562.078582:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784047562.078587:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047562.078591:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047562.078593:0:94379:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784047562.078595:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047562.078599:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047562.078832:0:94379:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784047562.078841:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784047562.078851:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cd00100000) 00000020:00000080:1.0:1784047562.078865:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1784047562.078870:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784047562.078872:0:94379:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784047562.078875:0:94379:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784047562.078880:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784047562.078930:0:94379:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc79c6800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784047562.078942:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cd00103380) 00000020:00000080:1.0:1784047562.078952:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1784047562.079007:0:94379:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784047562.079013:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775ab5 00000020:00000080:1.0:1784047562.079116:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784047562.079133:0:94379:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784047562.079138:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4426598c0c775abc 00080000:01000000:1.0:1784047562.079144:0:94379:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784047562.079149:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775ac3 00010000:00010000:3.0:1784047562.152292:0:94379:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784047562.153582:0:94379:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116995 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:3.0:1784047562.153947:0:94379:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0c846d7a-6357-4e9c-a620-e35737ede709 idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:3.0:1784047562.153975:0:94379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:3.0:1784047562.154101:0:94379:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784047562.154178:0:94379:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cd00ed3480: xid 1870705709359360, transno 120259084296, client gen 22, slot idx 0 00000001:00080000:3.0:1784047562.154201:0:94379:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99cd00ed3b40: xid 1870705709357440, transno 120259084295, client gen 22, slot idx 1 00000001:00080000:3.0:1784047562.154209:0:94379:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99ccc3e056c0: xid 1870705689478656, transno 120259084294, client gen 24, slot idx 2 00000001:00080000:3.0:1784047562.154214:0:94379:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99ccd4c159c0: xid 1870705689478272, transno 120259084293, client gen 24, slot idx 3 00000020:00000080:3.0:1784047562.155262:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99cceff3cd40) 00000020:00000080:3.0:1784047562.155286:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1784047562.155372:0:94379:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784047562.155382:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775adf 00000020:00000080:1.0:1784047562.156156:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784047562.165723:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4426598c0c775ae6 00000020:00000080:2.0:1784047562.168386:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784047562.168403:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.168411:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.168413:0:94379:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784047562.168419:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784047562.168422:0:94379:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1784047562.168430:0:94379:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047562.168432:0:94379:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047562.168433:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784047562.168436:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.168438:0:94379:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784047562.168441:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.168445:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.168447:0:94379:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784047562.168451:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784047562.168513:0:94379:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784047562.168533:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.168537:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.168538:0:94379:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784047562.168541:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.168544:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.168546:0:94379:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784047562.168549:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784047562.168554:0:94379:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:2.0:1784047562.168580:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047562.168597:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99ccc4ac3380) 00000020:00000080:2.0:1784047562.168878:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1784047562.168888:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784047562.168964:0:94379:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784047562.168971:0:94379:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784047562.168981:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775af4 00010000:00080000:2.0:1784047562.169018:0:94379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc1d86000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047562.171572:0:94379:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1784047562.173254:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047562.173269:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784047562.173540:0:94379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784047562.173567:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775afb 00000100:00080000:2.0:1784047562.173579:0:94379:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047562.173584:0:94379:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99cbc1d86000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047562.174001:0:94379:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef505180 x1870705709377664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047562.174060:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709377664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784047562.174139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.174230:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377664 00000100:00100000:0.0:1784047562.174239:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377664 00000100:00100000:0.0:1784047562.174282:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1784047562.174291:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709377664:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784047562.174315:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:0.0:1784047562.174354:0:8441:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775b02 00000004:00100000:0.0:1784047562.174369:0:8441:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047562.174489:0:8441:0:(import.c:65:import_set_state_nolock()) ffff99ccff387800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1784047562.174737:0:94379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1784047562.174833:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.174839:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.174841:0:94379:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784047562.174844:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784047562.174846:0:94379:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1784047562.174848:0:94379:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047562.174849:0:94379:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047562.174850:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784047562.174853:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.174854:0:94379:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784047562.174856:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784047562.174861:0:94379:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784047562.174864:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.174865:0:94379:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784047562.174868:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784047562.174872:0:94379:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:2.0:1784047562.174893:0:94379:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784047562.174896:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047562.174910:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ccc4ac19c0) 00000020:00000080:2.0:1784047562.174932:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1784047562.174938:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784047562.175161:0:94379:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784047562.175167:0:94379:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784047562.175177:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775b10 00010000:00080000:2.0:1784047562.175215:0:94379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccf7599800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047562.175567:0:94379:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:2.0:1784047562.177080:0:94379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784047562.177111:0:94379:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784047562.177566:0:94379:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000100:00100000:0.0:1784047562.177951:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709377664:12345-0@lo:38:llog_process_th.0 Request processed in 3654us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.177964:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1784047562.178118:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047562.178131:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1784047562.178140:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784047562.178144:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784047562.178148:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d86000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784047562.178156:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709377664:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047562.178287:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709377792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047562.178353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047562.178516:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377792 00000100:00100000:3.0:1784047562.178523:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377792 00000100:00100000:3.0:1784047562.178575:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:3.0:1784047562.178586:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709377792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047562.178638:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047562.178686:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709377792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.178694:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1784047562.178930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709377792:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784047562.179328:0:94379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047562.179364:0:94379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:2.0:1784047562.179523:0:94379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000040:00080000:0.0:1784047562.180999:0:94385:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:0.0:1784047562.181005:0:94385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1784047562.181171:0:94385:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:0.0:1784047562.181202:0:94385:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1784047562.181333:0:94385:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:0.0:1784047562.181336:0:94385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784047562.187528:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047562.187632:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784047562.187683:0:94379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784047562.187709:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775b17 00000100:00080000:2.0:1784047562.187720:0:94379:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047562.187726:0:94379:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccf7599800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047562.187882:0:94379:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef506680 x1870705709377920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047562.187938:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709377920:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784047562.188015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784047562.188081:0:94379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1784047562.188111:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709377920 00000100:00100000:1.0:1784047562.188119:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709377920 00000100:00100000:1.0:1784047562.188152:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5005 00000020:01000000:2.0:1784047562.188153:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.188157:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.188159:0:94379:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784047562.188162:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:1.0:1784047562.188162:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870705709377920:12345-0@lo:8:llog_process_th.0 00000020:01000000:2.0:1784047562.188165:0:94379:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784047562.188166:0:94379:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047562.188168:0:94379:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784047562.188169:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784047562.188171:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.188172:0:94379:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784047562.188175:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784047562.188179:0:94379:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784047562.188181:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.188183:0:94379:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784047562.188185:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00010000:00080000:1.0:1784047562.188186:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:2.0:1784047562.188200:0:94379:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:00000080:1.0:1784047562.188222:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775b1e 00000020:01000000:2.0:1784047562.188223:0:94379:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784047562.188225:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00002000:00100000:1.0:1784047562.188238:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cbcaee3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784047562.188243:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784047562.188246:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:2.0:1784047562.188252:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ccc4ac0000) 00000020:00000080:2.0:1784047562.188267:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1784047562.188272:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00002000:00080000:1.0:1784047562.188329:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000004:00080000:2.0:1784047562.188331:0:94379:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784047562.188338:0:94379:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784047562.188344:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4426598c0c775b2c 00000100:00080000:1.0:1784047562.188354:0:8433:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee1800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1784047562.188368:0:94379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc912c800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1784047562.188688:0:94379:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1784047562.188772:0:94379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784047562.188792:0:94379:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784047562.189175:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709377920:12345-0@lo:8:llog_process_th.0 Request processed in 1012us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.189186:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5005 00000040:00080000:2.0:1784047562.189283:0:94379:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000100:00100000:3.0:1784047562.190535:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784047562.190548:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784047562.190557:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784047562.190564:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784047562.190568:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:2.0:1784047562.190736:0:94379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047562.190768:0:94379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:2.0:1784047562.190891:0:94379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000040:00080000:2.0:1784047562.191374:0:94387:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:2.0:1784047562.191379:0:94387:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784047562.191516:0:94387:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:2.0:1784047562.191530:0:94387:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784047562.191671:0:94387:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:2.0:1784047562.191674:0:94387:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784047562.192138:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784047562.192149:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784047562.192187:0:94379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784047562.192220:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775b33 00000100:00080000:2.0:1784047562.192233:0:94379:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784047562.192241:0:94379:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cbc912c800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1784047562.192278:0:94379:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccef507480 x1870705709378048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784047562.192295:0:94379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784047562.192390:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.192409:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.192411:0:94379:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784047562.192415:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.192419:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.192420:0:94379:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784047562.192423:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784047562.192425:0:94379:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784047562.192428:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.192430:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.192431:0:94379:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784047562.192433:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.192436:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.192437:0:94379:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784047562.192441:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784047562.192447:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.192449:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.192451:0:94379:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1784047562.192453:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.192457:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.192458:0:94379:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1784047562.192465:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1784047562.192501:0:94379:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1784047562.192976:0:94379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94379:1870705709378176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047562.193065:0:94379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.193112:0:94379:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047562.193135:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709378304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047562.193178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.193224:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378304 00000100:00100000:1.0:1784047562.193233:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378304 00000004:00080000:3.0:1784047562.193262:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784047562.193274:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709377920:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784047562.193294:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1784047562.193298:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709378048:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784047562.193308:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709378304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047562.193340:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047562.193346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.193432:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378176 00000100:00100000:0.0:1784047562.193441:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378176 00000100:00100000:1.0:1784047562.193501:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709378304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.193510:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00080000:2.0:1784047562.193857:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047562.194129:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378048 00000100:00100000:1.0:1784047562.194134:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378048 00000100:00100000:1.0:1784047562.194160:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006 00000100:00100000:1.0:1784047562.194165:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3644:x1870705709378048:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784047562.194201:0:13594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:1.0:1784047562.194233:0:13594:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4426598c0c775b3a 00002000:00100000:1.0:1784047562.194248:0:13594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cbcaee1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784047562.194253:0:13594:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784047562.194255:0:13594:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784047562.194335:0:13594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784047562.194361:0:13594:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047562.194684:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1870705709378048:12345-0@lo:8:llog_process_th.0 Request processed in 516us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.194692:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006 00000100:00100000:1.0:1784047562.194728:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784047562.194737:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:94379:x1870705709378176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047562.194997:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+8:94379:x1870705709378176:12345-0@lo:502:llog_process_th.0 Request processed in 261us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.195005:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784047562.195330:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709378304:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1784047562.195838:0:94385:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1784047562.195876:0:94379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94379:1870705709378176:0@lo:502:llog_process_th.0 00000004:00080000:0.0:1784047562.195908:0:94385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3660448300431ns, next at 0ns, rc = 0 00000020:01000000:3.0:1784047562.195915:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047562.195923:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047562.195926:0:94379:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool_134 00080000:00080000:0.0:1784047562.195928:0:94385:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1784047562.195933:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1784047562.195966:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784047562.195974:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784047562.195983:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784047562.195987:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784047562.195998:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc912c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784047562.196049:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784047562.196056:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709378048:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784047562.196157:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709378432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047562.196213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.196302:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378432 00000100:00100000:2.0:1784047562.196308:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378432 00000100:00100000:2.0:1784047562.196355:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:2.0:1784047562.196364:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709378432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047562.196385:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000020:00000080:3.0:1784047562.196430:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047562.196434:0:94379:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784047562.196442:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1784047562.196457:0:94379:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1784047562.196496:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709378432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047562.196505:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00080000:2.0:1784047562.196523:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047562.196548:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709378432:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1784047562.196567:0:94387:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784047562.197256:0:94387:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3660449648173ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784047562.197264:0:94387:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784047562.197571:0:94379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94379:1870705709378560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047562.197658:0:94379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.197690:0:94379:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.197755:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378560 00000100:00100000:1.0:1784047562.197762:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378560 00000100:00100000:1.0:1784047562.197801:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784047562.197809:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:94379:x1870705709378560:12345-0@lo:502:llog_process_th.0 00000004:00080000:0.0:1784047562.197830:0:94368:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784047562.197926:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+8:94379:x1870705709378560:12345-0@lo:502:llog_process_th.0 Request processed in 117us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.197933:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784047562.198130:0:94379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94379:1870705709378560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047562.198156:0:94379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.198163:0:94379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.198165:0:94379:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1784047562.198170:0:94379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1784047562.198471:0:94367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:1.0:1784047562.198493:0:94367:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784047562.198509:0:94367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.198520:0:94367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047562.198529:0:94367:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cbc79c6800 from 1 10000000:01000000:1.0:1784047562.198532:0:94367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784047562.198560:0:94367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.198568:0:94367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.198577:0:94367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.198593:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709378688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784047562.198661:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.198677:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.198715:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378688 00000100:00100000:0.0:1784047562.198720:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378688 00000004:00080000:1.0:1784047562.198728:0:94368:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1784047562.198747:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784047562.198753:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+8:94367:x1870705709378688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047562.198763:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047562.198777:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775b41 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.198800:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775b41 expref: 9 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.198811:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b41 expref: 9 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.198820:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600c00, rc 0) 00000100:00100000:0.0:1784047562.198908:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+9:94367:x1870705709378688:12345-0@lo:101:mount.lustre.0 Request processed in 154us (246us total) trans 0 rc 0/0 00000020:01000004:3.0:1784047562.199123:0:94389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc79c6800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784047562.199128:0:94389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc79c6800 4 00000100:00100000:2.0:1784047562.199156:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709378688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047562.199169:0:94367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.199184:0:94367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.199636:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709378816:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784047562.199675:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.199707:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.199748:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378816 00000100:00100000:1.0:1784047562.199752:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378816 00000100:00100000:1.0:1784047562.199785:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784047562.199793:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709378816:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784047562.199807:0:94372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 00000100:00100000:0.0:1784047562.199956:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:1.0:1784047562.200031:0:94372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784047562.200036:0:94372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784047562.200039:0:94372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784047562.200042:0:94372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 128 00000100:00100000:1.0:1784047562.200239:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+9:94367:x1870705709378816:12345-0@lo:256:mount.lustre.0 Request processed in 445us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.200246:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784047562.200308:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709378816:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784047562.201117:0:94367:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784047562.201179:0:94367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.201199:0:94367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047562.201208:0:94367:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cbc79c6800 from 1 10000000:01000000:2.0:1784047562.201211:0:94367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784047562.201243:0:94367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.201252:0:94367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.201261:0:94367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.201283:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709378944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784047562.201324:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.201375:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.201434:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709378944 00000100:00100000:1.0:1784047562.201439:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709378944 00000100:00100000:1.0:1784047562.201482:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784047562.201490:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+9:94367:x1870705709378944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784047562.201500:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047562.201512:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbe400/0x4426598c0c775b56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775b4f expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.201531:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbe400/0x4426598c0c775b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775b4f expref: 10 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.201540:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbe400/0x4426598c0c775b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b4f expref: 10 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.201549:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbe400, rc 0) 00000100:00100000:1.0:1784047562.201587:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709378944:12345-0@lo:101:mount.lustre.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.201599:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784047562.201946:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709378944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047562.201961:0:94367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b56 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.201970:0:94367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775b56 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.202034:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784047562.202060:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.202086:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd004070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.202132:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379072 00000100:00100000:1.0:1784047562.202136:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379072 00000100:00100000:1.0:1784047562.202166:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784047562.202173:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709379072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047562.202317:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709379072:12345-0@lo:501:mount.lustre.0 Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.202324:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784047562.202399:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784047562.202431:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784047562.202475:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047562.202499:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047562.202544:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379200 00000100:00100000:2.0:1784047562.202548:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379200 00000100:00100000:2.0:1784047562.202580:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784047562.202587:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709379200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047562.202698:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709379200:12345-0@lo:503:mount.lustre.0 Request processed in 111us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047562.202704:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784047562.202754:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784047562.203133:0:94390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94390:1870705709379328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047562.203170:0:94390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.203200:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379328 00000100:00100000:2.0:1784047562.203204:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379328 00000100:00100000:2.0:1784047562.203222:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784047562.203228:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:94390:x1870705709379328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047562.203365:0:94390:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047562.204076:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:94390:x1870705709379328:12345-0@lo:502:llog_process_th.0 Request processed in 845us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.204087:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784047562.204212:0:94390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94390:1870705709379328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047562.204245:0:94390:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.204255:0:94390:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.204257:0:94390:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784047562.204264:0:94390:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbc79c6800 00000020:00000080:2.0:1784047562.204266:0:94390:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784047562.204274:0:94390:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.204276:0:94390:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.204278:0:94390:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784047562.204280:0:94390:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047562.204282:0:94390:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.204284:0:94390:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784047562.204287:0:94390:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbc79c6800 00000020:00000080:2.0:1784047562.204289:0:94390:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784047562.204370:0:94390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94390:1870705709379456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047562.204418:0:94390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.204486:0:94390:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccf349a600 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.211499:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379456 00000100:00100000:1.0:1784047562.211514:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379456 00000100:00100000:1.0:1784047562.211584:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784047562.211596:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:94390:x1870705709379456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047562.212040:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:94390:x1870705709379456:12345-0@lo:502:llog_process_th.0 Request processed in 445us (7619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.212049:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784047562.213592:0:94390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94390:1870705709379456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047562.214154:0:94390:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047562.214163:0:94390:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047562.214166:0:94390:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784047562.214171:0:94390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784047562.214794:0:94367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784047562.214889:0:94367:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784047562.214950:0:94367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b56 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.214962:0:94367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b56 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047562.215023:0:94367:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784047562.215026:0:94367:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cbc79c6800 10000000:01000000:0.0:1784047562.215029:0:94367:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cbc79c6800 10000000:01000000:0.0:1784047562.215033:0:94367:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784047562.215039:0:94367:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cbc79c6800 from 1 10000000:01000000:0.0:1784047562.215042:0:94367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047562.215081:0:94367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.215089:0:94367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.215124:0:94367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047562.215149:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784047562.215222:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.215259:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73480 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.215279:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379584 00000100:00100000:0.0:1784047562.215292:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379584 00000100:00100000:0.0:1784047562.215332:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047562.215340:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709379584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047562.215353:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047562.215366:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775b5d expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.215393:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775b5d expref: 11 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.216455:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b5d expref: 11 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.216466:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601600, rc 0) 00000100:00100000:0.0:1784047562.216525:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94367:x1870705709379584:12345-0@lo:101:mount.lustre.0 Request processed in 1183us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.216533:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784047562.216596:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784047562.216639:0:94367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047562.216657:0:94367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047562.216732:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047562.216761:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.216789:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.217180:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379712 00000100:00100000:1.0:1784047562.217186:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379712 00000100:00100000:0.0:1784047562.217265:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784047562.217280:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94367:x1870705709379712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784047562.217464:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94367:x1870705709379712:12345-0@lo:501:mount.lustre.0 Request processed in 184us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.217472:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784047562.217482:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784047562.217516:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784047562.217589:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.217747:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.217878:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379840 00000100:00100000:0.0:1784047562.217884:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379840 00000100:00100000:0.0:1784047562.217918:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784047562.217925:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:94367:x1870705709379840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047562.218056:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:94367:x1870705709379840:12345-0@lo:503:mount.lustre.0 Request processed in 131us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.218063:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784047562.218088:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709379840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784047562.219513:0:94393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94393:1870705709379968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047562.219572:0:94393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.219626:0:94393:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047562.219906:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709379968 00000100:00100000:3.0:1784047562.219912:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709379968 00000100:00100000:3.0:1784047562.220836:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784047562.220849:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94393:x1870705709379968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047562.220999:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94393:x1870705709379968:12345-0@lo:502:llog_process_th.0 Request processed in 153us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.221008:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784047562.221128:0:94393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94393:1870705709379968:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784047562.221203:0:94393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784047562.221220:0:94393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ccc5e48000) 00000020:00000080:0.0:1784047562.221248:0:94393:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784047562.221424:0:94393:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc79c6800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784047562.221429:0:94393:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbc79c6800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784047562.221432:0:94393:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc79c6800 4 00010000:00080000:0.0:1784047562.221458:0:94393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccc5e52000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1784047562.223028:0:94393:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784047562.223131:0:94393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784047562.223172:0:94393:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784047562.223186:0:94393:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4426598c0c775b72 00000100:00080000:0.0:1784047562.223208:0:94393:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784047562.223221:0:94393:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccc5e52000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047562.223256:0:94393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccff10c700 x1870705709380096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784047562.223290:0:94393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784047562.223601:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709380096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784047562.223754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.223810:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380096 00000100:00100000:1.0:1784047562.223818:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380096 00000100:00100000:1.0:1784047562.223850:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1784047562.223857:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709380096:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784047562.223920:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870705709380096:12345-0@lo:38:llog_process_th.0 Request processed in 61us (165us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784047562.223934:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1784047562.223991:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784047562.224000:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e52000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784047562.224005:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784047562.224009:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709380096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784047562.227918:0:94393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94393:1870705709380224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047562.228002:0:94393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.228048:0:94393:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.228491:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380224 00000100:00100000:1.0:1784047562.228498:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380224 00000100:00100000:1.0:1784047562.228551:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784047562.228561:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:94393:x1870705709380224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047562.230982:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:94393:x1870705709380224:12345-0@lo:502:llog_process_th.0 Request processed in 2414us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.230996:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784047562.231234:0:94393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94393:1870705709380224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047562.231308:0:94393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94393:1870705709380352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047562.231352:0:94393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.231385:0:94393:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e000 going to sleep for 11 seconds 00000100:00100000:3.0:1784047562.233212:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380352 00000100:00100000:3.0:1784047562.233231:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380352 00000100:00100000:3.0:1784047562.233288:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784047562.233299:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94393:x1870705709380352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047562.235976:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:94393:x1870705709380352:12345-0@lo:502:llog_process_th.0 Request processed in 2672us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.235990:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784047562.236248:0:94393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:94393:1870705709380352:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784047562.236286:0:94393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1784047562.237087:0:94367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:2.0:1784047562.237123:0:94367:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047562.237145:0:94367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.237165:0:94367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784047562.237225:0:94367:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784047562.237227:0:94367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047562.237229:0:94367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047562.237230:0:94367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047562.237232:0:94367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047562.237234:0:94367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047562.237235:0:94367:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047562.237237:0:94367:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047562.237239:0:94367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047562.237240:0:94367:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047562.237245:0:94367:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784047562.237248:0:94367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784047562.237249:0:94367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047562.237250:0:94367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047562.237252:0:94367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047562.237253:0:94367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047562.237254:0:94367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047562.237255:0:94367:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047562.237257:0:94367:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047562.237258:0:94367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047562.237259:0:94367:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047562.237282:0:94367:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784047562.237300:0:94367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709380480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784047562.237346:0:94367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.237376:0:94367:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047562.237893:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380480 00000100:00100000:3.0:1784047562.237901:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380480 00000100:00100000:3.0:1784047562.237946:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784047562.237954:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:94367:x1870705709380480:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784047562.237983:0:94374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784047562.237996:0:94374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784047562.240141:0:94374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047562.240160:0:94374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784047562.240457:0:94377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784047562.240463:0:94377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784047562.240486:0:94377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.240506:0:94377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b41 expref: 11 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.240527:0:94377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.240565:0:94377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775b41 expref: 11 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.240580:0:94377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775b41 expref: 11 pid: 94374 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.240595:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef506680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709380608:0@lo:104: 00000100:00100000:2.0:1784047562.241571:0:94377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.241631:0:94377:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047562.241759:0:9519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380608 00000100:00100000:1.0:1784047562.241766:0:9519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380608 00000100:00100000:1.0:1784047562.241920:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1784047562.241930:0:9519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6e36843b-2016-43fe-8842-da5818d68597+3:94377:x1870705709380608:12345-0@lo:104: 00010000:00010000:1.0:1784047562.241945:0:9519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.241995:0:9519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047562.242001:0:9519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6e36843b-2016-43fe-8842-da5818d68597+3:94377:x1870705709380608:12345-0@lo:104: Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.242008:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:1.0:1784047562.242028:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047562.242033:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242052:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047562.242056:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242064:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047562.242071:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047562.242076:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047562.242107:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242113:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047562.242133:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242140:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf000/0x4426598c0c775b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b48 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242155:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047562.242157:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047562.242159:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047562.242174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709380736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047562.242214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047562.242257:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380736 00000100:00100000:1.0:1784047562.242261:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380736 00010000:00010000:1.0:1784047562.242278:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b41 expref: 12 pid: 94374 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047562.242307:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1784047562.242313:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+12:3647:x1870705709380736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047562.242323:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047562.242328:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b41 expref: 12 pid: 94374 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242338:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775b41 expref: 12 pid: 94374 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242356:0:10393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242363:0:10393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784047562.242376:0:10393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013845937s 00010000:00010000:1.0:1784047562.242380:0:10393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242387:0:10393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242394:0:10393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242401:0:10393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242406:0:10393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047562.242416:0:10393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242422:0:10393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242431:0:10393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047562.242440:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047562.242469:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+12:3647:x1870705709380736:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047562.242475:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1784047562.242509:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709380736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047562.243104:0:94377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600c00/0x4426598c0c775b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775b41 expref: 11 pid: 94374 timeout: 3760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047562.243117:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef506680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709380608:0@lo:104: 00010000:00010000:2.0:1784047562.243131:0:94377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.243140:0:94377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.243147:0:94377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047562.243154:0:94377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775b79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047562.246026:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+10:94367:x1870705709380480:12345-0@lo:253:mount.lustre.0 Request processed in 8062us (8669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047562.246042:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784047562.246146:0:94367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:94367:1870705709380480:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784047562.246168:0:94367:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784047562.246171:0:94367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784047562.246173:0:94367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784047562.246174:0:94367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047562.246175:0:94367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047562.246176:0:94367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047562.246177:0:94367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047562.246178:0:94367:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784047562.246180:0:94367:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784047562.246182:0:94367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047562.246183:0:94367:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784047562.246217:0:94367:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1784047562.257354:0:94367:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411365 00000040:01000000:3.0:1784047562.260587:0:94367:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784047562.260947:0:94398:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411365 00000020:00080000:2.0:1784047562.260952:0:94398:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411365 00000040:01000000:2.0:1784047562.261280:0:94399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784047562.261299:0:94367:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784047562.262003:0:94399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784047562.263592:0:94400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94400:1870705709380864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047562.263682:0:94400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.263735:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380864 00000100:00100000:0.0:1784047562.263743:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380864 00000100:00100000:2.0:1784047562.263782:0:94400:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c66240 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.263790:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:0.0:1784047562.263868:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94400:x1870705709380864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047562.263977:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94400:x1870705709380864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 177us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.263986:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:2.0:1784047562.264501:0:94400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94400:1870705709380864:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1784047562.264531:0:94400:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784047562.264560:0:94400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94400:1870705709380992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784047562.264594:0:94400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047562.264639:0:94400:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c66240 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.264721:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709380992 00000100:00100000:0.0:1784047562.264726:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709380992 00000100:00100000:0.0:1784047562.264754:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:0.0:1784047562.264760:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94400:x1870705709380992:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784047562.264832:0:94367:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784047562.264884:0:94367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784047562.265207:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94400:x1870705709380992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 444us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.265215:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000004:00000080:3.0:1784047562.265327:0:94367:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784047562.265336:0:94367:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784047562.265370:0:94367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784047562.265754:0:94400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef504a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94400:1870705709380992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047562.265898:0:94400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94400:1870705709381120:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047562.265933:0:94400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047562.265971:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381120 00000100:00100000:0.0:1784047562.265976:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381120 00000100:00100000:0.0:1784047562.266009:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:0.0:1784047562.266016:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94400:x1870705709381120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784047562.266082:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94400:x1870705709381120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047562.266088:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:0.0:1784047562.266108:0:94400:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047562.266121:0:94400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94400:1870705709381120:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1784047562.266164:0:94400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784047562.266372:0:94399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784047562.266432:0:94399:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1784047562.267411:0:94367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784047562.268340:0:94367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784047562.268384:0:94367:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784047562.268546:0:94367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784047562.269245:0:94367:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00010000:00080000:3.0:1784047562.271261:0:94367:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084296 00010000:00080000:2.0:1784047562.272110:0:94401:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94401 00010000:02000000:2.0:1784047562.272157:0:94401:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1784047562.272161:0:94401:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784047562.272165:0:94401:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784047562.272245:0:94367:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784047562.272270:0:94367:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784047562.272292:0:94367:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784047562.272307:0:94367:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:0.0:1784047562.273438:0:94400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784047562.273505:0:94400:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784047562.273510:0:94400:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1784047562.274998:0:94401:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:3.0:1784047562.277001:0:94367:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047562.277291:0:94367:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047563.027766:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784047563.155211:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784047563.155219:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cbc79c6800 from 129 10000000:01000000:0.0:1784047563.155224:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784047563.155265:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.155291:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.155305:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.155331:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.155414:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.155468:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.155480:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381248 00000100:00100000:2.0:1784047563.155488:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381248 00000100:00100000:2.0:1784047563.155549:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784047563.155558:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+10:6515:x1870705709381248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.155573:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047563.155587:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775b80 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.155628:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775b80 expref: 11 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.155639:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b80 expref: 11 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.155647:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47200, rc 0) 00000100:00100000:2.0:1784047563.155686:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709381248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.155693:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784047563.156560:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.156576:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.156585:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.156658:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.156697:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.156724:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.156831:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381376 00000100:00100000:3.0:1784047563.156838:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381376 00000100:00100000:3.0:1784047563.156880:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784047563.156888:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709381376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047563.156906:0:94374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784047563.156923:0:94374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047563.156927:0:94374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 129 00000100:00100000:3.0:1784047563.157014:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709381376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.157022:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784047563.157065:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784047563.157112:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784047563.157119:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.157128:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.157145:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047563.157148:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 58 10000000:01000000:0.0:1784047563.157150:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047563.157168:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.157187:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.157194:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.157207:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.157232:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.157245:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.157317:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381504 00000100:00100000:3.0:1784047563.157322:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381504 00000100:00100000:3.0:1784047563.157364:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784047563.157371:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+11:6515:x1870705709381504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047563.157379:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047563.157390:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775b8e expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.157417:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775b8e expref: 12 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.157427:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b8e expref: 12 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.157435:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89e00, rc 0) 00000100:00100000:3.0:1784047563.158011:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709381504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 638us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.158018:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784047563.158078:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.158092:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.158102:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.158167:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.158212:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.158247:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.158302:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381632 00000100:00100000:3.0:1784047563.158307:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381632 00000100:00100000:3.0:1784047563.158338:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784047563.158346:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd44e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709381632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.158498:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd44e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709381632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.158505:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784047563.158561:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.158593:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.158651:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047563.158675:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d480 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.158725:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381760 00000100:00100000:3.0:1784047563.158729:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381760 00000100:00100000:3.0:1784047563.158773:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784047563.158780:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709381760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.158864:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709381760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.158870:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784047563.159003:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784047563.160923:0:94450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1784047563.161086:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1784047563.161114:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047563.161125:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.161136:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047563.161144:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784047563.161146:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 126 10000000:01000000:2.0:1784047563.161149:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784047563.161199:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.161223:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.161233:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.161257:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.161316:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.161365:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.164712:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709381888 00000100:00100000:0.0:1784047563.164726:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709381888 00000100:00100000:0.0:1784047563.164801:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784047563.164811:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+12:6515:x1870705709381888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.164829:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047563.164847:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775b9c expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.164875:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775b9c expref: 13 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.164888:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b9c expref: 13 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.164967:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600800, rc 0) 00000100:00100000:0.0:1784047563.165057:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709381888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.165064:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784047563.165193:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709381888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.165214:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.170169:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.170277:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.170380:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.170428:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.178930:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382016 00000100:00100000:2.0:1784047563.178952:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382016 00000100:00100000:2.0:1784047563.179076:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784047563.179089:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709382016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784047563.179125:0:94374:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784047563.179143:0:94374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784047563.179147:0:94374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784047563.179155:0:94374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784047563.179157:0:94374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784047563.179159:0:94374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 129 00000100:00100000:2.0:1784047563.179379:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709382016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 292us (8999us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.179389:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784047563.179500:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784047563.179645:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784047563.179657:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.179668:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.179677:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784047563.179680:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:0.0:1784047563.179697:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047563.180975:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.181001:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.181012:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.181038:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.181091:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047563.186087:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382144 00000100:00100000:1.0:1784047563.186105:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382144 00000100:00100000:1.0:1784047563.186168:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784047563.186194:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+13:6515:x1870705709382144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047563.186225:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047563.186244:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775baa expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.186272:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775baa expref: 14 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.186285:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775baa expref: 14 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.186294:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbf200, rc 0) 00000100:00100000:1.0:1784047563.186366:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709382144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (5274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.186373:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784047563.187845:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.187889:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.187914:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.187926:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.188007:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.188051:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.188065:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.188088:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382272 00000100:00100000:0.0:1784047563.188094:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382272 00000100:00100000:0.0:1784047563.188124:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047563.188132:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709382272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.188295:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709382272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.188303:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784047563.188351:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.188382:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.188423:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.188440:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.188453:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382400 00000100:00100000:0.0:1784047563.188457:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382400 00000100:00100000:0.0:1784047563.188476:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784047563.188483:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709382400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.188597:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709382400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.188625:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784047563.189485:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047563.191100:0:94452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:0.0:1784047563.191845:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:0.0:1784047563.191886:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784047563.191897:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.191910:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.191920:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1784047563.191923:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ccc355c000 from 1 10000000:01000000:0.0:1784047563.191926:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784047563.191965:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.191973:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.191983:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.192019:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.192090:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.192180:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.192220:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382528 00000100:00100000:2.0:1784047563.192227:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382528 00000100:00100000:2.0:1784047563.192366:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784047563.192378:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+14:6515:x1870705709382528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.192392:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047563.192406:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47c00/0x4426598c0c775bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775bb8 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.192428:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47c00/0x4426598c0c775bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775bb8 expref: 15 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.192439:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47c00/0x4426598c0c775bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bb8 expref: 15 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.192448:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47c00, rc 0) 00000100:00100000:2.0:1784047563.192489:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709382528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.192496:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784047563.192571:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.192587:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bbf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.192596:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bbf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.192629:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784047563.192634:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bbf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.192640:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601000/0x4426598c0c775bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bbf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.192648:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784047563.192650:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccc355c000 from 7 10000000:01000000:0.0:1784047563.192653:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784047563.192666:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.192673:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.192680:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.192704:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.192732:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.192762:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.192902:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382656 00000100:00100000:2.0:1784047563.192906:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382656 00000100:00100000:2.0:1784047563.192964:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784047563.192979:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709382656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.192987:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047563.192995:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47800/0x4426598c0c775bcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775bc6 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.193011:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47800/0x4426598c0c775bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775bc6 expref: 16 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.193020:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47800/0x4426598c0c775bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bc6 expref: 16 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.193027:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47800, rc 0) 00000100:00100000:2.0:1784047563.193064:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709382656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.193070:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784047563.193126:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.193138:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bcd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.193147:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bcd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.193210:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.193235:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.193269:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.193282:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382784 00000100:00100000:0.0:1784047563.193286:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382784 00000100:00100000:0.0:1784047563.193309:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784047563.193316:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709382784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.193432:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709382784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.193440:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784047563.193468:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.193493:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.193527:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.193540:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.193571:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709382912 00000100:00100000:0.0:1784047563.193575:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709382912 00000100:00100000:0.0:1784047563.193602:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784047563.193629:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709382912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.193708:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709382912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.193715:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784047563.193869:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709382912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047563.194537:0:94454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784047563.195126:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784047563.195148:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784047563.195159:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bcd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.195181:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bcd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047563.195191:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047563.195194:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 58 10000000:01000000:2.0:1784047563.195197:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047563.195228:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.195237:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.195423:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.195447:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.195495:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.195530:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.195651:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383040 00000100:00100000:0.0:1784047563.195658:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383040 00000100:00100000:0.0:1784047563.195699:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784047563.195706:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709383040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.195719:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047563.195732:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775bd4 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.195893:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 17 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.195905:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 17 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.195914:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600200, rc 0) 00000100:00100000:0.0:1784047563.195990:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709383040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 284us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.195997:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784047563.196061:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.196074:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.196084:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.196139:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.196162:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.196223:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccfdf0c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.196399:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383168 00000100:00100000:0.0:1784047563.196410:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383168 00000100:00100000:0.0:1784047563.196474:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784047563.196482:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709383168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.196628:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709383168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.196636:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784047563.199080:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.199147:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.199230:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047563.199333:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.200572:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383296 00000100:00100000:0.0:1784047563.200582:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383296 00000100:00100000:0.0:1784047563.200689:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784047563.200699:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709383296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.200834:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709383296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.200843:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784047563.201023:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047563.205052:0:94455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1784047563.205207:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1784047563.205237:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047563.205248:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.205260:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.205269:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784047563.205272:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1784047563.205275:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047563.205313:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.205321:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.205343:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.205372:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.205445:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.205495:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.205886:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383424 00000100:00100000:2.0:1784047563.205894:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383424 00000100:00100000:2.0:1784047563.205945:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784047563.205954:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709383424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.205966:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047563.205979:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775be2 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.206002:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775be2 expref: 18 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.206024:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775be2 expref: 18 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.206033:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46c00, rc 0) 00000100:00100000:2.0:1784047563.206084:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709383424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.206093:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784047563.206117:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.206136:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.206146:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.206212:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.206238:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.206268:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.206346:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383552 00000100:00100000:2.0:1784047563.206351:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383552 00000100:00100000:2.0:1784047563.206383:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784047563.206389:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709383552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.206555:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709383552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.206563:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784047563.206669:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.206703:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.206743:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.206764:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.207358:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383680 00000100:00100000:2.0:1784047563.207364:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383680 00000100:00100000:2.0:1784047563.207401:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784047563.207408:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709383680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.209543:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709383680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2127us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.209556:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784047563.209581:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047563.215486:0:94456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784047563.216137:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784047563.216165:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784047563.216188:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.216201:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047563.216212:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784047563.216215:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccf756a000 from 7 10000000:01000000:1.0:1784047563.216217:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047563.216259:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.216268:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.216289:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047563.216324:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.216409:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047563.216451:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d480 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.220556:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383808 00000100:00100000:2.0:1784047563.220574:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383808 00000100:00100000:2.0:1784047563.220655:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784047563.220668:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709383808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.220687:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047563.220715:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775bf0 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.220810:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775bf0 expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.220823:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bf0 expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.220832:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c47000, rc 0) 00000100:00100000:2.0:1784047563.220914:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709383808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.220921:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784047563.221079:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047563.221100:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bf7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.221112:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bf7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047563.224343:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.224431:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047563.224477:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709383936 00000100:00100000:1.0:1784047563.224484:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709383936 00000100:00100000:1.0:1784047563.224534:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784047563.224544:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709383936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.224840:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709383936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.224849:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784047563.224899:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047563.224922:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709383936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.225045:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.225100:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047563.225130:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc935a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.225779:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384064 00000100:00100000:3.0:1784047563.225786:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384064 00000100:00100000:3.0:1784047563.225825:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784047563.225836:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709384064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.225961:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709384064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.225969:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784047563.226059:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047563.232576:0:94458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784047563.232825:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784047563.232862:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784047563.232875:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bf7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.232886:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775bf7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047563.232907:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047563.232910:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 58 10000000:01000000:3.0:1784047563.232913:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047563.232952:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.232960:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.232971:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047563.232999:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.233078:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047563.233116:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047563.234020:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384192 00000100:00100000:1.0:1784047563.234029:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384192 00000100:00100000:1.0:1784047563.234085:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784047563.234094:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709384192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047563.234112:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047563.234127:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775bfe expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.234152:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775bfe expref: 20 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.234162:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bfe expref: 20 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.234180:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbea00, rc 0) 00000100:00100000:1.0:1784047563.234241:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709384192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.234247:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784047563.234478:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.234496:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.234509:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.234593:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.235492:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.235530:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.235593:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384320 00000100:00100000:3.0:1784047563.235600:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384320 00000100:00100000:3.0:1784047563.235664:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784047563.235682:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709384320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.235906:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709384320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.235913:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784047563.235984:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.236039:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.236089:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.236121:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047563.236163:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384448 00000100:00100000:2.0:1784047563.236168:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384448 00000100:00100000:2.0:1784047563.236212:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784047563.236218:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709384448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.236313:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709384448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047563.236326:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784047563.236562:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047563.238644:0:94460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1784047563.238733:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1784047563.238908:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047563.238921:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.238932:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047563.238943:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784047563.238946:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784047563.238949:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784047563.238986:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.238993:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.239004:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.239030:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.239096:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.239196:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.242559:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384576 00000100:00100000:3.0:1784047563.242574:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384576 00000100:00100000:1.0:1784047563.244541:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784047563.244554:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709384576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047563.244576:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047563.244597:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775c0c expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.244672:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775c0c expref: 21 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.244684:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775c0c expref: 21 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.244693:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbee00, rc 0) 00000100:00100000:1.0:1784047563.244846:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709384576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (5748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.244853:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784047563.245061:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047563.245082:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047563.245104:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047563.245196:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047563.245232:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047563.246457:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.248823:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384704 00000100:00100000:3.0:1784047563.248836:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384704 00000100:00100000:1.0:1784047563.251905:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784047563.251921:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709384704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.252137:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709384704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (6904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.252146:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784047563.252285:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.252349:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.252409:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047563.261550:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384832 00000100:00100000:3.0:1784047563.261566:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384832 00000100:00100000:3.0:1784047563.261643:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784047563.261654:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709384832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.263714:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709384832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2053us (11296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.263728:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784047563.264418:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047563.264448:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047563.267327:0:94462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784047563.267635:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784047563.267668:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784047563.267680:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.267692:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047563.267702:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784047563.267705:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ccfe6b8800 from 7 10000000:01000000:1.0:1784047563.267708:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784047563.267762:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.267778:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.267789:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047563.267827:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.267893:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047563.267942:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709384960 00000100:00100000:1.0:1784047563.267947:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff367a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.267951:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709384960 00000100:00100000:3.0:1784047563.268001:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784047563.268009:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709384960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047563.268022:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047563.268035:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b88400/0x4426598c0c775c21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775c1a expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.268058:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b88400/0x4426598c0c775c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775c1a expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.268068:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b88400/0x4426598c0c775c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775c1a expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.268088:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88400, rc 0) 00000100:00100000:3.0:1784047563.268132:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709384960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.268139:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784047563.268317:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709384960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.268333:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.268342:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.268401:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.268430:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.268455:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.268476:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385088 00000100:00100000:3.0:1784047563.268481:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385088 00000100:00100000:3.0:1784047563.268512:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784047563.268519:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709385088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047563.268654:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709385088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.268662:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784047563.268832:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.268864:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.268901:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.268934:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047563.269213:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385216 00000100:00100000:1.0:1784047563.269218:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385216 00000100:00100000:1.0:1784047563.269263:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784047563.269273:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709385216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.269372:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709385216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.269379:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784047563.269660:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047563.270823:0:94463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784047563.273988:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784047563.274029:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784047563.274040:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.274054:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047563.274069:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784047563.274072:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ccc5e4b380 from 1 10000000:01000000:1.0:1784047563.274075:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784047563.274117:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.274132:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.274143:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047563.274181:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.274248:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047563.274336:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047563.274771:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385344 00000100:00100000:3.0:1784047563.274780:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385344 00000100:00100000:3.0:1784047563.274879:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784047563.274891:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709385344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047563.274907:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047563.274923:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b89800/0x4426598c0c775c2f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775c28 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.274945:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b89800/0x4426598c0c775c2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775c28 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.274955:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b89800/0x4426598c0c775c2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775c28 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047563.274964:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89800, rc 0) 00000100:00100000:3.0:1784047563.275059:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709385344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047563.275066:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784047563.275256:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.275272:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c2f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.275281:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c2f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.275301:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784047563.275305:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c2f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.275312:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbec00/0x4426598c0c775c28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c2f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047563.275319:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784047563.275322:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:0.0:1784047563.275325:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784047563.275341:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.275348:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.275355:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.275372:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.275407:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.275439:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047563.275487:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385472 00000100:00100000:1.0:1784047563.275491:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385472 00000100:00100000:1.0:1784047563.275526:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784047563.275532:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709385472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047563.275540:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047563.275548:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775c36 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.275562:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775c36 expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.275571:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775c36 expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047563.275577:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbfc00, rc 0) 00000100:00100000:1.0:1784047563.275634:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709385472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.275640:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784047563.275754:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.275766:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.275774:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047563.275823:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047563.275849:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047563.275867:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047563.275968:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385600 00000100:00100000:1.0:1784047563.275972:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385600 00000100:00100000:1.0:1784047563.275999:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784047563.276006:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709385600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047563.276078:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709385600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047563.276085:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784047563.276151:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccff10c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709385600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784047563.276188:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784047563.276194:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.276201:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047563.404124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047563.404164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047563.404279:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492352 00000100:00100000:1.0:1784047563.404289:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492352 00000100:00100000:1.0:1784047563.404345:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:1.0:1784047563.404356:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2402:x1870705689492352:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047563.404426:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2402:x1870705689492352:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 72us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.404434:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:3.0:1784047563.404691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047563.407333:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492608 00000100:00100000:0.0:1784047563.407348:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492608 00000100:00100000:0.0:1784047563.407429:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492480 00000100:00100000:0.0:1784047563.407433:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492480 00000100:00100000:0.0:1784047563.407455:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1394 00000100:00100000:0.0:1784047563.407466:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689492608:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047563.407558:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689492608:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 94us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.407583:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1394 00000100:00100000:0.0:1784047563.407602:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1443 00000100:00100000:0.0:1784047563.407629:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1870705689492480:12345-192.168.204.40@tcp:38:kworker.0 00010000:00080000:0.0:1784047563.407658:0:66221:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '0c846d7a-6357-4e9c-a620-e35737ede709' at ffff99ccd001c000, cookie 0x4426598c0c775ad1 00010000:00080000:0.0:1784047563.407664:0:66221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp recovering/t120259084297 exp ffff99ccd001c000 cur 3661 last 1784047562 00010000:02000400:0.0:1784047563.407674:0:66221:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784047563.407679:0:66221:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784047563.407704:0:66221:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784047563.408088:0:66221:0:(import.c:65:import_set_state_nolock()) ffff99ccfe661800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047563.408126:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689492480:12345-192.168.204.40@tcp:38:kworker.0 Request processed in 496us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.408134:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1443 00000100:00080000:3.0:1784047563.408469:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047563.412244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047563.412758:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483136 00000100:00100000:1.0:1784047563.412775:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483136 00000100:00100000:1.0:1784047563.413230:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1444 00000100:00100000:1.0:1784047563.413242:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689483136:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00080000:1.0:1784047563.413265:0:66220:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084297, replaying 00000100:00100000:1.0:1784047563.413877:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689483136:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 635us (1649us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047563.413886:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1444 00010000:00080000:2.0:1784047563.415685:0:94401:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1784047563.851739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047563.851822:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492736 00000100:00100000:0.0:1784047563.851832:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492736 00000100:00100000:0.0:1784047563.851889:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:0.0:1784047563.851900:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689492736:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047563.851919:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047563.851939:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae507 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.851969:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 10 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.851981:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 10 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047563.852004:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600c00, rc 0) 00000100:00100000:0.0:1784047563.852069:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689492736:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 170us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047563.852077:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:2.0:1784047563.862747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047563.862820:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492864 00000100:00100000:1.0:1784047563.862830:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492864 00000100:00100000:1.0:1784047563.862893:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:1.0:1784047563.862905:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689492864:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784047563.862947:0:94375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1784047563.862963:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784047563.862966:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784047563.862969:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784047563.862985:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784047563.862988:0:94375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 129 00000100:00100000:1.0:1784047563.865805:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689492864:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 2888us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047563.865821:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:2.0:1784047564.050803:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709385728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047564.050885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784047564.050906:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047564.050996:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784047564.051005:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709385856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047564.051032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047564.051079:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385728 00000100:00100000:2.0:1784047564.051088:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385728 00000100:00080000:3.0:1784047564.051120:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047564.051145:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385856 00000100:00100000:3.0:1784047564.051149:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385856 00000100:00100000:2.0:1784047564.051153:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:2.0:1784047564.051170:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709385728:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784047564.051188:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:3.0:1784047564.051196:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709385856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047564.051202:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00002000:00000024:3.0:1784047564.051209:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047564.051247:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709385856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047564.051296:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00080000:3.0:1784047564.051320:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047564.051359:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709385856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047564.053801:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709385728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047564.054564:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709385728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3390us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047564.054577:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00010000:00010000:3.0:1784047565.075778:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047566.099010:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784047567.105963:0:94652:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784047567.123018:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047567.644318:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709385984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047567.644556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047567.644656:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709385984 00000100:00100000:3.0:1784047567.644664:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709385984 00000100:00100000:3.0:1784047567.644715:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1784047567.644723:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709385984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047567.644771:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047567.644819:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870705709385984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047567.644826:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1784047567.644879:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709385984:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1784047567.646214:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047567.646221:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047567.646224:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047567.646230:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3660 00000100:00080000:3.0:1784047567.646234:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047567.646240:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc64c8000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047567.646276:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709386112:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.646331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047567.646387:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386112 00000100:00100000:0.0:1784047567.646408:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386112 00000100:00100000:0.0:1784047567.646447:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784047567.646455:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709386112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.647135:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c21f80 x1870705709386240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047567.647172:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047567.647176:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047567.647178:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047567.647182:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3660 00000100:00080000:3.0:1784047567.647185:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047567.647189:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc753d000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047567.647201:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c23800 x1870705709386496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784047567.647223:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047567.647227:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047567.647229:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047567.647241:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3660 00000100:00080000:3.0:1784047567.647244:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047567.647248:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99cbc6531800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047567.647261:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709386624:0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.647301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047567.647349:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709386240:0@lo:38:kworker.0 00000100:00100000:3.0:1784047567.647353:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c22680 x1870705709386752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047567.647389:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709386880:0@lo:400:kworker.0 00000100:00100000:1.0:1784047567.647390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047567.647412:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709386496:0@lo:38:kworker.0 00000100:00100000:3.0:1784047567.647448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047567.647449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047567.647480:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709386752:0@lo:38:kworker.0 00000100:00100000:3.0:1784047567.647499:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386880 00000100:00100000:3.0:1784047567.647505:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386880 00000100:00100000:1.0:1784047567.647510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047567.647557:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:3.0:1784047567.647566:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709386880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.647625:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709386880:12345-0@lo:400:kworker.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047567.647632:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00080000:3.0:1784047567.647652:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047567.647678:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709386880:0@lo:400:kworker.0 00000100:00080000:3.0:1784047567.647701:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047567.647704:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047567.647706:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047567.647709:0:52247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3660 00000100:00080000:3.0:1784047567.647712:0:52247:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784047567.647715:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99cbcaee6800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047567.647727:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c20a80 x1870705709387136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047567.647755:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709387136:0@lo:38:kworker.0 00000100:00100000:3.0:1784047567.647780:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047567.647822:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784047567.647826:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784047567.647828:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e52000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047567.647834:0:52247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ccc5e52000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1784047567.647843:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709387392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.647868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047567.648226:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709386112:12345-0@lo:400:kworker.0 Request processed in 1771us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.648236:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784047567.648277:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386624 00000100:00100000:0.0:1784047567.648281:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386624 00000100:00100000:0.0:1784047567.648318:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386240 00000100:00100000:0.0:1784047567.648321:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386240 00000100:00100000:0.0:1784047567.648330:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386496 00000100:00100000:0.0:1784047567.648332:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386496 00000100:00100000:0.0:1784047567.648339:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387136 00000100:00100000:0.0:1784047567.648342:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387136 00000100:00100000:0.0:1784047567.648351:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1784047567.648358:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709386624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.649109:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709386624:12345-0@lo:400:kworker.0 Request processed in 33us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.649133:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1784047567.649157:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1784047567.649162:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709386240:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.649191:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3665 last 0 00000020:00000080:0.0:1784047567.649236:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c775c4b 00000004:00100000:0.0:1784047567.649256:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047567.649409:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047567.649471:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709386240:12345-0@lo:38:kworker.0 Request processed in 307us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.649478:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1784047567.649492:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1784047567.649497:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709386496:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.649510:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3665 last 0 00000020:00000080:0.0:1784047567.649535:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4426598c0c775c52 00000004:00100000:0.0:1784047567.649541:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047567.649561:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccd897a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047567.649591:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870705709386496:12345-0@lo:38:kworker.0 Request processed in 93us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.649598:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1784047567.649629:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1784047567.649633:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709387136:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.649648:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3665 last 0 00000020:00000080:0.0:1784047567.649669:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4426598c0c775c59 00000004:00100000:0.0:1784047567.649675:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047567.649698:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccd897c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047567.649729:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870705709387136:12345-0@lo:38:kworker.0 Request processed in 93us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.649735:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1784047567.649772:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386752 00000100:00100000:0.0:1784047567.649778:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386752 00000100:00100000:0.0:1784047567.649803:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1784047567.649808:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870705709386752:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.649822:0:83733:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99ccd0019800, cookie 0x4426598c0c775aca 00010000:00080000:0.0:1784047567.649825:0:83733:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084295 exp ffff99ccd0019800 cur 3665 last 1784047562 00000004:00100000:0.0:1784047567.649833:0:83733:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047567.649847:0:83733:0:(import.c:65:import_set_state_nolock()) ffff99ccd897e800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1784047567.650875:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047567.651334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709386624:0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.651458:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9c23b80 x1870705709387520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047567.652450:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709386752:12345-0@lo:38:kworker.0 Request processed in 73us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.652472:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1784047567.652529:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387392 00000100:00100000:0.0:1784047567.652538:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387392 00000100:00100000:0.0:1784047567.652621:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:0.0:1784047567.652632:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709387392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.652725:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709387392:12345-0@lo:400:kworker.0 Request processed in 94us (4856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.652733:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:0.0:1784047567.652772:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709387520:0@lo:38:kworker.0 00000100:00100000:0.0:1784047567.652815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784047567.652854:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9c20a80 x1870705709387136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047567.653170:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047567.653844:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1784047567.654666:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99cbc9c20a80 x1870705709387136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047592 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.654679:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047567.654685:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047567.654689:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047567.654696:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870705709387136:0@lo:38:kworker.0 00000100:00100000:0.0:1784047567.654727:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:0.0:1784047567.654733:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084296 00000020:00080000:0.0:1784047567.654738:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99cd004946c0 refcount 2 committed 0 result 0 batchid 73014444092 00000020:00080000:0.0:1784047567.654742:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cbc7972000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99cd004940c0 00000020:00080000:0.0:1784047567.654745:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].4 00000020:00080000:0.0:1784047567.654747:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cbc7972500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ccf289da00 00000020:00080000:0.0:1784047567.654750:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].4 00000004:00080000:0.0:1784047567.654777:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000020:00080000:0.0:1784047567.654781:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99cbcaa4ed80 refcount 2 committed 0 result 0 batchid 73014444093 00000020:00080000:0.0:1784047567.654784:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cd00eb8400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99cbcaa4ea80 00000020:00080000:0.0:1784047567.654786:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].5 00000020:00080000:0.0:1784047567.654788:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cd00eb8a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cd0004da00 00000020:00080000:0.0:1784047567.654791:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].5 00000100:00080000:0.0:1784047567.654808:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1784047567.654817:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784047567.654821:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1784047567.654837:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00080000:0.0:1784047567.654840:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc6531800 from lustre-MDT0000_UUID committed 120259084296 last 0 00000100:00080000:0.0:1784047567.654843:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:0.0:1784047567.654882:0:94401:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784047567.654887:0:94401:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 120259084297 00000020:00080000:0.0:1784047567.654892:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784047567.654895:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084297, next_transno: 120259084297 00010000:00080000:0.0:1784047567.654899:0:94401:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084297) 00000020:00080000:0.0:1784047567.654901:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784047567.654909:0:94401:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689483136 t120259084297 from 192.168.204.40@tcp req@ffff99cd00d05180 x1870705689483136/t0(120259084297) o36->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:694/0 lens 528/0 e 0 to 0 dl 1784047574 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047567.655007:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709387392:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.655038:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387520 00000100:00100000:0.0:1784047567.655045:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387520 00000100:00100000:0.0:1784047567.655081:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000020:00080000:3.0:1784047567.655326:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444093 committed batchid 73014444091 00000020:00080000:3.0:1784047567.655410:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000100:00100000:0.0:1784047567.655604:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709387520:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.655669:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3665 last 0 00000020:00000080:0.0:1784047567.655706:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4426598c0c775c60 00000004:00100000:0.0:1784047567.655722:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784047567.655759:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e51800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047567.655837:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870705709387520:12345-0@lo:38:kworker.0 Request processed in 237us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.655846:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1784047567.656057:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709386368:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.656111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047567.656147:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709387264:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.656180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047567.656205:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784047567.656212:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709387008:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.656237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047567.656263:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709386368 00000100:00100000:0.0:1784047567.656268:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709386368 00000100:00100000:0.0:1784047567.656314:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1784047567.656322:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709386368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.656365:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709386368:12345-0@lo:400:kworker.0 Request processed in 44us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047567.656372:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1784047567.657649:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387264 00000100:00100000:3.0:1784047567.657658:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387264 00000100:00100000:3.0:1784047567.657703:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387008 00000100:00100000:3.0:1784047567.657707:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387008 00000100:00100000:3.0:1784047567.657735:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:3.0:1784047567.657744:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709387264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.657811:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709387264:12345-0@lo:400:kworker.0 Request processed in 68us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047567.657819:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:3.0:1784047567.657838:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:3.0:1784047567.657847:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709387008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784047567.657981:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047567.657987:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047567.657989:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047567.658028:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709386112:0@lo:400:kworker.0 00000100:00100000:3.0:1784047567.658565:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709387008:12345-0@lo:400:kworker.0 Request processed in 719us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047567.658573:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000004:00080000:3.0:1784047567.658602:0:94401:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3632us 00000100:00100000:0.0:1784047567.658781:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709386368:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.658803:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709387264:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.658826:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709387008:0@lo:400:kworker.0 00000100:00100000:0.0:1784047567.658856:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709386752:0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.658877:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9c21f80 x1870705709386240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784047567.659636:0:94679:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784047567.659641:0:94679:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784047567.659647:0:94679:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1784047567.659988:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00010000:00010000:3.0:1784047567.661717:0:94679:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c7753ae expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047567.661742:0:94679:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:0.0:1784047567.663879:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99cbc9c21f80 x1870705709386240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047592 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.666330:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047567.666338:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047567.666345:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047567.666352:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709386240:0@lo:38:kworker.0 00010000:00080000:0.0:1784047567.667012:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9c23800 x1870705709386496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.667036:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:0.0:1784047567.669791:0:3644:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99cbc9c23800 x1870705709386496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047592 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.669805:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784047567.669811:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc753d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047567.669815:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784047567.669821:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870705709386496:0@lo:38:kworker.0 00000100:00100000:0.0:1784047567.669868:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709387648:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1784047567.670011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784047567.670126:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc9c23b80 x1870705709387520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.670144:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:0.0:1784047567.670153:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784047567.670158:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784047567.670160:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccc5e52000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784047567.670166:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870705709387520:0@lo:38:kworker.0 00000001:00100000:1.0:1784047567.676646:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784047567.676683:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784047567.676712:0:75662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784047567.679994:0:94401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680030:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680048:0:94401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680064:0:94401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680118:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680127:0:94401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680571:0:94401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680580:0:94401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680587:0:94401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680593:0:94401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047567.680597:0:94401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680625:0:94401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680643:0:94401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:2.0:1784047567.680653:0:94401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047567.680658:0:94401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680664:0:94401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047567.680682:0:94401:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076674328 reply state 00000000798ec813 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680695:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.680701:0:94401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc3e94f00) 00010000:00010000:2.0:1784047567.680703:0:94401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047567.680706:0:94401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784047567.680815:0:94401:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1784047567.680835:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.680838:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084298 00000020:00080000:2.0:1784047567.680842:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.680844:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084298 00000100:00100000:3.0:1784047567.681246:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387648 00000100:00100000:3.0:1784047567.681256:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387648 00000100:00100000:3.0:1784047567.681330:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:3.0:1784047567.681343:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709387648:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1784047567.681368:0:23872:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd0045a300 x1870705709387648/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:698/0 lens 328/0 e 0 to 0 dl 1784047578 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047567.681388:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870705709387648:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 50us (11379us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047567.681395:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000020:00080000:2.0:1784047567.681534:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.681538:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084298 00000100:00100000:2.0:1784047567.698373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047567.703181:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689483648 00000100:00100000:0.0:1784047567.703200:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689483648 00000100:00100000:0.0:1784047567.703357:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1449 00000100:00100000:0.0:1784047567.703369:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:2398:x1870705689483648:12345-192.168.204.40@tcp:36:rm.0 00010000:00080000:0.0:1784047567.703392:0:66220:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084298, current: 120259084298, replaying 00000100:00100000:0.0:1784047567.703406:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+8:2398:x1870705689483648:12345-192.168.204.40@tcp:36:rm.0 Request processed in 41us (5044us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047567.703413:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1449 00000020:00080000:2.0:1784047567.706026:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.706035:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084298, next_transno: 120259084298 00010000:00080000:2.0:1784047567.706040:0:94401:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084298) 00000020:00080000:2.0:1784047567.706043:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.706060:0:94401:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689483648 t120259084298 from 192.168.204.40@tcp req@ffff99ccef507b80 x1870705689483648/t0(120259084298) o36->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:698/0 lens 512/0 e 0 to 0 dl 1784047578 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784047567.706232:0:94401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706249:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706262:0:94401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706276:0:94401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706282:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706288:0:94401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706404:0:94401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706413:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706420:0:94401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706668:0:94401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706676:0:94401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706690:0:94401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706696:0:94401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047567.706700:0:94401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706708:0:94401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706720:0:94401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff99ccc3e94800) 00010000:00010000:2.0:1784047567.706723:0:94401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784047567.706728:0:94401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706734:0:94401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c83 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706758:0:94401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706764:0:94401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706769:0:94401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706774:0:94401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047567.706777:0:94401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706792:0:94401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706801:0:94401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:2.0:1784047567.706804:0:94401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047567.706806:0:94401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706812:0:94401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46e00/0x4426598c0c775c75 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047567.706824:0:94401:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000273cc9dc reply state 00000000b1d2a0e3 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706835:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.706842:0:94401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc3e94f00) 00010000:00010000:2.0:1784047567.706845:0:94401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047567.706847:0:94401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784047567.706938:0:94401:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784047567.706959:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.706962:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084299 00000020:00080000:2.0:1784047567.706965:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.706967:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084299 00000100:00100000:2.0:1784047567.726564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047567.726707:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689492992 00000100:00100000:0.0:1784047567.726717:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689492992 00000100:00100000:0.0:1784047567.726779:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1397 00000100:00100000:0.0:1784047567.726790:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+10:2398:x1870705689492992:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784047567.726821:0:66219:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99ccef505880 x1870705689492992/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:698/0 lens 224/0 e 0 to 0 dl 1784047578 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047567.726838:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+10:2398:x1870705689492992:12345-192.168.204.40@tcp:400:ldlm_lock_repla.0 Request processed in 51us (286us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047567.726845:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1397 00000020:00080000:2.0:1784047567.727000:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.727004:0:94401:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084299 00010000:00080000:2.0:1784047567.727007:0:94401:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1784047567.727024:0:94401:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784047567.727032:0:94401:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1784047567.727034:0:94401:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1784047567.727042:0:94401:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff99cd0045a300 x1870705709387648/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:698/0 lens 328/0 e 0 to 0 dl 1784047578 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784047567.727060:0:94401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047567.727100:0:94401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4426598c0c7753a7 expref: -99 pid: 94401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.727131:0:94401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c7753a7 expref: 7 pid: 94401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.727148:0:94401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030c00/0x4426598c0c775c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c7753a7 expref: 7 pid: 94401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047567.727157:0:94401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030c00, rc 0) 00010000:00080000:2.0:1784047567.727239:0:94401:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1784047567.727262:0:94401:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1784047567.727384:0:3644:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99ccf6c47400/0x4426598c0c7753a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c8a expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784047567.727396:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784047567.727425:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709387648:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1784047567.727454:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709387776:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1784047567.727498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047567.729379:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387776 00000100:00100000:2.0:1784047567.729393:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387776 00000100:00100000:2.0:1784047567.729463:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:2.0:1784047567.729475:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870705709387776:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1784047567.729496:0:83733:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cd00458000 x1870705709387776/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:698/0 lens 224/0 e 0 to 0 dl 1784047578 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047567.729527:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870705709387776:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 55us (2028us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047567.729534:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00010000:00080000:3.0:1784047567.730564:0:94401:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1784047567.730735:0:94401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:2.0:1784047567.732854:0:94368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1784047567.732869:0:94368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00080000:2.0:1784047567.732918:0:94368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:0.0:1784047567.732985:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733003:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733011:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733018:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047567.733036:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733044:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047567.733049:0:94401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1784047567.733065:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733071:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46600/0x4426598c0c775c6e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733100:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047567.733103:0:94401:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:0.0:1784047567.733107:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733112:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733116:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047567.733119:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047567.733121:0:94401:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.40@tcp: req@ffff99ccef505880 x1870705689492992/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:698/0 lens 224/0 e 0 to 0 dl 1784047578 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047567.733140:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733149:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99ccc3e94f00) 00010000:00010000:0.0:1784047567.733152:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047567.733156:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.733161:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46a00/0x4426598c0c775c7c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784047567.733251:0:94401:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99cd00458000 x1870705709387776/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:698/0 lens 224/0 e 0 to 0 dl 1784047578 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784047567.733335:0:94401:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1784047567.733375:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784047567.733384:0:3644:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff99cd00459180 x1870705709387776/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047583 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.733393:0:3644:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99cd00459180 x1870705709387776/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047583 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047567.733400:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc6531800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784047567.733418:0:3644:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1784047567.733425:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000025090f8e): req@ffff99ccef514a80 x1870705709366528/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047551 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047567.733440:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709387776:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1784047567.733512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709387904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047567.733550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047567.733640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047567.735272:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709387904 00000100:00100000:2.0:1784047567.735453:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709387904 00000100:00100000:2.0:1784047567.735519:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709366528 00000100:00100000:2.0:1784047567.735524:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709366528 00000100:00100000:2.0:1784047567.735555:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1784047567.735665:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1870705709387904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047567.735724:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1784047567.735830:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1870705709387904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 263us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047567.735839:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1784047567.735862:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1784047567.735869:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709366528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047567.735883:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1784047567.735919:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709366528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047567.735925:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1784047567.736009:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709387904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047567.736052:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709366528:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1784047567.781816:0:94401:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc91481cbe10 00100000:10000000:2.0:1784047567.781832:0:94401:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1784047567.784057:0:94386:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x722:0x0] 00000100:00100000:3.0:1784047567.784122:0:94386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94386:1870705709388032:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784047567.784195:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047567.784228:0:94386:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c3be40 going to sleep for 11 seconds 00000004:00080000:3.0:1784047567.784243:0:94388:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x723:0x0] 00000100:00100000:3.0:1784047567.784260:0:94388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94388:1870705709388160:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784047567.784284:0:94388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047567.784310:0:94388:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c3b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047567.784334:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388032 00000100:00100000:1.0:1784047567.784341:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388032 00000100:00100000:1.0:1784047567.784380:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388160 00000100:00100000:1.0:1784047567.784383:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388160 00000100:00100000:1.0:1784047567.784402:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007 00000100:00100000:1.0:1784047567.784410:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:94386:x1870705709388032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784047567.784436:0:26185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -95 00002000:02000040:1.0:1784047567.784450:0:26185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1827 to 0x280000401:1921) 00000100:00100000:0.0:1784047567.784831:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5008 00000100:00100000:0.0:1784047567.784842:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:94388:x1870705709388160:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784047567.784862:0:26187:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -94 00002000:02000040:0.0:1784047567.784866:0:26187:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1828 to 0x2c0000401:1921) 00002000:00010000:1.0:1784047567.800795:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.800817:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.800843:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.800849:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.800856:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.800874:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.800886:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.800894:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.800919:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047567.801053:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.801059:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801068:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.801071:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.801075:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801115:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801124:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801131:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801146:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784047567.801190:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.801196:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801204:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.801206:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.801210:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801220:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801228:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801248:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801264:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784047567.801307:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.801312:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801320:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.801324:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.801327:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801337:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801345:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801354:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801367:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784047567.801406:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.801411:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801425:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.801427:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.801432:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801442:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801450:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801458:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801473:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1784047567.801485:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784047567.801490:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801499:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.801504:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801513:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801542:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801551:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007abcefcd/0x4426598c0c775c91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801575:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784047567.801578:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801586:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbfa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.801589:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801597:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801641:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801649:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b14e7ba/0x4426598c0c775c98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801661:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047567.801664:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801677:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.801681:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801689:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801700:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801708:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb90d15/0x4426598c0c775c9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801720:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.801724:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801731:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbf000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.801734:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801742:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801751:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801765:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8a8bcc/0x4426598c0c775ca6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801777:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.801781:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801788:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.801791:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801799:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801808:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801815:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069ce9f8a/0x4426598c0c775cad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801826:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.801827:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.801829:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.801875:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.801880:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801893:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.801897:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.801901:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801911:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801919:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801927:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801940:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.801947:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.801950:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801956:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.801959:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801967:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801989:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.801996:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfd1f2d/0x4426598c0c775cb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.802008:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.802010:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.802012:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.802058:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.802063:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.802070:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.802073:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.802076:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.802127:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.802132:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.809898:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.809927:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.809936:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.809978:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.809993:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.809998:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810005:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.810010:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810019:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810112:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810120:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c775cbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810147:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.810149:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.810151:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.810287:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.810294:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810305:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.810315:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.810322:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810333:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810341:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810349:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810365:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047567.810404:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.810408:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810415:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.810418:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.810421:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810430:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810438:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810450:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810463:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784047567.810496:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.810501:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810507:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.810510:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.810514:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810522:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810530:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810537:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810546:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784047567.810552:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047567.810555:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810567:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.810571:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810578:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810601:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810627:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e0fe1e/0x4426598c0c775cc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810641:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.810644:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810651:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.810654:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810661:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810671:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810684:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000932d6502/0x4426598c0c775cc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810695:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.810698:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810703:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cea00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.810707:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810715:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810723:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810730:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c775cd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810741:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.810742:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.810744:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.810778:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.810783:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810794:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.810797:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.810801:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810811:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810819:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810826:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810837:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.810843:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.810846:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810852:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cee00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.810855:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810863:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810882:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810890:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff12c59/0x4426598c0c775cd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810901:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.810903:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.810904:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.810936:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.810940:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810948:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.810951:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.810955:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810964:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810971:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810979:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.810999:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.811004:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.811007:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.811014:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.811017:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812158:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812178:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812187:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9a2904/0x4426598c0c775cde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812213:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.812214:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.812217:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.812315:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.812321:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812331:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.812344:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.812350:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812361:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812370:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812377:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812393:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.812399:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.812404:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812410:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfa00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.812414:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812421:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812430:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812446:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9309a7d/0x4426598c0c775ce5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812460:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.812462:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.812463:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.812496:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.812500:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812508:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.812511:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.812515:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812524:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812531:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812539:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812549:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.812559:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.812562:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812569:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.812572:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.812579:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813418:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813429:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000317ee874/0x4426598c0c775cec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813445:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.813447:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.813449:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.813508:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.813514:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813521:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.813524:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.813528:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813549:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813558:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813566:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.813580:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047567.813585:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.813587:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.813591:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813599:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047567.813603:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813639:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813651:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813658:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c775cf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813674:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.813676:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.813678:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.813684:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784047567.813708:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047567.813713:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813733:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1784047567.813736:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047567.813741:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813753:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813761:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813769:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813779:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784047567.813841:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784047567.813846:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813855:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1784047567.813858:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047567.813862:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813871:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813890:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.813899:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.814589:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047567.818032:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.818054:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818068:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.818073:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818095:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818121:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818147:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000655fc994/0x4426598c0c775cfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818173:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.818177:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818183:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.818186:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818193:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818203:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818209:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d79c89/0x4426598c0c775d01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818221:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.818223:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.818224:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.818360:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.818366:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818389:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.818394:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.818401:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818413:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818422:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818431:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818456:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047567.818497:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.818502:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818510:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.818513:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.818517:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818525:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818544:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818552:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818565:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047567.818572:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.818576:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818583:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.818586:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818625:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818637:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818644:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000618700c2/0x4426598c0c775d08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818660:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.818668:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818675:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cec00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.818678:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818686:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818696:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818704:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e1e931/0x4426598c0c775d0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818717:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.818719:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.818721:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.818762:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.818768:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818776:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.818779:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.818784:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818803:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818812:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818819:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818831:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.818837:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.818841:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818847:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.818850:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818858:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818867:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818874:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000361c7710/0x4426598c0c775d16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818893:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.818895:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.818897:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.818937:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.818942:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818949:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.818952:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.818956:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818966:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818974:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818982:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.818994:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.818999:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.819003:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819020:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.819023:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819031:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819042:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819049:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c775d1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819061:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819063:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819064:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.819116:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.819121:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819130:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.819132:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.819136:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819145:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819159:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819165:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819176:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.819182:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.819185:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819191:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.819194:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819201:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819212:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819219:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab121aa1/0x4426598c0c775d24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819231:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819237:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819239:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.819279:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.819284:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819291:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.819294:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.819299:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819307:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819314:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819320:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819332:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.819338:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.819341:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819348:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfe00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.819351:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819370:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819381:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819387:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d6e64dd/0x4426598c0c775d2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819400:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819402:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.819442:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.819447:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819454:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.819457:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.819461:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819470:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819477:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819490:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819502:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.819508:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.819512:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819518:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.819522:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819530:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819540:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819547:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbd6ecce/0x4426598c0c775d32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819558:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819560:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819561:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.819598:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.819627:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819636:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.819639:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.819643:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819652:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819660:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819667:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819680:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.819686:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.819690:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819696:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.819700:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819707:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819723:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819731:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e286a854/0x4426598c0c775d39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819744:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819745:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819747:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.819790:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.819795:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819802:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.819806:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.819809:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819817:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819825:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819832:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819865:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.819871:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.819875:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819882:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.819885:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819893:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819904:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819911:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3555aad/0x4426598c0c775d40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819924:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819925:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.819927:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.819965:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.819970:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.819979:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.819987:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.819991:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820001:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820009:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820015:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820026:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.820032:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.820035:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820041:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.820044:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820051:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820061:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820077:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425528d0/0x4426598c0c775d47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820092:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.820100:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820101:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820103:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820104:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.820141:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.820146:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820154:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.820157:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820161:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820169:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820177:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820183:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820206:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.820238:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.820243:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047567.820250:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.820251:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.820255:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820256:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820264:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.820265:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820267:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820271:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820280:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820286:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820287:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820295:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820309:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047567.820345:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.820350:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820358:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.820361:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820365:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820368:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca43f8c/0x4426598c0c775d4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820383:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.820384:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820387:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820393:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.820393:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820397:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820401:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820405:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820412:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.820414:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820418:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.820422:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a003a5/0x4426598c0c775d55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820422:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820429:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.820432:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820433:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.820435:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820440:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820441:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.820445:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820450:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820457:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000653548c0/0x4426598c0c775d5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820476:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820477:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820479:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.820517:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.820522:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820530:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.820533:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820537:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820546:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820554:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820561:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820581:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047567.820638:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.820644:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820662:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.820665:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820669:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820677:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820678:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.820682:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820686:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820691:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.820693:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820695:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820703:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820705:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.820714:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820721:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8718c0a/0x4426598c0c775d63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820733:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.820736:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047567.820741:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.820744:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.820745:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820747:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820753:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.820756:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820759:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820768:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820779:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820785:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820790:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820793:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820798:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680eee01/0x4426598c0c775d6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820805:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.820809:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.820811:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.820812:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820818:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.820822:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820829:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820838:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047567.820843:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.820845:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6623a41/0x4426598c0c775d71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820848:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820855:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.820858:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.820862:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820867:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.820868:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.820870:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820871:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.820876:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.820879:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820887:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.820918:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.821520:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.821526:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.821534:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.821537:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.821545:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.821557:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.821565:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084420e78/0x4426598c0c775d78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.821577:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.821578:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.821580:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.823558:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.823568:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823590:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.823594:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.823601:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823630:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823641:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823650:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823670:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.823680:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.823685:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823693:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.823698:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823707:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823735:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823744:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286bef3d/0x4426598c0c775d7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823774:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.823776:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.823778:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.823821:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.823826:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823835:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.823839:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.823844:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823853:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823862:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823870:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.823893:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.823901:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.823905:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.824497:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.824507:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.826038:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.826045:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.827712:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.827749:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.827758:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f498cedb/0x4426598c0c775d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.827790:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.827793:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.827796:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.829202:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.829216:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.829235:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.829258:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.829266:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.829281:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784047567.829710:0:26185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1826 00000100:00100000:1.0:1784047567.829841:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:94386:x1870705709388032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 45426us (45640us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047567.829852:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007 00000100:00100000:1.0:1784047567.829918:0:94386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94386:1870705709388032:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784047567.829938:0:94386:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x781:0x0] from OST, last_created [0x280000401:0x781:0x0]last_used is [0x280000401:0x722:0x0] 00010000:00010000:3.0:1784047567.830003:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.830012:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047567.830013:0:94386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94386:1870705709388416:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1784047567.830030:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.830042:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.830048:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047567.830048:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047567.830057:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.830061:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.830070:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047567.830070:0:94386:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1784047567.830099:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047567.830102:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709388288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784047567.830119:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e0209d4/0x4426598c0c775d8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047567.830126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047567.830140:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.830142:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.830143:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047567.830155:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388288 00000100:00100000:1.0:1784047567.830156:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388416 00000100:00100000:3.0:1784047567.830161:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388288 00000100:00100000:1.0:1784047567.830161:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388416 00000100:00100000:3.0:1784047567.830192:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:1.0:1784047567.830192:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009 00000100:00100000:3.0:1784047567.830201:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709388288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047567.830201:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:94386:x1870705709388416:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784047567.830246:0:26189:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00002000:00000024:3.0:1784047567.831387:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 896 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047567.831456:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709388288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1254us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047567.831465:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1784047567.831525:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709388288:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1784047567.831663:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.831670:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831686:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.831690:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.831696:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831708:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831726:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831733:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831748:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.831758:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.831775:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831782:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.831786:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831795:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831810:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831820:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df3f4676/0x4426598c0c775d94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831840:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.831847:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.831849:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.831891:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.831896:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.831904:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.831907:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.833010:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833029:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833039:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833048:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833065:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.833136:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.833142:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833152:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.833156:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.833161:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833177:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833187:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833196:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833209:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047567.833246:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.833251:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833260:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.833263:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.833268:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833278:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.833287:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833723:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047567.833730:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833739:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047567.833743:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833751:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833767:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833775:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9b050a/0x4426598c0c775d9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833810:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047567.833813:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833819:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88c00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047567.833823:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833830:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833840:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833847:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003848bc5e/0x4426598c0c775da2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.833857:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.833859:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.833861:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.833884:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.834411:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047567.834426:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:94386:x1870705709388416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4222us (4373us total) trans 4294968757 rc 0/0 00000100:00100000:1.0:1784047567.834437:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009 00010000:00010000:3.0:1784047567.834442:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784047567.834450:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.834455:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834462:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.834465:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834473:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834484:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834491:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf5ce6a/0x4426598c0c775da9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834506:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.834508:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.834510:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.834569:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.834580:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834591:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.834595:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.834601:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834628:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834636:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834643:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834659:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.834702:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.834707:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834714:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.834717:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.834721:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834729:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834742:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834749:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834762:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047567.834770:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047567.834774:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834780:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.834784:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834792:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834803:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834811:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f0761d/0x4426598c0c775db0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834825:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.834834:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834841:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6de00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.834844:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834852:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834864:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834872:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775db7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.834884:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.834886:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.834888:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.835760:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.838567:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.838587:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838616:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.838622:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.838628:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838661:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838673:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838681:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838714:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.838832:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.838838:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838847:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.838850:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.838854:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838862:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838867:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.838871:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838875:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838888:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838893:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ce00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.838897:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838904:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047567.838906:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838923:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838931:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775dbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838954:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784047567.838956:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.838958:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838961:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838966:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.838969:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.838969:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838972:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.838976:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838977:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.838987:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.838992:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.839001:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.839001:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775dc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.839009:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.839014:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.839016:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.839023:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784047567.839278:0:94386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94386:1870705709388416:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784047567.839295:0:94386:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x781:0x0]-[0x280000401:0x7a1:0x0] 00010000:00010000:1.0:1784047567.841735:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.841750:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.841765:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.841771:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.841783:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.841811:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.841820:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775dcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.841850:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.841853:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.841854:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.844237:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.844466:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.844481:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844497:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.844502:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.844509:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844524:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844534:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844542:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844572:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.844630:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.844635:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844642:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.844645:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.844649:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844657:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844670:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844677:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844689:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047567.844727:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.844732:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844740:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.844742:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.844746:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.844755:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845580:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845590:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845692:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784047567.845702:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047567.845708:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845717:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.845722:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845732:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845749:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.845757:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000851e6a43/0x4426598c0c775dd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845769:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784047567.845776:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845792:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047567.845796:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845804:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845817:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845824:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fec9583/0x4426598c0c775dda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845841:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047567.845845:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845851:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6cc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047567.845854:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845861:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845869:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845882:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f31d6b03/0x4426598c0c775de1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047567.845896:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.845897:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.845899:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.846897:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.846899:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.846901:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.847423:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.847431:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.847468:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.847476:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847490:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.847500:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.847507:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847518:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847527:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847535:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847564:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.847682:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.847688:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847695:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.847698:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.847703:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847711:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847719:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847731:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.847753:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047567.848057:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.848063:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848072:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6dc00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.848075:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848093:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848109:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848116:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62344fa/0x4426598c0c775de8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848131:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.848134:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848140:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d000 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.848144:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848163:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848173:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848180:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea1f41e/0x4426598c0c775def lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.848193:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.848194:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.848196:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.848233:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.848237:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848246:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.848249:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.848253:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848262:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848270:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848277:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848362:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.848405:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.848410:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848423:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.848426:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.848429:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848438:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848446:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848452:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848469:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047567.848476:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047567.848480:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848486:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.848489:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848496:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848517:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848524:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b938b16e/0x4426598c0c775df6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848538:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.848541:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848547:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.848550:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848558:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848567:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848574:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009547d888/0x4426598c0c775dfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848586:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.848587:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.848594:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.848656:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.848661:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848668:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.848671:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.848675:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848683:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848691:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848697:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848710:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.848744:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.848748:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848756:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.848758:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.848778:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848798:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848805:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848812:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848825:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784047567.848831:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047567.848834:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848841:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.848844:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848850:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848859:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848867:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775e04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848884:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047567.848887:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848892:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.848895:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.848902:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.849860:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.849919:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.850396:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850413:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb65a5e/0x4426598c0c775e0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850436:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.850438:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.850440:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784047567.850528:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.850535:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850546:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.850558:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.850564:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850576:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850585:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850593:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850632:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.850673:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.850678:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850686:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.850689:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.850693:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850702:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850709:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850723:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850739:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047567.850779:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.850784:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850792:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.850795:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.850799:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850806:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850814:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850820:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850831:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784047567.850866:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.850870:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850883:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.850886:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.850889:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850897:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.850905:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.850970:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784047567.850977:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.850985:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.850989:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.850998:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851013:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851027:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d7a16ff/0x4426598c0c775e12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851122:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.851126:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851133:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d200 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.851136:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851144:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851155:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851163:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5a19d3b/0x4426598c0c775e19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851176:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.851179:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851186:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6da00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.851195:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851203:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851214:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851222:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007884354b/0x4426598c0c775e20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.851234:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.851236:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.851238:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047567.851686:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.851756:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047567.851766:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.852354:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852380:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784047567.852453:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.852459:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852469:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.852472:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.852477:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852488:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852510:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852517:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852529:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784047567.852567:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.852572:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852580:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.852583:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.852586:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852595:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852625:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852634:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852658:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784047567.852698:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784047567.852703:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852710:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1784047567.852714:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047567.852718:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852727:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852734:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852741:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852757:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784047567.852766:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047567.852770:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852778:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c600 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.852787:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852796:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852810:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852818:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f23f59/0x4426598c0c775e27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852835:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047567.852838:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852844:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6de00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.852847:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852854:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852863:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852870:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775e2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852887:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047567.852890:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852896:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ca00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047567.852899:0:16469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.852905:0:16469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853161:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047567.853168:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853177:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ce00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.853180:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853187:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853200:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853216:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcee650c/0x4426598c0c775e3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.853235:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.853237:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784047567.853755:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.853762:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853772:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.853776:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.853779:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853788:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853797:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853805:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853819:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784047567.853862:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784047567.853867:0:26187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853875:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1784047567.853878:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047567.853881:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853890:0:26187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853897:0:26187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853904:0:26187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853927:0:26187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784047567.853935:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047567.853938:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853945:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.853949:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853968:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853980:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.853987:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653548c0/0x4426598c0c775e43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.854001:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047567.854002:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.854005:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.854011:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28e00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:1.0:1784047567.854013:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.854020:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.854108:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.854115:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000425528d0/0x4426598c0c775e4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047567.854135:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.854136:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047567.854138:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.854655:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.854664:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22a9316/0x4426598c0c775e35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047567.854682:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.854684:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047567.854685:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047567.855023:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047567.855031:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784047567.857364:0:26187:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1827 00000100:00100000:1.0:1784047567.857501:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:94388:x1870705709388160:12345-0@lo:5:osp-pre-1-0.0 Request processed in 72654us (73207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047567.857514:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5008 00000100:00100000:2.0:1784047567.862855:0:94388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94388:1870705709388160:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784047567.862876:0:94388:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x781:0x0] from OST, last_created [0x2c0000401:0x781:0x0]last_used is [0x2c0000401:0x723:0x0] 00000100:00100000:2.0:1784047567.862999:0:94388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94388:1870705709388672:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784047567.863072:0:94388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047567.863116:0:94388:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc9090900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047567.863149:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388672 00000100:00100000:2.0:1784047567.863156:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388672 00000100:00100000:2.0:1784047567.863204:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010 00000100:00100000:2.0:1784047567.863214:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:94388:x1870705709388672:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784047567.863262:0:26180:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1922 00000100:00100000:0.0:1784047567.863370:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709388544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047567.863402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047567.863738:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388544 00000100:00100000:1.0:1784047567.863743:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388544 00000100:00100000:1.0:1784047567.863777:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:1.0:1784047567.863785:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709388544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047567.863798:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047567.863843:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709388544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047567.863851:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:1.0:1784047567.863892:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709388544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047567.870712:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:94388:x1870705709388672:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7490us (7631us total) trans 4294968757 rc 0/0 00000100:00100000:2.0:1784047567.870726:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010 00000100:00100000:0.0:1784047567.871055:0:94388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94388:1870705709388672:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784047567.871072:0:94388:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x781:0x0]-[0x2c0000401:0x7a1:0x0] 00000020:00000004:3.0:1784047568.088010:0:94707:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047568.088241:0:94707:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784047568.152907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047568.519697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047568.519733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047568.519764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047568.519794:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493376 00000100:00100000:0.0:1784047568.519804:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493376 00000100:00100000:0.0:1784047568.519862:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493248 00000100:00100000:0.0:1784047568.519865:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493248 00000100:00100000:0.0:1784047568.519886:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1398 00000100:00100000:0.0:1784047568.519895:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689493376:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047568.519974:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:2402:x1870705689493376:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047568.519994:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1398 00000100:00100000:0.0:1784047568.520016:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1399 00000100:00100000:0.0:1784047568.520022:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689493248:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047568.520053:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689493248:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047568.520060:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1399 00000100:00080000:0.0:1784047568.520091:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047568.520135:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493120 00000100:00100000:1.0:1784047568.520140:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493120 00000100:00100000:1.0:1784047568.520172:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:1.0:1784047568.520179:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689493120:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047568.520207:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689493120:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047568.520213:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 76 00000020:00000004:1.0:1784047568.936545:0:94757:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784047568.936813:0:94757:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784047569.171019:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784047569.171047:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047569.171130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047569.171176:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709388800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047569.171199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047569.171331:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388928 00010000:00010000:3.0:1784047569.171337:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047569.171342:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388928 00000100:00100000:3.0:1784047569.171356:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709388800 00000100:00100000:3.0:1784047569.171362:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709388800 00000100:00100000:3.0:1784047569.171468:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:3.0:1784047569.171496:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709388800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047569.171520:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047569.171571:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709388800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047569.171578:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00080000:1.0:1784047569.171751:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047569.171756:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047569.177323:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1784047569.177351:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709388928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047569.177388:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047569.177468:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709388928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (6339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047569.177475:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:3.0:1784047569.178574:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047569.178595:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709388800:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047570.200106:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047570.963053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047570.963139:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493504 00000100:00100000:0.0:1784047570.963149:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493504 00000100:00080000:1.0:1784047570.963362:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047570.972138:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1450 00000100:00100000:2.0:1784047570.972173:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:72390:x1870705689493504:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1784047570.972200:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047570.972226:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c775e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae50e expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047570.972333:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c775e58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047570.972349:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c775e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047570.972365:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c775e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047570.972444:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784047570.972448:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047570.972489:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c775e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047570.972514:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0x4426598c0c775e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae50e expref: 8 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047570.972539:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c775e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae50e expref: 7 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047570.972547:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:2.0:1784047570.972550:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784047570.972554:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031c00, rc 0) 00000100:00100000:2.0:1784047570.972762:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:72390:x1870705689493504:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 606us (9718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047570.972771:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1450 00000100:00100000:0.0:1784047570.986137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047570.986238:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493632 00000100:00100000:2.0:1784047570.986249:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493632 00000100:00100000:2.0:1784047570.986335:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1451 00000100:00100000:2.0:1784047570.986346:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:72390:x1870705689493632:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047570.986385:0:66219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1784047570.986474:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:72390:x1870705689493632:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 129us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047570.986481:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1451 00000100:00100000:1.0:1784047570.990284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047570.990453:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493760 00000100:00100000:3.0:1784047570.990464:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493760 00000100:00100000:3.0:1784047570.990534:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1452 00000100:00100000:3.0:1784047570.990545:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:72390:x1870705689493760:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047570.990584:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047570.990677:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:72390:x1870705689493760:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 134us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047570.990686:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1452 00000100:00080000:1.0:1784047570.991398:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047570.995461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047570.995653:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689493888 00000100:00100000:1.0:1784047570.995666:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689493888 00000100:00100000:1.0:1784047570.995732:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5011 00000100:00100000:1.0:1784047570.995744:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2398:x1870705689493888:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:1.0:1784047570.995790:0:26196:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3669 last 0 00000020:00000080:1.0:1784047570.995830:0:26196:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c775e5f 00002000:00100000:1.0:1784047570.995846:0:26196:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccd8431000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784047570.995869:0:26196:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784047570.995961:0:26196:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784047570.996000:0:26196:0:(import.c:65:import_set_state_nolock()) ffff99ccd8434000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047570.996093:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689493888:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 349us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047570.996102:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5011 00000100:00100000:0.0:1784047571.005820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047571.005922:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494016 00000100:00100000:1.0:1784047571.005939:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494016 00000100:00080000:0.0:1784047571.006115:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047571.007599:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2164 00000100:00100000:1.0:1784047571.007645:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:72390:x1870705689494016:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:1.0:1784047571.007709:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047571.007820:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:72390:x1870705689494016:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 190us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047571.007830:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2164 00000100:00100000:0.0:1784047571.013438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047571.013602:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494144 00000100:00100000:1.0:1784047571.013647:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494144 00000100:00100000:1.0:1784047571.013713:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5012 00000100:00100000:1.0:1784047571.013725:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1870705689494144:12345-192.168.204.40@tcp:8:lfs.0 00010000:00080000:1.0:1784047571.013773:0:13594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp t0 exp 0000000000000000 cur 3669 last 0 00000020:00000080:1.0:1784047571.013817:0:13594:0:(genops.c:1406:class_connect()) connect: client 0c846d7a-6357-4e9c-a620-e35737ede709, cookie 0x4426598c0c775e66 00002000:00100000:1.0:1784047571.013833:0:13594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccd8435000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784047571.013858:0:13594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784047571.013951:0:13594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784047571.013994:0:13594:0:(import.c:65:import_set_state_nolock()) ffff99ccd8433000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784047571.014517:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689494144:12345-192.168.204.40@tcp:8:lfs.0 Request processed in 789us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047571.014530:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5012 00000100:00100000:3.0:1784047571.016851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047571.017040:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494272 00000100:00100000:0.0:1784047571.017054:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494272 00000100:00100000:0.0:1784047571.017220:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2165 00000100:00100000:0.0:1784047571.017234:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:72390:x1870705689494272:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047571.017269:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047571.017368:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+6:72390:x1870705689494272:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 136us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047571.017376:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2165 00000100:00080000:1.0:1784047571.017875:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784047571.218918:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047572.245861:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047572.755924:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709389056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047572.756042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.756122:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389056 00000100:00100000:0.0:1784047572.756132:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389056 00000100:00100000:0.0:1784047572.756227:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1784047572.756237:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709389056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047572.756285:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:0.0:1784047572.756343:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709389056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.756351:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1784047572.756414:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709389056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047572.760595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709389184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047572.760904:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709389312:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.760987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.761044:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709389824:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.761095:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390336:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.761151:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784047572.761157:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709389440:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.761211:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709389952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.761256:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390464:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047572.761312:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389312 00000100:00100000:0.0:1784047572.761319:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389312 00000100:00100000:0.0:1784047572.761382:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784047572.761392:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709389312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761455:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709389312:12345-0@lo:400:kworker.0 Request processed in 63us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.761479:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784047572.761518:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389824 00000100:00100000:0.0:1784047572.761521:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389824 00000100:00100000:0.0:1784047572.761560:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389440 00000100:00100000:0.0:1784047572.761563:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389440 00000100:00100000:0.0:1784047572.761586:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1784047572.761593:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709389824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761654:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709389824:12345-0@lo:400:kworker.0 Request processed in 62us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.761660:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1784047572.761812:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1784047572.761821:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709389440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761851:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709389440:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.761857:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1784047572.761878:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390336 00000100:00100000:0.0:1784047572.761882:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390336 00000100:00100000:0.0:1784047572.761919:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1784047572.761926:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709390336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.761961:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709390336:12345-0@lo:400:kworker.0 Request processed in 35us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.761966:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1784047572.762000:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389952 00000100:00100000:0.0:1784047572.762004:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389952 00000100:00100000:0.0:1784047572.762039:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390464 00000100:00100000:0.0:1784047572.762041:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390464 00000100:00100000:0.0:1784047572.762058:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:0.0:1784047572.762072:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709389952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762104:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709389952:12345-0@lo:400:kworker.0 Request processed in 33us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.762110:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:0.0:1784047572.762121:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1784047572.762126:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709390464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762151:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709390464:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047572.762157:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1784047572.762273:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709389440:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762289:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709389952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762300:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390464:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762310:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709389312:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762319:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709389824:0@lo:400:kworker.0 00000100:00100000:0.0:1784047572.762328:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfa3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390336:0@lo:400:kworker.0 00000100:00080000:0.0:1784047572.762376:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047572.762382:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047572.762385:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047572.764719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.764972:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709389696:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.765139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.765167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709390208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.765191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.771599:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709390720:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.771846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.771887:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784047572.771896:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709389568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.771923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.771946:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709390080:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.771977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.772012:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709390592:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047572.772098:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389696 00000100:00100000:3.0:1784047572.772107:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389696 00000100:00100000:3.0:1784047572.772178:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390208 00000100:00100000:3.0:1784047572.772182:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390208 00000100:00100000:3.0:1784047572.772197:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390720 00000100:00100000:3.0:1784047572.772199:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390720 00000100:00100000:3.0:1784047572.772209:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389568 00000100:00100000:3.0:1784047572.772212:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389568 00000100:00100000:3.0:1784047572.772230:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1784047572.772241:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709389696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772307:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709389696:12345-0@lo:400:kworker.0 Request processed in 67us (7167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772315:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1784047572.772340:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1784047572.772346:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709390208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772380:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709390208:12345-0@lo:400:kworker.0 Request processed in 35us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772387:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1784047572.772413:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1784047572.772420:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709390720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772451:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709390720:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772458:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1784047572.772471:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1784047572.772477:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709389568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772504:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709389568:12345-0@lo:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772510:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1784047572.772534:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709389184 00000100:00100000:3.0:1784047572.772538:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709389184 00000100:00100000:3.0:1784047572.772571:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:3.0:1784047572.772578:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709389184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047572.772640:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047572.772680:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709389184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (7971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772687:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:3.0:1784047572.772737:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390080 00000100:00100000:3.0:1784047572.772743:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390080 00000100:00100000:3.0:1784047572.772773:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390592 00000100:00100000:3.0:1784047572.772776:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390592 00000100:00100000:3.0:1784047572.772798:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:3.0:1784047572.772805:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709390080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772837:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709390080:12345-0@lo:400:kworker.0 Request processed in 33us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772843:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:3.0:1784047572.772864:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:3.0:1784047572.772870:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709390592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.772903:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709390592:12345-0@lo:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047572.772910:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00080000:3.0:1784047572.772932:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047572.772939:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047572.772941:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047572.773002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709389568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.773017:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709390080:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.773028:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709390592:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.773041:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709389696:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.773052:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709390208:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.773063:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709390720:0@lo:400:kworker.0 00000100:00100000:3.0:1784047572.773080:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709389184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047573.270790:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784047573.270802:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047573.270886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047573.270933:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390976 00000100:00100000:3.0:1784047573.270940:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047573.270943:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390976 00000100:00100000:3.0:1784047573.270966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047573.271008:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709390848 00000100:00100000:0.0:1784047573.271012:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709390848 00000100:00100000:3.0:1784047573.271027:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1784047573.271039:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709390976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047573.271084:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047573.271141:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709390976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047573.271158:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1784047573.271315:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:0.0:1784047573.271324:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709390848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047573.271347:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047573.271381:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709390848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047573.271388:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1784047573.272656:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047573.272678:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709390848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047573.642633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047573.642682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047573.642737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047573.642759:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047573.642786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047573.642959:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494528 00000100:00100000:0.0:1784047573.642982:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494528 00000100:00100000:0.0:1784047573.643061:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494656 00000100:00100000:0.0:1784047573.643064:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494656 00000100:00100000:0.0:1784047573.643090:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1406 00000100:00100000:0.0:1784047573.643102:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689494528:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047573.643198:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689494528:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 98us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047573.643207:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1406 00000100:00100000:0.0:1784047573.643233:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1407 00000100:00100000:0.0:1784047573.643239:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:2399:x1870705689494656:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047573.643261:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:2399:x1870705689494656:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047573.643267:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1407 00000100:00100000:0.0:1784047573.643291:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494784 00000100:00100000:0.0:1784047573.643294:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494784 00000100:00100000:0.0:1784047573.643319:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494912 00000100:00100000:0.0:1784047573.643333:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494912 00000100:00100000:0.0:1784047573.643354:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2654 00000100:00100000:0.0:1784047573.643360:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+6:2399:x1870705689494784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047573.643391:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+6:2399:x1870705689494784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047573.643397:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2654 00000100:00100000:0.0:1784047573.643408:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2655 00000100:00100000:0.0:1784047573.643413:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+6:2399:x1870705689494912:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047573.643431:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+6:2399:x1870705689494912:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 19us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047573.643437:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2655 00000100:00080000:0.0:1784047573.643451:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047573.643455:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047573.643458:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047573.643460:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047573.643657:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689494400 00000100:00100000:0.0:1784047573.643661:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689494400 00000100:00100000:0.0:1784047573.643688:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:0.0:1784047573.643693:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689494400:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047573.643724:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689494400:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047573.643731:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000020:00080000:3.0:1784047573.781525:0:75662:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444093 batchid updated 00000020:00080000:0.0:1784047573.781922:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000004:00080000:0.0:1784047573.782119:0:75682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99ccd4ecac00 with version 15 00000020:00080000:0.0:1784047573.782139:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444092 cancel update log [0x2000090a1:0x2:0x0].4: rc = 0 00000020:00080000:0.0:1784047573.782259:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444092 cancel update log [0x2400088d0:0x2:0x0].4: rc = 0 00000004:00080000:0.0:1784047573.782305:0:75682:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99ccd843cd80 with version 16 00000020:00080000:0.0:1784047573.782308:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444093 cancel update log [0x2000090a1:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1784047573.782330:0:75682:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444093 cancel update log [0x2400088d0:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1784047573.782339:0:75682:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000004:00080000:3.0:1784047573.782433:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 15 rpc_version 15 00000020:00100000:3.0:1784047573.782478:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784047573.782491:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99cbc9be5f80 x1870705709391232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047573.782523:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be5f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709391232:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784047573.782728:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047573.782772:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047573.783397:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709391232 00000100:00100000:0.0:1784047573.783409:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709391232 00000100:00100000:0.0:1784047573.783480:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1784047573.783492:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75668:x1870705709391232:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784047573.783763:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75668:x1870705709391232:12345-0@lo:1000:osp_up0-1.0 Request processed in 272us (1033us total) trans 124554051585 rc 0/0 00000100:00100000:0.0:1784047573.783772:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1784047573.783841:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be5f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709391232:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1784047573.783855:0:75668:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff99cbc8b233c0 version 16 rpc_version 16 00000020:00100000:0.0:1784047573.783875:0:75668:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784047573.783882:0:75668:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99cd0062f100 x1870705709391488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047573.783904:0:75668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709391488:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784047573.783941:0:75668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047573.783961:0:75668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00ed3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047573.783990:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709391488 00000100:00100000:0.0:1784047573.783993:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709391488 00000100:00100000:0.0:1784047573.784991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:0.0:1784047573.785007:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75668:x1870705709391488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784047573.785214:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75668:x1870705709391488:12345-0@lo:1000:osp_up0-1.0 Request processed in 211us (1270us total) trans 124554051586 rc 0/0 00000100:00100000:0.0:1784047573.785241:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1784047573.785324:0:75668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75668:1870705709391488:0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1784047573.790481:0:94368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051585 is committed 00000001:00100000:3.0:1784047573.790945:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00080000:3.0:1784047573.790959:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968757 is committed 00000001:00100000:2.0:1784047573.797447:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c846d7a-6357-4e9c-a620-e35737ede709 00000001:00080000:2.0:1784047573.797470:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968757 is committed 00000100:00100000:2.0:1784047574.291421:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784047574.291446:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709391616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047574.291517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047574.291576:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709391616 00000100:00100000:2.0:1784047574.291584:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709391616 00000100:00100000:2.0:1784047574.291656:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:2.0:1784047574.291666:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709391616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047574.291687:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047574.291730:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709391616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047574.291737:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:2.0:1784047574.291996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709391616:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784047574.292093:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047574.292648:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047574.292659:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709391744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047574.292697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047574.292946:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709391744 00000100:00100000:1.0:1784047574.292952:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709391744 00000100:00100000:1.0:1784047574.293051:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1784047574.293058:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709391744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047574.293081:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00010000:2.0:1784047574.293085:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047574.293133:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709391744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047574.293140:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00080000:3.0:1784047574.293246:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047574.293415:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709391744:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784047575.314936:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047576.342071:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784047576.783921:0:94950:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1784047577.371073:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047577.876665:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709391872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047577.876736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047577.876797:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709391872 00000100:00100000:3.0:1784047577.876804:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709391872 00000100:00100000:3.0:1784047577.876856:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1784047577.876865:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709391872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047577.876920:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047577.876969:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709391872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047577.876976:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1784047577.877024:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709391872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047577.877395:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709392000:0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.877641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047577.877762:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709392128:0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.877789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047577.877823:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392128 00000100:00100000:3.0:1784047577.877827:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392128 00000100:00100000:3.0:1784047577.877868:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1784047577.877875:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709392128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.877926:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709392128:12345-0@lo:400:kworker.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047577.877934:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00080000:3.0:1784047577.877953:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047577.877985:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709392128:0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.878018:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709392256:0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.878042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047577.878071:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392256 00000100:00100000:3.0:1784047577.878075:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392256 00000100:00100000:3.0:1784047577.878104:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1784047577.878110:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.878144:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709392256:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047577.878391:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392000 00000100:00100000:0.0:1784047577.878395:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392000 00000100:00100000:0.0:1784047577.878425:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784047577.878432:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709392000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047577.878471:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709392000:12345-0@lo:400:kworker.0 Request processed in 40us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047577.878478:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1784047577.879365:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047577.879379:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709392384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047577.879418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.879458:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392384 00000100:00100000:1.0:1784047577.879462:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392384 00000100:00100000:1.0:1784047577.879494:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:1.0:1784047577.879501:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1870705709392384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047577.879529:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1784047577.879570:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1870705709392384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.879577:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:1.0:1784047577.879634:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051585 gen 3 00000004:00080000:1.0:1784047577.879640:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051585 committed transno 124554051585 00000100:00100000:1.0:1784047577.879665:0:3648:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff99cd0062f100 x1870705709391488/t124554051586(124554051586) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1784047589 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047577.879679:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709392384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047577.879726:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047577.879732:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709392768:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.879764:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.879789:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392768 00000100:00100000:1.0:1784047577.879792:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392768 00000100:00100000:1.0:1784047577.879836:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1784047577.879842:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709392768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.879875:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709392768:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.879881:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00080000:1.0:1784047577.879910:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047577.879927:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709392768:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.879957:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709392896:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.879980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880006:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392896 00000100:00100000:1.0:1784047577.880010:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392896 00000100:00100000:1.0:1784047577.880038:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1784047577.880044:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709392896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880077:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709392896:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.880083:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00080000:1.0:1784047577.880100:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047577.880116:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709392896:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880157:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047577.880163:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709393280:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880225:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393280 00000100:00100000:1.0:1784047577.880228:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393280 00000100:00100000:1.0:1784047577.880257:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:1.0:1784047577.880262:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709393280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880294:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709393280:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.880309:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00080000:1.0:1784047577.880326:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047577.880339:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968757 gen 2 00000100:00100000:1.0:1784047577.880351:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709393280:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880379:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709393408:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880430:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393408 00000100:00100000:1.0:1784047577.880434:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393408 00000100:00100000:1.0:1784047577.880458:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1784047577.880464:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709393408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880499:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870705709393408:12345-0@lo:400:kworker.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.880505:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1784047577.880529:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870705709393408:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880566:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709392640:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880626:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709393152:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880663:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784047577.880668:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709392512:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880699:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709393024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047577.880739:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393152 00000100:00100000:1.0:1784047577.880749:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393152 00000100:00100000:1.0:1784047577.880780:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:1.0:1784047577.880786:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709393152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880819:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709393152:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.880825:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:1.0:1784047577.880843:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392640 00000100:00100000:1.0:1784047577.880846:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392640 00000100:00100000:1.0:1784047577.880862:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709392512 00000100:00100000:1.0:1784047577.880865:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709392512 00000100:00100000:1.0:1784047577.880877:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393024 00000100:00100000:1.0:1784047577.880880:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393024 00000100:00100000:1.0:1784047577.880901:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1784047577.880909:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709392640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880939:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709392640:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.880945:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1784047577.880956:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1784047577.880962:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709392512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.880987:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709392512:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.880993:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1784047577.881004:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1784047577.881009:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709393024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.881033:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709393024:12345-0@lo:400:kworker.0 Request processed in 24us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047577.881039:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1784047577.881078:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709392000:0@lo:400:kworker.0 00000100:00080000:1.0:1784047577.881094:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047577.881098:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047577.881100:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047577.881119:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709392256:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.881141:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709392512:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.881149:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709393024:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.881157:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709392640:0@lo:400:kworker.0 00000100:00100000:1.0:1784047577.881164:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968757 gen 2 00000100:00100000:1.0:1784047577.881172:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709393152:0@lo:400:kworker.0 00000100:00100000:3.0:1784047577.881538:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1784047578.386766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709393536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047578.386837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047578.386917:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393536 00000100:00100000:3.0:1784047578.386924:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393536 00000100:00100000:3.0:1784047578.386973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1784047578.386981:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709393536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784047578.387012:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047578.387057:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709393536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047578.387065:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1784047578.387113:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709393536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047578.387365:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709393664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047578.387394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047578.387468:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393664 00000100:00100000:1.0:1784047578.387473:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393664 00000100:00100000:1.0:1784047578.387511:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:1.0:1784047578.387519:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709393664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047578.387535:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047578.387572:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709393664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047578.387578:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:3.0:1784047578.388165:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709393664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784047578.388226:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784047578.452460:0:94999:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1784047578.763391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047578.763444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047578.763482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047578.763517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047578.763564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047578.763599:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495552 00000100:00100000:0.0:1784047578.763635:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495552 00000100:00100000:0.0:1784047578.763693:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495424 00000100:00100000:0.0:1784047578.763696:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495424 00000100:00100000:0.0:1784047578.763720:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2660 00000100:00100000:0.0:1784047578.763730:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689495552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047578.763802:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:2401:x1870705689495552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047578.763810:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2660 00000100:00100000:0.0:1784047578.763828:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2661 00000100:00100000:0.0:1784047578.763840:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689495424:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047578.763866:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+5:2402:x1870705689495424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047578.763894:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2661 00000100:00100000:2.0:1784047578.764011:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495040 00000100:00100000:2.0:1784047578.764017:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495040 00000100:00100000:2.0:1784047578.764060:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:2.0:1784047578.764067:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689495040:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047578.764082:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495168 00000100:00100000:3.0:1784047578.764088:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495168 00000100:00100000:2.0:1784047578.764106:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689495040:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 39us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047578.764113:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:3.0:1784047578.764126:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495296 00000100:00100000:3.0:1784047578.764130:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495296 00000100:00100000:3.0:1784047578.764151:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1414 00000100:00100000:3.0:1784047578.764160:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689495168:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047578.764203:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689495168:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 44us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047578.764207:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1415 00000100:00100000:2.0:1784047578.764218:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689495296:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047578.764232:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1414 00000100:00100000:2.0:1784047578.764250:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689495296:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 33us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047578.764258:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1415 00000100:00080000:1.0:1784047578.764365:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047578.764369:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047578.764371:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047578.764373:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784047579.411483:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047579.411706:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709393792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047579.411731:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709393920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047579.411783:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047579.411836:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393920 00000100:00100000:3.0:1784047579.411845:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393920 00000100:00080000:1.0:1784047579.411920:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047579.411938:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:3.0:1784047579.411953:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709393920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784047579.411980:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784047579.412037:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709393920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047579.412045:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1784047579.412194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047579.412246:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709393792 00000100:00100000:2.0:1784047579.412332:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709393920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047579.412444:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709393792 00000100:00100000:1.0:1784047579.412500:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:1.0:1784047579.412508:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709393792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047579.412520:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047579.412558:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709393792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047579.412565:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00080000:2.0:1784047579.412738:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047579.412901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709393792:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1784047579.926488:0:94368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051586 is committed 00000100:00100000:0.0:1784047580.194492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.194730:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495680 00000100:00100000:3.0:1784047580.194740:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495680 00000100:00100000:3.0:1784047580.194912:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1453 00000100:00100000:3.0:1784047580.194923:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:72860:x1870705689495680:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:3.0:1784047580.194966:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:3.0:1784047580.195050:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:72860:x1870705689495680:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 128us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.195058:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1453 00000100:00080000:2.0:1784047580.195263:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047580.199305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047580.199464:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495808 00000100:00100000:2.0:1784047580.199473:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495808 00000100:00100000:2.0:1784047580.199651:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1454 00000100:00100000:2.0:1784047580.199662:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:72860:x1870705689495808:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:2.0:1784047580.199699:0:66221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1784047580.199769:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+9:72860:x1870705689495808:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 108us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047580.199777:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1454 00000100:00080000:1.0:1784047580.201191:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047580.203938:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047580.204078:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689495936 00000100:00100000:2.0:1784047580.204189:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689495936 00000100:00100000:2.0:1784047580.204332:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2174 00000100:00100000:2.0:1784047580.204345:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+5:72860:x1870705689495936:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047580.204378:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047580.204697:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+5:72860:x1870705689495936:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 354us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047580.204707:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2174 00000100:00080000:1.0:1784047580.204822:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047580.210170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047580.210433:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496064 00000100:00100000:1.0:1784047580.210444:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496064 00000100:00100000:1.0:1784047580.210538:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2175 00000100:00100000:1.0:1784047580.210549:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+5:72860:x1870705689496064:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:1.0:1784047580.210598:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047580.210697:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+5:72860:x1870705689496064:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 149us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047580.210705:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2175 00000100:00080000:2.0:1784047580.210926:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047580.240915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047580.241022:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496192 00000100:00100000:1.0:1784047580.241030:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496192 00000100:00100000:1.0:1784047580.241207:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1455 00000100:00100000:1.0:1784047580.241219:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+7:71755:x1870705689496192:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1784047580.241240:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047580.241332:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c775e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae515 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.241409:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.241424:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.241452:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.241468:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.241474:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.241480:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.242347:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29e00/0x4426598c0c775e82 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.242361:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29e00/0x4426598c0c775e82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.242521:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29e00/0x4426598c0c775e82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047580.242572:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784047580.242576:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047580.246125:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29e00/0x4426598c0c775e82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246154:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246163:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246187:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246194:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246201:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047580.246206:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246213:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246231:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:1.0:1784047580.246234:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047580.246238:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246245:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c775e74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246453:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246459:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246465:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246469:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047580.246479:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246485:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246493:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff99ccfebe4a00) 00010000:00010000:1.0:1784047580.246495:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047580.246498:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246503:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c775e7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246550:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c775e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae515 expref: 9 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246565:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29e00/0x4426598c0c775e82 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae515 expref: 8 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.246572:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:1.0:1784047580.246575:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784047580.246577:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29e00, rc 0) 00000100:00100000:1.0:1784047580.246829:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+8:71755:x1870705689496192:12345-192.168.204.40@tcp:101:bash.0 Request processed in 5610us (5922us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047580.246840:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1455 00000100:00100000:0.0:1784047580.257996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047580.258423:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496320 00000100:00100000:1.0:1784047580.258433:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496320 00000100:00100000:1.0:1784047580.258500:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1456 00000100:00100000:1.0:1784047580.258512:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+8:71755:x1870705689496320:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1784047580.258545:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047580.258567:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c775e89 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae51c expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.259054:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.259397:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.259410:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.259430:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.259438:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.259445:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047580.259701:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66219:1870705709394048:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784047580.259919:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047580.261516:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cccc3f73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047580.261913:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394048 00000100:00100000:3.0:1784047580.261924:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394048 00000100:00100000:3.0:1784047580.262217:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:3.0:1784047580.262230:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66219:x1870705709394048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047580.262346:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66219:x1870705709394048:12345-0@lo:1000:mdt00_000.0 Request processed in 119us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.262355:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1784047580.262734:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66219:1870705709394048:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784047580.262802:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5200/0x4426598c0c775e9e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262818:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5200/0x4426598c0c775e9e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262829:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5200/0x4426598c0c775e9e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047580.262870:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5200/0x4426598c0c775e9e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262886:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262892:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262899:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262905:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262911:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047580.262915:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262922:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262953:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:0.0:1784047580.262956:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047580.262960:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262967:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775e90 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262980:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262987:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262993:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.262998:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047580.263001:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.263007:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.263014:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff99cbc9aa9700) 00010000:00010000:0.0:1784047580.263017:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047580.263020:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.263026:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4000/0x4426598c0c775e97 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.263461:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c775e89 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae51c expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.263479:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5200/0x4426598c0c775e9e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae51c expref: 9 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.263486:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99cbc9aa9000) 00010000:00010000:0.0:1784047580.263489:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047580.263491:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5200, rc 0) 00000100:00100000:0.0:1784047580.263599:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:71755:x1870705689496320:12345-192.168.204.40@tcp:101:bash.0 Request processed in 5088us (5614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047580.263657:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1456 00000100:00100000:0.0:1784047580.268497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.269347:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496448 00000100:00100000:3.0:1784047580.269359:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496448 00000100:00100000:3.0:1784047580.269472:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1457 00000100:00100000:3.0:1784047580.269485:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+9:71755:x1870705689496448:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1784047580.269509:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047580.269549:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6ca00/0x4426598c0c775ea5 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae523 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.269664:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6de00/0x4426598c0c775eac lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.269679:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6de00/0x4426598c0c775eac lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.269692:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6de00/0x4426598c0c775eac lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047580.269747:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1784047580.269751:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784047580.269810:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6ca00/0x4426598c0c775ea5 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae523 expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.269832:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6de00/0x4426598c0c775eac lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae523 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.269842:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99ccc37b6800) 00010000:00010000:3.0:1784047580.269856:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784047580.269861:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6de00, rc 0) 00000100:00100000:3.0:1784047580.269940:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:71755:x1870705689496448:12345-192.168.204.40@tcp:101:bash.0 Request processed in 458us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.269966:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1457 00000100:00100000:0.0:1784047580.280042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.280187:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496576 00000100:00100000:3.0:1784047580.280199:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496576 00000100:00100000:3.0:1784047580.280269:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 743 00000100:00100000:3.0:1784047580.280280:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689496576:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047580.280299:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047580.280326:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6de00/0x4426598c0c775eac lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae523 expref: 10 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.280346:0:26195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99ccc37b6800) 00010000:00010000:3.0:1784047580.280350:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047580.280418:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0c846d7a-6357-4e9c-a620-e35737ede709+9:2399:x1870705689496576:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 139us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.280426:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 743 00000100:00100000:2.0:1784047580.285603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047580.285740:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496704 00000100:00100000:1.0:1784047580.285752:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496704 00000100:00100000:1.0:1784047580.285823:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1458 00000100:00100000:1.0:1784047580.285837:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+9:71755:x1870705689496704:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1784047580.285869:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047580.285899:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28a00/0x4426598c0c775eb3 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae52a expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.285968:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.285984:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.285994:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286008:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286016:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286022:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286133:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28e00/0x4426598c0c775ec8 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286143:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28e00/0x4426598c0c775ec8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286150:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28e00/0x4426598c0c775ec8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047580.286194:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784047580.286199:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784047580.286223:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28e00/0x4426598c0c775ec8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286236:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28e00/0x4426598c0c775ec8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286245:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286252:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286258:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286264:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286269:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047580.286273:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286286:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286297:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff99ccc37b6800) 00010000:00010000:1.0:1784047580.286300:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047580.286305:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286312:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28000/0x4426598c0c775eba lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286326:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286331:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286336:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286340:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047580.286342:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286347:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286352:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff99ccfebe4a00) 00010000:00010000:1.0:1784047580.286354:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047580.286356:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286370:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff29c00/0x4426598c0c775ec1 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286404:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28a00/0x4426598c0c775eb3 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae52a expref: 11 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286418:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99cceff28e00/0x4426598c0c775ec8 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae52a expref: 10 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047580.286426:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff99cbc6765500) 00010000:00010000:1.0:1784047580.286428:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047580.286431:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28e00, rc 0) 00000100:00100000:1.0:1784047580.286493:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+10:71755:x1870705689496704:12345-192.168.204.40@tcp:101:bash.0 Request processed in 660us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047580.286500:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1458 00000100:00100000:1.0:1784047580.295198:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.295449:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496832 00000100:00100000:3.0:1784047580.295459:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496832 00000100:00100000:3.0:1784047580.295532:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5013 00000100:00100000:3.0:1784047580.295544:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689496832:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1784047580.295566:0:8824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047580.295588:0:8824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775ecf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae531 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047580.295659:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x222:0x0] initial LVB size: 0, mtime: 0x6a5667a9, atime: 0x6a5667a9, ctime: 0x6a5667a9, blocks: 0x0 00010000:00010000:3.0:1784047580.295683:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=3678s v=(0 0) 00010000:00010000:3.0:1784047580.295688:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047580.295716:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775ecf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae531 expref: 6 pid: 8824 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.295738:0:8824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033c89a64/0x4426598c0c775ecf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae531 expref: 6 pid: 8824 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.295752:0:8824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6de00, rc 0) 00000100:00100000:3.0:1784047580.295821:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+6:2400:x1870705689496832:12345-192.168.204.40@tcp:101:bash.0 Request processed in 279us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.295828:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5013 00000100:00100000:0.0:1784047580.302855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.303035:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689496960 00000100:00100000:3.0:1784047580.303045:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689496960 00000100:00100000:3.0:1784047580.303120:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1459 00000100:00100000:3.0:1784047580.303130:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+9:71755:x1870705689496960:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1784047580.303150:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047580.303173:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6ca00/0x4426598c0c775ed6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae538 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.303236:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.303249:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.303391:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.303408:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.303431:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.303438:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047580.303565:0:66219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66219:1870705709394176:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784047580.303657:0:66219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047580.304087:0:66219:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccff3e8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047580.307912:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394176 00000100:00100000:1.0:1784047580.307929:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394176 00000100:00100000:1.0:1784047580.308091:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1784047580.308103:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66219:x1870705709394176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784047580.308263:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66219:x1870705709394176:12345-0@lo:1000:mdt00_000.0 Request processed in 162us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047580.308271:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1784047580.308360:0:66219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66219:1870705709394176:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784047580.308444:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775eeb lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308462:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775eeb lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308475:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775eeb lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047580.308499:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775eeb lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308532:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308539:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308545:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308552:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308558:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047580.308561:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308569:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308582:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff99ccfebe4f00) 00010000:00010000:0.0:1784047580.308585:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047580.308589:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308595:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c600/0x4426598c0c775edd lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308631:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308638:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308651:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308655:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047580.308658:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308664:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308673:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff99ccec9b6100) 00010000:00010000:0.0:1784047580.308675:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047580.308678:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308684:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c800/0x4426598c0c775ee4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308727:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6ca00/0x4426598c0c775ed6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae538 expref: 11 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308742:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4e00/0x4426598c0c775eeb lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae538 expref: 10 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.308750:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cbc9aa9700) 00010000:00010000:0.0:1784047580.308752:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047580.308754:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4e00, rc 0) 00000100:00100000:0.0:1784047580.308823:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+10:71755:x1870705689496960:12345-192.168.204.40@tcp:101:bash.0 Request processed in 5694us (5986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047580.308840:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1459 00000100:00100000:2.0:1784047580.313517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.313602:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497088 00000100:00100000:3.0:1784047580.313639:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497088 00000100:00100000:3.0:1784047580.313705:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1460 00000100:00100000:3.0:1784047580.313716:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:71755:x1870705689497088:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1784047580.313736:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047580.313758:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6d600/0x4426598c0c775ef2 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae53f expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.313820:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6c400/0x4426598c0c775ef9 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.313834:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6c400/0x4426598c0c775ef9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.313858:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6c400/0x4426598c0c775ef9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047580.313904:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784047580.313908:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784047580.313945:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6d600/0x4426598c0c775ef2 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae53f expref: 12 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.313986:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6c400/0x4426598c0c775ef9 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae53f expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.313996:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cbc6765e00) 00010000:00010000:3.0:1784047580.313999:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784047580.314003:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6c400, rc 0) 00000100:00100000:3.0:1784047580.314128:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:71755:x1870705689497088:12345-192.168.204.40@tcp:101:bash.0 Request processed in 413us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.314135:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1460 00000100:00100000:3.0:1784047580.319879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047580.320042:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497216 00000100:00100000:0.0:1784047580.320067:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497216 00000100:00100000:0.0:1784047580.320205:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 744 00000100:00100000:0.0:1784047580.320217:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689497216:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047580.320235:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047580.320278:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccebd6c400/0x4426598c0c775ef9 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae53f expref: 11 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047580.320298:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cbc6765e00) 00010000:00010000:0.0:1784047580.320303:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047580.320367:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c846d7a-6357-4e9c-a620-e35737ede709+10:2400:x1870705689497216:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 151us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047580.320383:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 744 00000100:00100000:0.0:1784047580.326494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047580.327251:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497344 00000100:00100000:2.0:1784047580.327263:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497344 00000100:00100000:2.0:1784047580.327378:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1461 00000100:00100000:2.0:1784047580.327391:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+10:71755:x1870705689497344:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1784047580.327412:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047580.327432:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031a00/0x4426598c0c775f00 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae546 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327501:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327528:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327540:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327555:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327577:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327585:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327715:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030200/0x4426598c0c775f15 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327724:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030200/0x4426598c0c775f15 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327731:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030200/0x4426598c0c775f15 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047580.327771:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1784047580.327776:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047580.327801:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030200/0x4426598c0c775f15 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327812:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030200/0x4426598c0c775f15 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327821:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327827:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327834:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327866:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327873:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047580.327877:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327886:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327910:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff99cbc6765e00) 00010000:00010000:2.0:1784047580.327914:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047580.327918:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327924:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031200/0x4426598c0c775f07 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327940:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327946:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327951:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327955:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047580.327958:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327974:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327982:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff99ccc34a7100) 00010000:00010000:2.0:1784047580.327984:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047580.327986:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.327991:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030600/0x4426598c0c775f0e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.328021:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0031a00/0x4426598c0c775f00 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae546 expref: 12 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.328036:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99ccc0030200/0x4426598c0c775f15 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae546 expref: 11 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047580.328044:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff99ccc2b81200) 00010000:00010000:2.0:1784047580.328046:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047580.328048:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030200, rc 0) 00000100:00100000:2.0:1784047580.328133:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:71755:x1870705689497344:12345-192.168.204.40@tcp:101:bash.0 Request processed in 744us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047580.328141:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1461 00000100:00100000:0.0:1784047580.331311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047580.331409:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497472 00000100:00100000:3.0:1784047580.331418:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497472 00000100:00100000:3.0:1784047580.331475:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5014 00000100:00100000:3.0:1784047580.331485:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689497472:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1784047580.331507:0:26184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047580.331536:0:26184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775f1c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae54d expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047580.331562:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x223:0x0] initial LVB size: 0, mtime: 0x6a5667a9, atime: 0x6a5667a9, ctime: 0x6a5667a9, blocks: 0x0 00010000:00010000:3.0:1784047580.331581:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=3678s v=(0 0) 00010000:00010000:3.0:1784047580.331585:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047580.331594:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae54d expref: 7 pid: 26184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.331629:0:26184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f8d1c25/0x4426598c0c775f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae54d expref: 7 pid: 26184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047580.331655:0:26184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6d600, rc 0) 00000100:00100000:3.0:1784047580.331722:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689497472:12345-192.168.204.40@tcp:101:bash.0 Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047580.331730:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5014 00010000:00010000:3.0:1784047580.436637:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047581.463374:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047582.483162:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047582.994896:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709394304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047582.994978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047582.995115:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394304 00000100:00100000:3.0:1784047582.995129:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394304 00000100:00100000:3.0:1784047582.995212:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:3.0:1784047582.995224:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709394304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047582.995280:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1784047582.995473:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709394432:0@lo:400:kworker.0 00000100:00100000:0.0:1784047582.995544:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709394816:0@lo:400:kworker.0 00000100:00100000:3.0:1784047582.995956:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709394304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 730us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047582.995967:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:3.0:1784047583.001652:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709394688:0@lo:400:kworker.0 00000100:00100000:2.0:1784047583.001725:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709394560:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.001755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047583.001817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047583.001824:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709395200:0@lo:400:kworker.0 00000100:00100000:2.0:1784047583.001875:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709395072:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.001882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047583.001917:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709395712:0@lo:400:kworker.0 00000100:00100000:2.0:1784047583.001963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047583.001973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047583.002021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709395584:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.002185:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394688 00000100:00100000:3.0:1784047583.002197:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394688 00000100:00100000:3.0:1784047583.002285:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394560 00000100:00100000:3.0:1784047583.002289:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394560 00000100:00100000:3.0:1784047583.002318:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1784047583.002333:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709394688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.002381:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395200 00000100:00100000:0.0:1784047583.002391:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395200 00000100:00100000:0.0:1784047583.002442:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395712 00000100:00100000:0.0:1784047583.002447:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395712 00000100:00100000:0.0:1784047583.002490:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:3.0:1784047583.002506:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709394688:12345-0@lo:400:kworker.0 Request processed in 173us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.002508:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709395200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.002526:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1784047583.002563:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1784047583.002574:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709394560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.002640:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709395200:12345-0@lo:400:kworker.0 Request processed in 138us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.002648:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1784047583.002683:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1784047583.002692:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709395712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.002726:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709394560:12345-0@lo:400:kworker.0 Request processed in 152us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047583.002736:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1784047583.002758:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709395712:12345-0@lo:400:kworker.0 Request processed in 63us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.002768:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1784047583.002835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047583.002876:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709395328:0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.002904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047583.002926:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709395840:0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.002952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047583.002983:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394816 00000100:00100000:0.0:1784047583.002987:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394816 00000100:00100000:0.0:1784047583.003028:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395840 00000100:00100000:0.0:1784047583.003032:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395840 00000100:00100000:0.0:1784047583.003046:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1784047583.003052:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709394816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.003084:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709394816:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.003090:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1784047583.003104:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1784047583.003110:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709395840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.003134:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709395840:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.003152:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1784047583.003195:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709395840:0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.003216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709394304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047583.003245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709394816:0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.004185:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395328 00000100:00100000:0.0:1784047583.004195:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395328 00000100:00100000:0.0:1784047583.004241:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1784047583.004249:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709395328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.004304:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709395328:12345-0@lo:400:kworker.0 Request processed in 55us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.004311:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1784047583.004351:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709395328:0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.004420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047583.004482:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709394944:0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.004515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047583.004534:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcec14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709395456:0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.004554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047583.004569:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709395968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047583.004591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047583.004823:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394432 00000100:00100000:0.0:1784047583.004827:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394432 00000100:00100000:0.0:1784047583.004878:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784047583.004885:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.004924:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709394432:12345-0@lo:400:kworker.0 Request processed in 40us (3324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.004930:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784047583.005328:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395072 00000100:00100000:1.0:1784047583.005333:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395072 00000100:00100000:1.0:1784047583.005365:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395968 00000100:00100000:1.0:1784047583.005369:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395968 00000100:00100000:1.0:1784047583.005390:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1784047583.005396:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3647:x1870705709395072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.005434:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3647:x1870705709395072:12345-0@lo:400:kworker.0 Request processed in 38us (3476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.005440:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1784047583.005453:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1784047583.005458:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709395968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047583.005480:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1784047583.005512:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709395968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.005518:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1784047583.005536:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709394944 00000100:00100000:1.0:1784047583.005540:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709394944 00000100:00100000:1.0:1784047583.005567:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395456 00000100:00100000:1.0:1784047583.005570:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395456 00000100:00100000:1.0:1784047583.005581:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1784047583.005586:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709394944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.005660:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709394944:12345-0@lo:400:kworker.0 Request processed in 73us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.005667:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1784047583.005680:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1784047583.005685:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709395456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.011500:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709394688:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.011527:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709395200:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.011540:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709395712:0@lo:400:kworker.0 00000100:00080000:3.0:1784047583.011670:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047583.011678:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047583.011683:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047583.011686:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047583.011815:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709394432:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.011833:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709394944:0@lo:400:kworker.0 00000100:00100000:3.0:1784047583.011924:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051586 gen 3 00000004:00080000:3.0:1784047583.011932:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051586 committed transno 124554051586 00000100:00100000:3.0:1784047583.011971:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709395968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047583.017241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047583.017377:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709394560:0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.017391:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709395584 00000100:00100000:3.0:1784047583.017400:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709395072:0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.017412:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709395584 00000100:00100000:0.0:1784047583.017507:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:0.0:1784047583.017519:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709395584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047583.017635:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709395584:12345-0@lo:400:kworker.0 Request processed in 118us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.017653:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00080000:0.0:1784047583.017699:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047583.017712:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709395584:0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.017964:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709395456:12345-0@lo:400:kworker.0 Request processed in 12275us (13405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.017979:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1784047583.018014:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcec14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709395456:0@lo:400:kworker.0 00000100:00100000:1.0:1784047583.506920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709396096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047583.507038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047583.507118:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396096 00000100:00100000:1.0:1784047583.507128:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396096 00000100:00100000:1.0:1784047583.507190:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:1.0:1784047583.507202:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709396096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784047583.507242:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784047583.507295:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709396096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.507303:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:1.0:1784047583.507363:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709396096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784047583.509064:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047583.509320:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047583.509345:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709396224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047583.509415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047583.509542:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396224 00000100:00100000:2.0:1784047583.509550:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396224 00000100:00100000:2.0:1784047583.509632:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1784047583.509642:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709396224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047583.509676:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047583.509729:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709396224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047583.509737:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:1.0:1784047583.509825:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709396224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047583.877851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047583.877924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047583.877969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047583.878013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047583.878042:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497728 00000100:00100000:3.0:1784047583.878051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047583.878059:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497728 00000100:00100000:3.0:1784047583.878098:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497984 00000100:00100000:3.0:1784047583.878103:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497984 00000100:00100000:3.0:1784047583.878149:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498112 00000100:00100000:1.0:1784047583.878152:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497856 00000100:00100000:3.0:1784047583.878153:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498112 00000100:00100000:1.0:1784047583.878159:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497856 00000100:00100000:3.0:1784047583.878194:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2666 00000100:00100000:3.0:1784047583.878207:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689497984:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047583.878236:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1422 00000100:00100000:1.0:1784047583.878247:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689497728:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047583.878341:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689497728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 96us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.878350:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1422 00000100:00100000:1.0:1784047583.878374:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1423 00000100:00100000:1.0:1784047583.878381:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689497856:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047583.878410:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689497856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.878417:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1423 00000100:00100000:1.0:1784047583.878442:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2667 00000100:00100000:1.0:1784047583.878449:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689498112:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047583.878476:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689498112:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047583.878483:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2667 00000100:00100000:3.0:1784047583.878521:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689497984:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 316us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047583.878530:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2666 00000100:00100000:0.0:1784047583.878868:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689497600 00000100:00100000:0.0:1784047583.878873:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689497600 00000100:00100000:0.0:1784047583.878918:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:0.0:1784047583.878926:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689497600:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047583.878957:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689497600:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047583.878964:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00080000:1.0:1784047583.879038:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047583.879045:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047583.879048:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047583.879050:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784047584.530805:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047584.531228:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047584.531258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709396352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047584.531351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047584.531421:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396352 00000100:00100000:0.0:1784047584.531432:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396352 00000100:00100000:0.0:1784047584.531500:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1784047584.531511:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709396352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047584.531542:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047584.531597:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709396352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047584.531633:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1784047584.531694:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709396352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047584.534561:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709396480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047584.534746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047584.534968:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396480 00000100:00100000:3.0:1784047584.534990:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396480 00000100:00100000:3.0:1784047584.535062:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:3.0:1784047584.535076:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709396480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047584.535105:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047584.535156:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709396480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047584.535181:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1784047584.535333:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709396480:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784047585.559927:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047586.578865:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047587.603456:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047588.114893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047588.114927:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709396608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047588.115030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.115144:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396608 00000100:00100000:1.0:1784047588.115154:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396608 00000100:00100000:1.0:1784047588.115250:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1784047588.115261:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709396608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047588.115324:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1784047588.115384:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709396608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.115392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1784047588.115445:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709396608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047588.121735:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784047588.121769:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709396736:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.121884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.121908:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709397120:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.121931:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709396864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047588.121947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047588.121958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.121968:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709397632:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.121976:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709397248:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.121991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122011:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709398144:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.122012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047588.122027:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709397760:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047588.122047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122055:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784047588.122060:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709396992:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.122060:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709398272:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122099:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709397504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122139:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709398016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122185:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709397376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122228:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709397888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122298:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397120 00000100:00100000:1.0:1784047588.122307:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397120 00000100:00100000:1.0:1784047588.122367:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397248 00000100:00100000:1.0:1784047588.122371:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397248 00000100:00100000:1.0:1784047588.122385:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397760 00000100:00100000:1.0:1784047588.122388:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397760 00000100:00100000:1.0:1784047588.122399:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396992 00000100:00100000:1.0:1784047588.122401:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396992 00000100:00100000:1.0:1784047588.122410:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397376 00000100:00100000:1.0:1784047588.122413:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397376 00000100:00100000:1.0:1784047588.122430:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1784047588.122439:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709397120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122500:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709397120:12345-0@lo:400:kworker.0 Request processed in 61us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.122508:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1784047588.122528:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1784047588.122535:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709397248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.122565:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709397248:12345-0@lo:400:kworker.0 Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047588.122565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.122571:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1784047588.122580:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398272 00000100:00100000:1.0:1784047588.122583:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398272 00000100:00100000:1.0:1784047588.122597:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1784047588.122601:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709397760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.122603:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709397248:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.122668:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396736 00000100:00100000:0.0:1784047588.122671:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396736 00000100:00100000:0.0:1784047588.122713:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784047588.122719:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709396736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.122753:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709396736:12345-0@lo:400:kworker.0 Request processed in 34us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047588.122759:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784047588.122789:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709396864 00000100:00100000:0.0:1784047588.122793:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709396864 00000100:00100000:0.0:1784047588.122834:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397888 00000100:00100000:0.0:1784047588.122837:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397888 00000100:00100000:0.0:1784047588.122856:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1784047588.122860:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709396864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047588.122900:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047588.122957:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:3.0:1784047588.122968:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709397888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125001:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709397760:12345-0@lo:400:kworker.0 Request processed in 2385us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125021:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1784047588.125068:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1784047588.125083:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709396992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125179:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709396992:12345-0@lo:400:kworker.0 Request processed in 103us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125186:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1784047588.125201:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1784047588.125209:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709397376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125257:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709397376:12345-0@lo:400:kworker.0 Request processed in 50us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125263:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1784047588.125275:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1784047588.125282:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709398272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125315:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709398272:12345-0@lo:400:kworker.0 Request processed in 33us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125321:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1784047588.125352:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397632 00000100:00100000:1.0:1784047588.125362:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397632 00000100:00100000:1.0:1784047588.125407:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398144 00000100:00100000:1.0:1784047588.125411:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398144 00000100:00100000:1.0:1784047588.125430:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709397504 00000100:00100000:1.0:1784047588.125433:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709397504 00000100:00100000:1.0:1784047588.125454:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398016 00000100:00100000:1.0:1784047588.125457:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398016 00000100:00100000:1.0:1784047588.125478:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:1.0:1784047588.125484:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709397632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125520:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709397632:12345-0@lo:400:kworker.0 Request processed in 37us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125526:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:1.0:1784047588.125536:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:1.0:1784047588.125550:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709398144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125581:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709398144:12345-0@lo:400:kworker.0 Request processed in 33us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125587:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:1.0:1784047588.125859:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:1.0:1784047588.125867:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709397504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125897:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709397504:12345-0@lo:400:kworker.0 Request processed in 32us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125903:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:1.0:1784047588.125914:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1784047588.125921:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709398016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.125948:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709398016:12345-0@lo:400:kworker.0 Request processed in 28us (3788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.125954:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00080000:1.0:1784047588.126017:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784047588.126022:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047588.126025:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047588.126029:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047588.127644:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870705709396864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4767us (5669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047588.127662:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1784047588.127784:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709397760:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.127801:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709398272:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.127847:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709396736:0@lo:400:kworker.0 00000100:00100000:0.0:1784047588.127873:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709396864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047588.128861:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709397888:12345-0@lo:400:kworker.0 Request processed in 5889us (6605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.128875:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1784047588.129086:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709397376:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129101:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709397888:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129145:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709396992:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129159:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709397504:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129172:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709398016:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129186:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709397120:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129214:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfeb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709397632:0@lo:400:kworker.0 00000100:00100000:1.0:1784047588.129227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709398144:0@lo:400:kworker.0 00000020:00000080:2.0:1784047588.136548:0:95290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffebbdfafd0 20000000:00000080:2.0:1784047588.136576:0:95290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99ccc5c0a400 uarg=0000000000000000 00000040:00100000:2.0:1784047588.137444:0:95290:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:2.0:1784047588.137454:0:95290:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1784047588.137470:0:95290:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1784047588.138054:0:95291:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 46 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1784047588.138160:0:95291:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 46 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1784047588.138175:0:95291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:2.0:1784047588.138449:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:2.0:1784047588.138466:0:95290:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1784047588.138481:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:2.0:1784047588.138494:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:2.0:1784047588.138508:0:95290:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1784047588.138985:0:95292:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1784047588.139018:0:95292:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1784047588.139032:0:95292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1784047588.139194:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:2.0:1784047588.139205:0:95290:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1784047588.139221:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:2.0:1784047588.139238:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:2.0:1784047588.139261:0:95290:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1784047588.140407:0:95293:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 48 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1784047588.140461:0:95293:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 48 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1784047588.140476:0:95293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:2.0:1784047588.141124:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:2.0:1784047588.141141:0:95290:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1784047588.141159:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:2.0:1784047588.141189:0:95290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:2.0:1784047588.141212:0:95290:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784047588.141243:0:95290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141271:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141281:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 9 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141290:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775a7d expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141299:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b5d expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141307:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b8e expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141315:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775baa expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141323:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141331:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775be2 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141338:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bfe expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141355:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775c0c expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141362:0:95290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775c36 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141372:0:95290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141429:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775c36 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141449:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775c36 expref: 23 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.141471:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398400:0@lo:104: 00000100:00100000:2.0:1784047588.141578:0:95290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047588.141733:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775c0c expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141742:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775c0c expref: 23 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.141751:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398528:0@lo:104: 00000100:00100000:2.0:1784047588.141778:0:95290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784047588.141854:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775bfe expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141863:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775bfe expref: 23 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.141879:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398656:0@lo:104: 00010000:00010000:2.0:1784047588.141921:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775be2 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141930:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775be2 expref: 23 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.141939:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398784:0@lo:104: 00010000:00010000:2.0:1784047588.141968:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.141977:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.141986:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398912:0@lo:104: 00010000:00010000:2.0:1784047588.142012:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775baa expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.142020:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775baa expref: 23 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.142028:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399040:0@lo:104: 00010000:00010000:2.0:1784047588.142054:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775b8e expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.142062:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775b8e expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.142084:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399168:0@lo:104: 00010000:00010000:2.0:1784047588.142113:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775b5d expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.142121:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775b5d expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.142129:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399296:0@lo:104: 00010000:00010000:2.0:1784047588.142153:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775a7d expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.142161:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775a7d expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.142169:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399424:0@lo:104: 00010000:00010000:2.0:1784047588.142200:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 9 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.142209:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 9 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.142218:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399552:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047588.142300:0:95290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.142309:0:95290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 9 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.142329:0:95290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399680:192.168.204.40@tcp:104: 00000100:00100000:2.0:1784047588.142356:0:95290:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8c669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047588.143101:0:9519:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784047588.143138:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143168:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143178:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143187:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143195:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143205:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143216:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.143227:0:9519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398400 00000100:00100000:1.0:1784047588.143237:0:9519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398400 00000100:00100000:1.0:1784047588.143310:0:9519:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:1.0:1784047588.143319:0:9519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398528 00000100:00100000:1.0:1784047588.143322:0:9519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398528 00000100:00100000:1.0:1784047588.143337:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784047588.143347:0:9519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6e36843b-2016-43fe-8842-da5818d68597+4:95290:x1870705709398400:12345-0@lo:104: 00010000:00010000:1.0:1784047588.143365:0:9519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.143510:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398656 00000100:00100000:3.0:1784047588.143515:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398656 00000100:00100000:3.0:1784047588.143534:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398784 00000100:00100000:3.0:1784047588.143536:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398784 00000100:00100000:3.0:1784047588.143546:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709398912 00000100:00100000:3.0:1784047588.143548:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709398912 00000100:00100000:3.0:1784047588.143555:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709399040 00000100:00100000:3.0:1784047588.143557:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709399040 00000100:00100000:3.0:1784047588.143564:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709399168 00000100:00100000:3.0:1784047588.143566:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709399168 00000100:00100000:3.0:1784047588.143575:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709399296 00000100:00100000:3.0:1784047588.143577:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709399296 00000100:00100000:3.0:1784047588.143585:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709399424 00000100:00100000:3.0:1784047588.143587:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709399424 00000100:00100000:3.0:1784047588.143599:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1784047588.143621:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+11:95290:x1870705709398528:12345-0@lo:104: 00010000:00010000:3.0:1784047588.143631:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.143723:0:9519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047588.143730:0:9519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6e36843b-2016-43fe-8842-da5818d68597+11:95290:x1870705709398400:12345-0@lo:104: Request processed in 385us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.143737:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784047588.143757:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784047588.143763:0:9519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6e36843b-2016-43fe-8842-da5818d68597+10:95290:x1870705709398656:12345-0@lo:104: 00010000:00010000:1.0:1784047588.143771:0:9519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047588.143835:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1784047588.143842:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1784047588.143851:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:0.0:1784047588.144168:0:95294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784047588.144176:0:95294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6e36843b-2016-43fe-8842-da5818d68597+10:95290:x1870705709398784:12345-0@lo:104: 00010000:00010000:0.0:1784047588.144185:0:95294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.144472:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398400:0@lo:104: 00010000:00010000:3.0:1784047588.144679:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784047588.144686:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+10:95290:x1870705709398528:12345-0@lo:104: Request processed in 1080us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.144694:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1784047588.144769:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784047588.144778:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+9:95290:x1870705709398912:12345-0@lo:104: 00010000:00010000:3.0:1784047588.144788:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.144831:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784047588.144836:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+9:95290:x1870705709398912:12345-0@lo:104: Request processed in 61us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.144841:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784047588.144856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784047588.144863:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+8:95290:x1870705709399040:12345-0@lo:104: 00010000:00010000:3.0:1784047588.144870:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.144914:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784047588.144920:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+8:95290:x1870705709399040:12345-0@lo:104: Request processed in 58us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.144926:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784047588.144938:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784047588.144944:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+7:95290:x1870705709399168:12345-0@lo:104: 00010000:00010000:3.0:1784047588.144952:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.144986:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784047588.144991:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+7:95290:x1870705709399168:12345-0@lo:104: Request processed in 48us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.144996:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784047588.145018:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784047588.145025:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+6:95290:x1870705709399296:12345-0@lo:104: 00010000:00010000:3.0:1784047588.145033:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145063:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1784047588.145068:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+6:95290:x1870705709399296:12345-0@lo:104: Request processed in 45us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.145074:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784047588.145087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1784047588.145093:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff28f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+5:95290:x1870705709399424:12345-0@lo:104: 00010000:00010000:3.0:1784047588.145100:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145128:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1784047588.145133:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff28f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+5:95290:x1870705709399424:12345-0@lo:104: Request processed in 42us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.145139:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:3.0:1784047588.145223:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784047588.145231:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145239:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145244:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145253:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145274:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145280:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145327:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145334:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145356:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145364:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600400/0x4426598c0c775c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145379:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784047588.145383:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145388:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145391:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145399:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145405:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145410:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145428:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145434:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145449:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145456:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46800/0x4426598c0c775c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c13 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145465:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784047588.145468:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145473:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145477:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145484:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145489:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145494:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145502:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145507:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145511:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145526:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46200/0x4426598c0c775bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775bdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145533:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047588.145536:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145541:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145545:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145552:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145558:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145563:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145572:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145577:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145582:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145587:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00601400/0x4426598c0c775baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775bb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145594:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047588.145601:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145628:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145631:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145639:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145645:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145650:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145661:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145666:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145670:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145676:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00601e00/0x4426598c0c775b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145685:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047588.145688:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145694:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145708:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145725:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145732:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145738:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145749:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145754:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145758:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145765:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00601a00/0x4426598c0c775b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b64 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145774:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047588.145776:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145782:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.145785:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145791:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.145797:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.145807:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.145820:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145826:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.145831:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145837:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00601c00/0x4426598c0c775a7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775a8b expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.145846:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047588.145848:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047588.145850:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047588.145859:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047588.145895:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709400192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.145948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146000:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784047588.146006:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709399808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.146031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146049:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709400320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.146072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146105:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400192 00000100:00100000:3.0:1784047588.146113:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400192 00010000:00010000:3.0:1784047588.146145:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775baa expref: 24 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146175:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709399808 00000100:00100000:3.0:1784047588.146187:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709399808 00010000:00010000:3.0:1784047588.146200:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775c36 expref: 25 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146217:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400320 00000100:00100000:3.0:1784047588.146220:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400320 00010000:00010000:3.0:1784047588.146230:0:26194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b8e expref: 26 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146247:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:3.0:1784047588.146254:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+26:3647:x1870705709400192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.146268:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.146275:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775baa expref: 26 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146285:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775baa expref: 26 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146307:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.146339:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+26:3647:x1870705709400192:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.146346:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:3.0:1784047588.146361:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1784047588.146367:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709399808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.146375:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.146379:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775c36 expref: 25 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146389:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775c36 expref: 25 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146407:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbfc00/0x4426598c0c775c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775c36 expref: 25 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146418:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.146441:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709399808:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.146449:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1784047588.146462:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1784047588.146468:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709400320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.146476:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.146480:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b8e expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146489:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775b8e expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146499:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.146518:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709400320:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.146525:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1784047588.146592:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709399936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.146643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146667:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709400448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.146687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146715:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784047588.146720:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709400064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.146749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146765:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709400576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.146783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047588.146815:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709399936 00000100:00100000:3.0:1784047588.146820:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709399936 00010000:00010000:3.0:1784047588.146834:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775c0c expref: 23 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146852:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400448 00000100:00100000:3.0:1784047588.146855:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400448 00010000:00010000:3.0:1784047588.146865:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b5d expref: 24 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146875:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400064 00000100:00100000:3.0:1784047588.146877:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400064 00010000:00010000:3.0:1784047588.146885:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 25 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146894:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400576 00000100:00100000:3.0:1784047588.146896:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400576 00010000:00010000:3.0:1784047588.146905:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775a7d expref: 26 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.146915:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1784047588.146920:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709399936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.146927:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.146931:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775c0c expref: 26 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146940:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775c0c expref: 26 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.146957:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.146984:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+26:3645:x1870705709399936:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.146991:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1784047588.147004:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1784047588.147010:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+25:3645:x1870705709400448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.147018:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.147022:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b5d expref: 25 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.147030:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775b5d expref: 25 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.147039:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.147059:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+25:3645:x1870705709400448:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.147065:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1784047588.147076:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1784047588.147082:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709400064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.147088:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.147092:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 24 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.147100:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 24 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.147109:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.147136:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709400064:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.147142:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1784047588.147155:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1784047588.147160:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709400576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.147168:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.147172:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775a7d expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.147181:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775a7d expref: 23 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.147191:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.147211:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709400576:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.147217:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1784047588.147259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709400064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.147267:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709400576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.147274:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709399936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.147280:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709400448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.147311:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709399808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.147318:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709400320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047588.147325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709400192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047588.147627:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047588.147635:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047588.147642:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047588.147674:0:9519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047588.147683:0:9519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6e36843b-2016-43fe-8842-da5818d68597+4:95290:x1870705709398656:12345-0@lo:104: Request processed in 3919us (4544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.147692:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:1.0:1784047588.147724:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047588.147732:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.147740:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047588.147745:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.147754:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047588.147762:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047588.147777:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047588.147812:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.147819:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047588.147840:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.147848:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cce3b88e00/0x4426598c0c775bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775c05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.147861:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047588.147863:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047588.147865:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047588.147872:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047588.147882:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709400704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047588.147936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.147969:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400704 00000100:00100000:1.0:1784047588.147975:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400704 00010000:00010000:1.0:1784047588.147997:0:25839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775bfe expref: 23 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047588.148020:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1784047588.148027:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+23:3648:x1870705709400704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047588.148036:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047588.148040:0:25839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775bfe expref: 23 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.148049:0:25839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775bfe expref: 23 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.148067:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047588.148095:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e36843b-2016-43fe-8842-da5818d68597+23:3648:x1870705709400704:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.148102:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1784047588.148129:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709400704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047588.148308:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbee00/0x4426598c0c775c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775c0c expref: 22 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.148322:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398528:0@lo:104: 00010000:00010000:2.0:1784047588.148336:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbea00/0x4426598c0c775c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775bfe expref: 21 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.148343:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398656:0@lo:104: 00000100:00100000:3.0:1784047588.148732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047588.149101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047588.149137:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498240 00000100:00100000:3.0:1784047588.149145:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498240 00010000:00010000:3.0:1784047588.149177:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 10 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.149204:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498368 00000100:00100000:3.0:1784047588.149207:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498368 00010000:00010000:3.0:1784047588.149219:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 11 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047588.149240:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2584 00000100:00100000:3.0:1784047588.149248:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+11:2401:x1870705689498240:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.149263:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.149269:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 11 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.149279:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 11 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.149296:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.149349:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+11:2401:x1870705689498240:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 102us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.149357:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2584 00000100:00100000:3.0:1784047588.149374:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2585 00000100:00100000:3.0:1784047588.149380:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689498368:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.149388:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047588.149393:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 10 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.149410:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 10 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.149421:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047588.149440:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689498368:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 60us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047588.149447:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2585 00000100:00100000:2.0:1784047588.150157:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398784:0@lo:104: 00010000:00010000:2.0:1784047588.150175:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600200/0x4426598c0c775bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775bd4 expref: 20 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150191:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709398912:0@lo:104: 00010000:00010000:2.0:1784047588.150206:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebdbf200/0x4426598c0c775bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775baa expref: 19 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150214:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399040:0@lo:104: 00010000:00010000:2.0:1784047588.150225:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b89e00/0x4426598c0c775b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775b8e expref: 18 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150236:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399168:0@lo:104: 00010000:00010000:2.0:1784047588.150247:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00601600/0x4426598c0c775b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775b5d expref: 17 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150274:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399296:0@lo:104: 00010000:00010000:2.0:1784047588.150294:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88200/0x4426598c0c775a8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775a7d expref: 16 pid: 94375 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150303:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399424:0@lo:104: 00010000:00010000:2.0:1784047588.150317:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47e00/0x4426598c0c775a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae500 expref: 9 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150325:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399552:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047588.150338:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88000/0x4426598c0c775a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f2 expref: 8 pid: 94372 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047588.150346:0:95290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95290:1870705709399680:192.168.204.40@tcp:104: 00010000:00010000:2.0:1784047588.150404:0:95290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047588.150527:0:95294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047588.150538:0:95294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6e36843b-2016-43fe-8842-da5818d68597+3:95290:x1870705709398784:12345-0@lo:104: Request processed in 6361us (7366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047588.150549:0:95294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00010000:3.0:1784047588.150644:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047588.150652:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.150662:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047588.150667:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.150677:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047588.150685:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047588.150691:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047588.150758:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.150765:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047588.150799:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047588.150854:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709400832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047588.151021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047588.151209:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400832 00000100:00100000:0.0:1784047588.151217:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400832 00010000:00010000:0.0:1784047588.151247:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775be2 expref: 16 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047588.151317:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1784047588.151326:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+16:3648:x1870705709400832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047588.151332:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600600/0x4426598c0c775be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775be9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151341:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047588.151346:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775be2 expref: 16 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047588.151350:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047588.151352:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047588.151354:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047588.151364:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775be2 expref: 16 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151380:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46c00/0x4426598c0c775be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775be2 expref: 16 pid: 94374 timeout: 3786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151400:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151410:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151429:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151437:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151445:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151456:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151461:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031a00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047588.151466:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151474:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151500:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047588.151514:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047588.151521:0:95290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.151529:0:95290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047588.151535:0:95290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047588.151559:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e36843b-2016-43fe-8842-da5818d68597+15:3648:x1870705709400832:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047588.151567:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1784047588.151660:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709400832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047588.627070:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047588.627670:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709400960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047588.627785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047588.627868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047588.627876:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709401088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047588.627905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047588.628212:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709400960 00000100:00100000:2.0:1784047588.628243:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709400960 00000100:00100000:2.0:1784047588.628315:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401088 00000100:00100000:2.0:1784047588.628318:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401088 00000100:00100000:2.0:1784047588.628344:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1784047588.628354:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709400960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047588.628401:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047588.628466:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709400960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047588.628475:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1784047588.628493:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1784047588.628500:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709401088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047588.628519:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047588.628549:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709401088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047588.628556:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1784047588.628638:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709401088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047588.628657:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709400960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047589.004075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047589.004124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047589.004176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047589.004214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047589.004222:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498624 00000100:00100000:2.0:1784047589.004238:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498624 00000100:00100000:2.0:1784047589.004327:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498496 00000100:00100000:2.0:1784047589.004331:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498496 00000100:00100000:2.0:1784047589.004356:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1430 00000100:00100000:2.0:1784047589.004369:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689498624:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047589.004463:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689498624:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.004473:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1430 00000100:00080000:3.0:1784047589.004511:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047589.004517:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1431 00000100:00080000:3.0:1784047589.004519:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047589.004526:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689498496:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047589.004559:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689498496:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.004566:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1431 00000100:00100000:0.0:1784047589.005480:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498752 00000100:00100000:0.0:1784047589.005492:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498752 00000100:00100000:2.0:1784047589.005547:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689498880 00000100:00100000:2.0:1784047589.005552:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689498880 00000100:00100000:0.0:1784047589.005573:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2672 00000100:00100000:0.0:1784047589.005585:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689498752:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047589.005597:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2673 00000100:00100000:2.0:1784047589.005636:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689498880:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047589.005816:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689498752:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 233us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.005825:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2672 00000100:00080000:3.0:1784047589.005893:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047589.005898:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047589.005975:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689498880:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 370us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.005983:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2673 10000000:01000000:0.0:1784047589.203402:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047589.203414:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cbc79c6800 from 58 10000000:01000000:0.0:1784047589.203422:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047589.203495:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.203511:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.203525:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.203563:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.203707:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.203765:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc133a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784047589.205476:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401216 00000100:00100000:1.0:1784047589.205494:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401216 00000100:00100000:1.0:1784047589.205595:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784047589.205647:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709401216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047589.205670:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047589.205705:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f2a expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.207113:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f2a expref: 16 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.207134:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f2a expref: 16 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.207146:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29400, rc 0) 00000100:00100000:1.0:1784047589.208017:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709401216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2404us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047589.208030:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784047589.208958:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.209008:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.209022:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.209144:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.211071:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.211245:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc133a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.215385:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401344 00000100:00100000:2.0:1784047589.215409:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401344 00000100:00100000:2.0:1784047589.215518:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784047589.215534:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709401344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.216229:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709401344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 697us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.216241:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784047589.216983:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.217105:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.217199:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.217248:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.217645:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401472 00000100:00100000:0.0:1784047589.217654:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401472 00000100:00100000:0.0:1784047589.217732:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784047589.217744:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709401472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.217916:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709401472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.217925:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784047589.218305:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.221825:0:95295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95295:1870705709401600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047589.221984:0:95295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.222038:0:95295:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa04e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.222316:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401600 00000100:00100000:0.0:1784047589.222326:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401600 00000100:00100000:0.0:1784047589.222398:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784047589.222409:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:95295:x1870705709401600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.222665:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:95295:x1870705709401600:12345-0@lo:502:llog_process_th.0 Request processed in 256us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.222674:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784047589.223179:0:95295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95295:1870705709401600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047589.223271:0:95295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95295:1870705709401728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047589.223319:0:95295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.223362:0:95295:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6e0e000 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.223710:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401728 00000100:00100000:2.0:1784047589.223726:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401728 00000100:00100000:2.0:1784047589.223774:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784047589.223783:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:95295:x1870705709401728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.224110:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:95295:x1870705709401728:12345-0@lo:502:llog_process_th.0 Request processed in 327us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.224129:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784047589.224418:0:95295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95295:1870705709401728:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784047589.224452:0:95295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1784047589.228024:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1784047589.228110:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047589.228128:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047589.228143:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047589.228195:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784047589.228199:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1784047589.228202:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784047589.228260:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047589.228824:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047589.228840:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047589.228875:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.229109:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.229224:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.229403:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401856 00000100:00100000:0.0:1784047589.229414:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401856 00000100:00100000:0.0:1784047589.229568:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784047589.229581:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709401856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.229600:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047589.229650:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f38 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.229692:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f38 expref: 17 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.229706:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f38 expref: 17 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.229717:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4800, rc 0) 00000100:00100000:0.0:1784047589.230091:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709401856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 511us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.230098:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784047589.231101:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047589.231130:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047589.231144:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047589.232146:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.232844:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.233356:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.233827:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709401984 00000100:00100000:0.0:1784047589.233840:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709401984 00000100:00100000:0.0:1784047589.234078:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784047589.234092:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709401984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.236715:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709401984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2614us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.236742:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784047589.237060:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709401984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.237144:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.237249:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.237298:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.237943:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402112 00000100:00100000:2.0:1784047589.237954:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402112 00000100:00100000:2.0:1784047589.238039:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784047589.238051:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709402112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.238230:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709402112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.238238:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784047589.240375:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.248840:0:95296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95296:1870705709402240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.248996:0:95296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.249045:0:95296:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.249431:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402240 00000100:00100000:0.0:1784047589.249442:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402240 00000100:00100000:0.0:1784047589.249519:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784047589.249541:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:95296:x1870705709402240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.249785:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:95296:x1870705709402240:12345-0@lo:502:llog_process_th.0 Request processed in 247us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.249795:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784047589.251501:0:95296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95296:1870705709402240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047589.251558:0:95296:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047589.251577:0:95296:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047589.251580:0:95296:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784047589.251587:0:95296:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1784047589.251642:0:95296:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1784047589.253667:0:95296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95296:1870705709402368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.253811:0:95296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.253870:0:95296:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.254126:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402368 00000100:00100000:0.0:1784047589.254136:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402368 00000100:00100000:0.0:1784047589.254215:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784047589.254227:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:95296:x1870705709402368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.254437:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:95296:x1870705709402368:12345-0@lo:502:llog_process_th.0 Request processed in 210us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.254447:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000020:01000004:1.0:1784047589.255223:0:95297:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc79c6800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784047589.255233:0:95297:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc79c6800 4 00000100:00100000:3.0:1784047589.255672:0:95296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95296:1870705709402368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047589.255742:0:95296:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047589.255751:0:95296:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047589.255754:0:95296:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1784047589.255760:0:95296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:0.0:1784047589.256892:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:0.0:1784047589.256934:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784047589.256950:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.256966:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047589.257112:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047589.257116:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 58 10000000:01000000:0.0:1784047589.257119:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047589.257181:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.257190:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.257224:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.257254:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.257541:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.257586:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.257747:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402496 00000100:00100000:2.0:1784047589.257757:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402496 00000100:00100000:2.0:1784047589.257822:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784047589.257834:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709402496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047589.257852:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047589.257870:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f46 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.258105:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f46 expref: 18 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.258118:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f46 expref: 18 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.258128:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031a00, rc 0) 00000100:00100000:2.0:1784047589.258251:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709402496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 419us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.258259:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784047589.258500:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047589.258519:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.258546:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047589.258695:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.258747:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.258774:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6e0e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.259689:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402624 00000100:00100000:3.0:1784047589.259699:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402624 00000100:00100000:3.0:1784047589.259773:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784047589.259784:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709402624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.260248:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709402624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 464us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.260258:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784047589.260767:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.260841:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.261107:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.261148:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6e0e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.261548:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402752 00000100:00100000:3.0:1784047589.261558:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402752 00000100:00100000:3.0:1784047589.261634:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784047589.261645:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709402752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.261814:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709402752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.261823:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784047589.262230:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709402752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.272250:0:95298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95298:1870705709402880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.272457:0:95298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.273498:0:95298:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.273660:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709402880 00000100:00100000:0.0:1784047589.273672:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709402880 00000100:00100000:0.0:1784047589.273764:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784047589.273776:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:95298:x1870705709402880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.274844:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:95298:x1870705709402880:12345-0@lo:502:llog_process_th.0 Request processed in 1063us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.274857:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784047589.275514:0:95298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95298:1870705709402880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.276357:0:95298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95298:1870705709403008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.276449:0:95298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.276493:0:95298:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d840 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.276640:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403008 00000100:00100000:0.0:1784047589.276650:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403008 00000100:00100000:0.0:1784047589.276727:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784047589.276739:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:95298:x1870705709403008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.277506:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:95298:x1870705709403008:12345-0@lo:502:llog_process_th.0 Request processed in 765us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.277519:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784047589.277773:0:95298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95298:1870705709403008:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784047589.277817:0:95298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1784047589.278232:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1784047589.278343:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047589.278358:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.278374:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047589.278398:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784047589.278402:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:0.0:1784047589.278405:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047589.278449:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.278459:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.278480:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.278508:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.278569:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.278756:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.279356:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403136 00000100:00100000:2.0:1784047589.279366:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403136 00000100:00100000:2.0:1784047589.279470:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784047589.279482:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709403136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047589.279500:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047589.279522:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f54 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.279557:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f54 expref: 19 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.279571:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f54 expref: 19 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.279583:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030600, rc 0) 00000100:00100000:2.0:1784047589.279669:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709403136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.279690:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784047589.279804:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.279824:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.279835:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.279959:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.280007:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.280792:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.280850:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403264 00000100:00100000:3.0:1784047589.280857:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403264 00000100:00100000:3.0:1784047589.280913:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784047589.280923:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709403264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.281539:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709403264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 615us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.281550:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784047589.283201:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.283305:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.283420:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.283468:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.283692:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403392 00000100:00100000:3.0:1784047589.283701:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403392 00000100:00100000:3.0:1784047589.283766:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784047589.283778:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709403392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.283953:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709403392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.283962:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784047589.284104:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.287053:0:95299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95299:1870705709403520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.287239:0:95299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.287366:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403520 00000100:00100000:1.0:1784047589.287376:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403520 00000100:00100000:1.0:1784047589.287437:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784047589.287447:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:95299:x1870705709403520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.287794:0:95299:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b240 going to sleep for 11 seconds 00000100:00100000:1.0:1784047589.288128:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:95299:x1870705709403520:12345-0@lo:502:llog_process_th.0 Request processed in 680us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047589.288137:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784047589.288255:0:95299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95299:1870705709403520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784047589.288428:0:95299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047589.288453:0:95299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047589.288457:0:95299:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784047589.288465:0:95299:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1784047589.288489:0:95299:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1784047589.292073:0:95299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95299:1870705709403648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.292394:0:95299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.292444:0:95299:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b240 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.294061:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403648 00000100:00100000:0.0:1784047589.294079:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403648 00000100:00100000:0.0:1784047589.294183:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784047589.294197:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:95299:x1870705709403648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.294669:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:95299:x1870705709403648:12345-0@lo:502:llog_process_th.0 Request processed in 473us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.294689:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784047589.296584:0:95299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95299:1870705709403648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047589.296700:0:95299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784047589.296791:0:95299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047589.296795:0:95299:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1784047589.296817:0:95299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1784047589.297087:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1784047589.297174:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784047589.297190:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.297204:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047589.297218:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047589.297221:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 58 10000000:01000000:0.0:1784047589.297225:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047589.297287:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.297296:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.297307:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.297337:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.297430:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.297490:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784047589.297519:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403776 00000100:00100000:1.0:1784047589.297529:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403776 00000100:00100000:1.0:1784047589.297593:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784047589.297647:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd44e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709403776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047589.297665:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047589.297693:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f62 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.297825:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f62 expref: 20 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.297838:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f62 expref: 20 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.297850:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29200, rc 0) 00000100:00100000:1.0:1784047589.302114:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd44e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709403776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4493us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047589.302133:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784047589.302801:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047589.302837:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.302852:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.304438:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.304533:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.304658:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e480 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.310726:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709403904 00000100:00100000:3.0:1784047589.310752:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709403904 00000100:00100000:3.0:1784047589.310836:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784047589.310850:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709403904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.311148:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709403904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (6613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.311167:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784047589.311285:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709403904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.311372:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.311449:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.311497:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6e0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.311548:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404032 00000100:00100000:2.0:1784047589.311553:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404032 00000100:00100000:2.0:1784047589.311593:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784047589.311602:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709404032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.311737:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709404032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.311743:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784047589.311884:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.312596:0:95300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95300:1870705709404160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047589.312704:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.312751:0:95300:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6e0ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.312754:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404160 00000100:00100000:2.0:1784047589.312759:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404160 00000100:00100000:2.0:1784047589.312791:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784047589.312798:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:95300:x1870705709404160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.312917:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:95300:x1870705709404160:12345-0@lo:502:llog_process_th.0 Request processed in 118us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.312926:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784047589.312981:0:95300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95300:1870705709404160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047589.313037:0:95300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95300:1870705709404288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047589.313071:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.313091:0:95300:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.313129:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404288 00000100:00100000:3.0:1784047589.313134:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404288 00000100:00100000:3.0:1784047589.313167:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784047589.313175:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:95300:x1870705709404288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.313259:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:95300:x1870705709404288:12345-0@lo:502:llog_process_th.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.313266:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784047589.313291:0:95300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95300:1870705709404288:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784047589.313310:0:95300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1784047589.313493:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1784047589.313527:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047589.313540:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.313556:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047589.313576:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784047589.313580:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784047589.313584:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784047589.313654:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.313664:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.313685:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047589.313722:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.313756:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.313786:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.313810:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404416 00000100:00100000:0.0:1784047589.313815:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404416 00000100:00100000:0.0:1784047589.313853:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784047589.313862:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709404416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.313872:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047589.313898:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f70 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.313928:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f70 expref: 21 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.313941:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f70 expref: 21 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.313951:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4600, rc 0) 00000100:00100000:0.0:1784047589.314003:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709404416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.314016:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784047589.314098:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047589.314113:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.314123:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047589.314180:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.314208:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.314230:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.314286:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404544 00000100:00100000:0.0:1784047589.314291:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404544 00000100:00100000:0.0:1784047589.314321:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784047589.314329:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709404544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.314471:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709404544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.314487:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784047589.314508:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.314537:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.314581:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.314634:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.314688:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404672 00000100:00100000:0.0:1784047589.314693:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404672 00000100:00100000:0.0:1784047589.314730:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784047589.314737:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709404672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.314822:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709404672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.314829:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784047589.314847:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047589.316754:0:95301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1784047589.317138:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1784047589.317175:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784047589.317189:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.317202:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047589.317214:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047589.317217:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 58 10000000:01000000:0.0:1784047589.317220:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047589.317273:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.317282:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.317293:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047589.317324:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.317422:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.317473:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e300 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.317588:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404800 00000100:00100000:2.0:1784047589.317597:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404800 00000100:00100000:2.0:1784047589.317699:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784047589.317712:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709404800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047589.317729:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047589.317746:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f7e expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.317776:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f7e expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.317788:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f7e expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.317798:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030e00, rc 0) 00000100:00100000:2.0:1784047589.317853:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709404800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.317861:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784047589.318905:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047589.318934:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047589.318946:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047589.319068:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.319118:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.319149:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.319222:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709404928 00000100:00100000:0.0:1784047589.319229:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709404928 00000100:00100000:0.0:1784047589.319284:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784047589.319293:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709404928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.319475:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709404928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.319484:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784047589.320204:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709404928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.320269:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.320329:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047589.320367:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.320455:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405056 00000100:00100000:3.0:1784047589.320462:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405056 00000100:00100000:3.0:1784047589.320502:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784047589.320512:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709405056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.320655:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709405056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.320682:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784047589.323505:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.324950:0:95302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95302:1870705709405184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.325086:0:95302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.325139:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405184 00000100:00100000:2.0:1784047589.325141:0:95302:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838d300 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.325148:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405184 00000100:00100000:0.0:1784047589.325224:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784047589.325235:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:95302:x1870705709405184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.325528:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:95302:x1870705709405184:12345-0@lo:502:llog_process_th.0 Request processed in 294us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.325538:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784047589.325994:0:95302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95302:1870705709405184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047589.326318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047589.327063:0:95302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95302:1870705709405312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047589.327140:0:95302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.327277:0:95302:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.339779:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499008 00000100:00100000:0.0:1784047589.339803:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499008 00000100:00100000:0.0:1784047589.339903:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405312 00000100:00100000:0.0:1784047589.339908:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405312 00000100:00100000:0.0:1784047589.339934:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 116 00000100:00100000:0.0:1784047589.339947:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689499008:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.339969:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047589.339995:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae554 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.340048:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.340080:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.340091:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5c00, rc 0) 00000100:00100000:0.0:1784047589.340190:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689499008:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 245us (13874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.340199:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 116 00000100:00100000:0.0:1784047589.340236:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784047589.340242:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:95302:x1870705709405312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047589.340412:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:95302:x1870705709405312:12345-0@lo:502:llog_process_th.0 Request processed in 169us (13271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.340420:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784047589.341796:0:95302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95302:1870705709405312:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784047589.341865:0:95302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1784047589.344310:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1784047589.344368:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784047589.344384:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.344399:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047589.344425:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784047589.344429:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784047589.344432:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784047589.344490:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.344499:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.344512:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047589.344545:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.344670:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.344732:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.346374:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405440 00000100:00100000:0.0:1784047589.346396:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405440 00000100:00100000:0.0:1784047589.346482:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784047589.346495:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709405440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.346519:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047589.346545:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775f93 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.346578:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775f93 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.346591:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f93 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.346641:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5a00, rc 0) 00000100:00100000:0.0:1784047589.346733:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709405440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.346742:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784047589.346814:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047589.346849:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.346860:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047589.346964:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.347031:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.347074:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd838dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.347127:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405568 00000100:00100000:3.0:1784047589.347134:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405568 00000100:00100000:3.0:1784047589.347172:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784047589.347180:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709405568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.347341:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709405568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.347348:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784047589.348753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047589.348861:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499136 00000100:00100000:2.0:1784047589.348871:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499136 00000100:00100000:2.0:1784047589.348924:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:2.0:1784047589.348935:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689499136:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.349046:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047589.349109:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.349118:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689499136:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 185us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.349125:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:0.0:1784047589.349171:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047589.349208:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00100000:3.0:1784047589.349344:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405696 00000100:00100000:3.0:1784047589.349348:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405696 00000100:00100000:3.0:1784047589.349387:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784047589.349395:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709405696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.349513:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709405696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.349520:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784047589.349829:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784047589.351903:0:95303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:3.0:1784047589.356846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047589.360064:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499264 00000100:00100000:1.0:1784047589.360087:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499264 00000100:00100000:1.0:1784047589.360186:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:1.0:1784047589.360219:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689499264:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.360449:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689499264:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 233us (3618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047589.360458:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 122 00000020:01000000:0.0:1784047589.363719:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1784047589.363785:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784047589.363802:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.363819:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047589.364081:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784047589.364086:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:2.0:1784047589.364089:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784047589.364143:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.364152:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047589.364165:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047589.364221:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.364306:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.364354:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047589.364935:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405824 00000100:00100000:0.0:1784047589.364948:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405824 00000100:00100000:0.0:1784047589.366659:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784047589.366697:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709405824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.366727:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047589.366754:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775fa1 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.366823:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.366836:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.366847:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4000, rc 0) 00000100:00100000:0.0:1784047589.366948:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709405824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.366955:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784047589.367186:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047589.367210:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047589.367221:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047589.367333:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047589.367385:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047589.367600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047589.369951:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784047589.371476:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709405952 00000100:00100000:2.0:1784047589.371497:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709405952 00000100:00100000:2.0:1784047589.371559:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499392 00000100:00100000:2.0:1784047589.371564:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499392 00000100:00100000:2.0:1784047589.371588:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784047589.371601:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709405952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047589.371830:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709405952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (4444us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784047589.371840:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784047589.371886:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 125 00000100:00100000:2.0:1784047589.371893:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73343:x1870705689499392:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784047589.372040:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73343:x1870705689499392:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 146us (4442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.372048:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 125 00000100:00100000:3.0:1784047589.373837:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709405952:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784047589.373918:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784047589.373933:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047589.373951:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047589.380331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047589.381042:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499520 00000100:00100000:2.0:1784047589.381058:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499520 00000100:00100000:2.0:1784047589.381145:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:2.0:1784047589.381157:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73343:x1870705689499520:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784047589.381583:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73343:x1870705689499520:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 426us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047589.381639:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:3.0:1784047589.386573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047589.387401:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499648 00000100:00100000:0.0:1784047589.387430:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499648 00000100:00100000:0.0:1784047589.387523:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:0.0:1784047589.387536:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689499648:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047589.387561:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047589.387587:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae55b expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.387654:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 10 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.387668:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 10 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047589.387690:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5600, rc 0) 00000100:00100000:0.0:1784047589.387785:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689499648:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 251us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.387816:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:3.0:1784047589.394989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047589.398969:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499776 00000100:00100000:1.0:1784047589.398992:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499776 00000100:00100000:1.0:1784047589.399090:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:1.0:1784047589.399104:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689499776:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047589.399299:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689499776:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 192us (4320us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047589.399309:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:2.0:1784047589.651047:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047589.651082:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbcaa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709406080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047589.651196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047589.651326:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047589.651462:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709406080 00000100:00100000:0.0:1784047589.651472:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709406080 00000100:00100000:0.0:1784047589.651548:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1784047589.651560:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709406080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047589.651596:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047589.651706:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709406080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047589.651716:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:2.0:1784047589.652258:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbcaa17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709406080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784047589.652552:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709406208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047589.652602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047589.653153:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709406208 00000100:00100000:3.0:1784047589.653164:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709406208 00000100:00100000:3.0:1784047589.653228:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:3.0:1784047589.653238:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709406208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047589.653262:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047589.655848:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709406208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2595us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047589.655867:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1784047589.660683:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709406208:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784047590.679749:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047591.700056:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784047591.996236:0:95401:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc68ef9f60 20000000:00000080:3.0:1784047591.996263:0:95401:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99ccff0d6800 uarg=0000000000000000 00000040:00100000:3.0:1784047591.997088:0:95401:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:3.0:1784047591.997097:0:95401:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:3.0:1784047591.997115:0:95401:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1784047591.998063:0:95402:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 43 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:1.0:1784047591.998130:0:95402:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 43 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:1.0:1784047591.998151:0:95402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:3.0:1784047591.998584:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:3.0:1784047591.998996:0:95401:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1784047591.999037:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:3.0:1784047591.999062:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:3.0:1784047591.999082:0:95401:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1784047591.999754:0:95403:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:1.0:1784047591.999807:0:95403:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:1.0:1784047591.999828:0:95403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:3.0:1784047592.000067:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:3.0:1784047592.000081:0:95401:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1784047592.000094:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:3.0:1784047592.000109:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:3.0:1784047592.000122:0:95401:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1784047592.000780:0:95404:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 45 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:1.0:1784047592.000819:0:95404:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 45 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:1.0:1784047592.000833:0:95404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:3.0:1784047592.001033:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:3.0:1784047592.001048:0:95401:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1784047592.001064:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:3.0:1784047592.001081:0:95401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:3.0:1784047592.001122:0:95401:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784047592.001150:0:95401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001174:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f2a expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001182:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f38 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001189:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f46 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001195:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f54 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001202:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f62 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001209:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f70 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001228:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f7e expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001239:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001247:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775f93 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001254:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001261:0:95401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001269:0:95401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001322:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001340:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 9 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.001439:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406336:192.168.204.40@tcp:104: 00010000:00010000:3.0:1784047592.001760:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001770:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 23 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.001790:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406464:0@lo:104: 00000100:00100000:3.0:1784047592.001849:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.001905:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f93 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001914:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f93 expref: 23 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.001923:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406592:0@lo:104: 00000100:00100000:3.0:1784047592.001947:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.001982:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.001991:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.002000:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406720:192.168.204.40@tcp:104: 00010000:00010000:3.0:1784047592.002032:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f7e expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.002040:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f7e expref: 23 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.002048:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406848:0@lo:104: 00000100:00100000:3.0:1784047592.002068:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.002090:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f70 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.002109:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f70 expref: 23 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.002119:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406976:0@lo:104: 00000100:00100000:3.0:1784047592.002142:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.002166:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f62 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.002173:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f62 expref: 23 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.002181:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407104:0@lo:104: 00000100:00100000:3.0:1784047592.002202:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.002219:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f54 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.002228:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f54 expref: 23 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.002236:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407232:0@lo:104: 00000100:00100000:3.0:1784047592.002259:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.002275:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f46 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.002283:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f46 expref: 23 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.002291:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407360:0@lo:104: 00000100:00100000:3.0:1784047592.002325:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.002345:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f38 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047592.002496:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784047592.002514:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709406464 00000100:00100000:2.0:1784047592.002522:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709406464 00000100:00100000:2.0:1784047592.002571:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709406592 00000100:00100000:2.0:1784047592.002574:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709406592 00000100:00100000:2.0:1784047592.002584:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709406848 00000100:00100000:2.0:1784047592.002586:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709406848 00000100:00100000:2.0:1784047592.002594:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709406976 00000100:00100000:2.0:1784047592.002597:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709406976 00000100:00100000:2.0:1784047592.002647:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407104 00000100:00100000:2.0:1784047592.002651:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407104 00000100:00100000:2.0:1784047592.002663:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407232 00000100:00100000:2.0:1784047592.002666:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407232 00000100:00100000:2.0:1784047592.002676:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407360 00000100:00100000:2.0:1784047592.002679:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407360 00000100:00100000:2.0:1784047592.002694:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1784047592.002705:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+9:95401:x1870705709406464:12345-0@lo:104: 00010000:00010000:2.0:1784047592.002721:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.002795:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784047592.002802:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+9:95401:x1870705709406464:12345-0@lo:104: Request processed in 99us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.002816:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1784047592.002835:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784047592.002841:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+8:95401:x1870705709406592:12345-0@lo:104: 00010000:00010000:2.0:1784047592.002850:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.002887:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784047592.002892:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+8:95401:x1870705709406592:12345-0@lo:104: Request processed in 51us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.002899:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784047592.002913:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784047592.002920:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+7:95401:x1870705709406848:12345-0@lo:104: 00010000:00010000:2.0:1784047592.002928:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.002961:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784047592.002965:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+7:95401:x1870705709406848:12345-0@lo:104: Request processed in 48us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.002970:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784047592.002982:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784047592.002986:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+6:95401:x1870705709406976:12345-0@lo:104: 00010000:00010000:2.0:1784047592.002994:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.003022:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784047592.003028:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+6:95401:x1870705709406976:12345-0@lo:104: Request processed in 41us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.003039:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784047592.003052:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784047592.003057:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+5:95401:x1870705709407104:12345-0@lo:104: 00010000:00010000:2.0:1784047592.003065:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.003098:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784047592.003103:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+5:95401:x1870705709407104:12345-0@lo:104: Request processed in 46us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.003110:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784047592.003121:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784047592.003126:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+4:95401:x1870705709407232:12345-0@lo:104: 00010000:00010000:2.0:1784047592.003134:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.003160:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1784047592.003165:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+4:95401:x1870705709407232:12345-0@lo:104: Request processed in 40us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.003171:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784047592.003181:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784047592.003187:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff28c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:95401:x1870705709407360:12345-0@lo:104: 00010000:00010000:2.0:1784047592.003195:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.003221:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1784047592.003226:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff28c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e36843b-2016-43fe-8842-da5818d68597+3:95401:x1870705709407360:12345-0@lo:104: Request processed in 39us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.003238:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:2.0:1784047592.003284:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784047592.003292:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.003300:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047592.003306:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.003315:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047592.003323:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047592.003330:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047592.003584:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f38 expref: 23 pid: 94372 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.003597:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407488:0@lo:104: 00010000:00010000:3.0:1784047592.003639:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784047592.003645:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.003801:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784047592.003815:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003839:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047592.003844:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003853:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047592.003859:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047592.003865:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047592.003883:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003890:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047592.003918:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003926:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0030a00/0x4426598c0c775f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003954:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784047592.003956:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003962:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047592.003965:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.003971:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047592.003976:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047592.003981:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047592.003995:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004001:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047592.004008:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004013:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0031200/0x4426598c0c775f70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004023:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784047592.004026:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004043:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4400 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047592.004046:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004054:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047592.004060:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047592.004064:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047592.004078:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004084:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047592.004104:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004110:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4400/0x4426598c0c775f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004120:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047592.004122:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004127:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4c00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047592.004130:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004146:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047592.004151:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047592.004156:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047592.004170:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004175:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047592.004181:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004189:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4c00/0x4426598c0c775f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004198:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047592.004200:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004206:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047592.004209:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004216:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047592.004223:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047592.004236:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784047592.004251:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004257:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784047592.004263:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004269:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5e00/0x4426598c0c775f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.004279:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047592.004280:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047592.004282:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047592.004312:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709407744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047592.004547:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.004555:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047592.004562:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.004569:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccc0031e00/0x4426598c0c775fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775fa8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.004580:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047592.004581:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047592.004583:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.004777:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047592.004782:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.004790:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047592.004796:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047592.004801:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047592.004838:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.004845:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047592.004850:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.004856:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5000/0x4426598c0c775f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.004866:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.004868:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.004870:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.004879:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.004886:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047592.004899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709407872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.005260:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709408000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.005301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047592.005390:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709408384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.005413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047592.005522:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709408128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047592.005586:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047592.005663:0:95401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775f2a expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.005677:0:95401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775f2a expref: 23 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.005688:0:95401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0062c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709408512:0@lo:104: 00000100:00100000:3.0:1784047592.005810:0:95401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047592.005840:0:95401:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784047592.005871:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406464:0@lo:104: 00000100:00100000:3.0:1784047592.005883:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406592:0@lo:104: 00000100:00100000:3.0:1784047592.005912:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406848:0@lo:104: 00000100:00100000:3.0:1784047592.005921:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406976:0@lo:104: 00000100:00100000:3.0:1784047592.005930:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef505180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407104:0@lo:104: 00000100:00100000:3.0:1784047592.005940:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407232:0@lo:104: 00000100:00100000:3.0:1784047592.005949:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407360:0@lo:104: 00000100:00100000:1.0:1784047592.006171:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407488 00000100:00100000:1.0:1784047592.006186:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407488 00000100:00100000:1.0:1784047592.006246:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408512 00000100:00100000:1.0:1784047592.006250:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408512 00000100:00100000:1.0:1784047592.006272:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784047592.006281:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:95401:x1870705709407488:12345-0@lo:104: 00010000:00010000:1.0:1784047592.006293:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006358:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784047592.006364:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+4:95401:x1870705709407488:12345-0@lo:104: Request processed in 84us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047592.006371:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784047592.006390:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784047592.006397:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:95401:x1870705709408512:12345-0@lo:104: 00010000:00010000:1.0:1784047592.006404:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006438:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784047592.006444:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e36843b-2016-43fe-8842-da5818d68597+3:95401:x1870705709408512:12345-0@lo:104: Request processed in 49us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047592.006450:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:1.0:1784047592.006465:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784047592.006471:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006478:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c200 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047592.006493:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006512:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047592.006520:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047592.006525:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047592.006556:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006562:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047592.006579:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006587:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c200/0x4426598c0c775f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006603:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784047592.006636:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006643:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:1.0:1784047592.006646:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006652:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784047592.006660:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047592.006672:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784047592.006687:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006693:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784047592.006709:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006717:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5800/0x4426598c0c775f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775f31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.006736:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.006738:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.006739:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047592.006755:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047592.006952:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709407488:0@lo:104: 00000100:00100000:3.0:1784047592.006962:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0062c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709408512:0@lo:104: 00000100:00100000:0.0:1784047592.007133:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047592.007144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709408640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.007182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047592.007580:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408000 00000100:00100000:2.0:1784047592.007598:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408000 00010000:00010000:2.0:1784047592.007672:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f62 expref: 24 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047592.007704:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408384 00000100:00100000:2.0:1784047592.007708:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408384 00010000:00010000:2.0:1784047592.007721:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f7e expref: 25 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047592.007742:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:2.0:1784047592.007751:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709408000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047592.007766:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047592.007772:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f62 expref: 25 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.007783:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f62 expref: 25 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.007800:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff29200/0x4426598c0c775f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f62 expref: 25 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.007819:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047592.007860:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709408000:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.007868:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:2.0:1784047592.007884:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1784047592.007891:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709408384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784047592.007899:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047592.007904:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f7e expref: 23 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.007919:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f7e expref: 23 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.007930:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0030e00/0x4426598c0c775f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f7e expref: 23 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.007941:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047592.007968:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709408384:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047592.007974:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1784047592.008220:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709408000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.008229:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709408384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.008264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047592.008568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047592.008950:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709408256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.008992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047592.009021:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408640 00000100:00100000:3.0:1784047592.009030:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408640 00010000:00010000:3.0:1784047592.009062:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f38 expref: 22 pid: 94372 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.009089:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407744 00000100:00100000:3.0:1784047592.009092:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407744 00010000:00010000:3.0:1784047592.009103:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f93 expref: 23 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.009119:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:3.0:1784047592.009126:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+23:3647:x1870705709408640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.009140:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.009144:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f38 expref: 23 pid: 94372 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.009153:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f38 expref: 23 pid: 94372 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.009167:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4800/0x4426598c0c775f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f38 expref: 23 pid: 94372 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.009190:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.009229:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709408640:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.009235:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:3.0:1784047592.009254:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:3.0:1784047592.009259:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+21:3645:x1870705709407744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.009268:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.009273:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f93 expref: 21 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.009281:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f93 expref: 21 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.009292:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5a00/0x4426598c0c775f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f93 expref: 21 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.009301:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.009345:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+20:3645:x1870705709407744:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.009362:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:3.0:1784047592.009744:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406336:192.168.204.40@tcp:104: 00000100:00100000:3.0:1784047592.010165:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689499904 00000100:00100000:3.0:1784047592.010171:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689499904 00010000:00010000:3.0:1784047592.010198:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 10 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.010232:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2591 00000100:00100000:3.0:1784047592.010253:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689499904:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.010268:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.010273:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 10 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.010283:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 10 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.010298:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae55b expref: 10 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.010310:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.011047:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2401:x1870705689499904:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 232us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.011058:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2591 00000100:00100000:3.0:1784047592.011433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408128 00000100:00100000:3.0:1784047592.011441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408128 00010000:00010000:3.0:1784047592.011466:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f54 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.011578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1784047592.011586:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+20:3648:x1870705709408128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.011600:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.012079:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f54 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.012094:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f54 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.012134:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0030600/0x4426598c0c775f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f54 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.012151:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.012235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+19:3648:x1870705709408128:12345-0@lo:103:ldlm_bl.0 Request processed in 650us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.012243:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1784047592.012330:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e36843b-2016-43fe-8842-da5818d68597:3648:1870705709408128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.012586:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709408640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.012650:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047592.012728:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709408768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.012773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047592.012798:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709407744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047592.013052:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408256 00000100:00100000:3.0:1784047592.013062:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408256 00010000:00010000:3.0:1784047592.013097:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f46 expref: 19 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.013130:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408768 00000100:00100000:3.0:1784047592.013133:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408768 00010000:00010000:3.0:1784047592.013145:0:10393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f2a expref: 20 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.013171:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1784047592.013180:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+20:3645:x1870705709408256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.013195:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.013201:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f46 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.013211:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f46 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.013227:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0031a00/0x4426598c0c775f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f46 expref: 20 pid: 94374 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.013258:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.013298:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+19:3645:x1870705709408256:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.013306:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1784047592.013320:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1784047592.013326:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+18:3645:x1870705709408768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.013334:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.013339:0:10393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f2a expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.013347:0:10393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f2a expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.013445:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cceff29400/0x4426598c0c775f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f2a expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.013455:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.013482:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+17:3645:x1870705709408768:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.013571:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1784047592.013818:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709408768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.013846:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709408256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.014097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047592.014153:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709407616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.014197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047592.014269:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407872 00000100:00100000:3.0:1784047592.014275:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407872 00010000:00010000:3.0:1784047592.014299:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f70 expref: 17 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.014330:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709407616 00000100:00100000:3.0:1784047592.014333:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709407616 00010000:00010000:3.0:1784047592.014343:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.014456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1784047592.014464:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+18:3646:x1870705709407872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.014476:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.014481:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775f70 expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.014565:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775f70 expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.014580:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4600/0x4426598c0c775f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775f70 expref: 18 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.014594:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.014757:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+17:3646:x1870705709407872:12345-0@lo:103:ldlm_bl.0 Request processed in 293us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.014763:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1784047592.014816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:3.0:1784047592.014822:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+16:3646:x1870705709407616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.015323:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.015334:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 16 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.015442:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 16 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.015463:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b4000/0x4426598c0c775fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775fa1 expref: 16 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.015588:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.015705:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+15:3646:x1870705709407616:12345-0@lo:103:ldlm_bl.0 Request processed in 881us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.015713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1784047592.016096:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709407872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047592.016110:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709407616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047592.021065:0:95401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95401:1870705709406720:192.168.204.40@tcp:104: 00010000:00010000:3.0:1784047592.021148:0:95401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047592.023201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047592.023494:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500032 00000100:00100000:3.0:1784047592.023507:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500032 00010000:00010000:3.0:1784047592.023561:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047592.023645:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2597 00000100:00100000:3.0:1784047592.023657:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2402:x1870705689500032:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047592.023679:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047592.023686:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023701:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023726:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cbc67b5c00/0x4426598c0c775f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae554 expref: 9 pid: 94375 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023749:0:26195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023783:0:26195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023804:0:26195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023812:0:26195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023819:0:26195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023837:0:26195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023845:0:26195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c400 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047592.023850:0:26195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023858:0:26195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023880:0:26195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047592.023892:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047592.023964:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:2402:x1870705689500032:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 308us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047592.023973:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2597 00010000:00010000:1.0:1784047592.024438:0:95401:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.024449:0:95401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047592.024456:0:95401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6c400/0x4426598c0c775fb6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047592.722895:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047593.234947:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709409280:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235091:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709409152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.235174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.235188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709409664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.235194:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709409792:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.235215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.235229:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409152 00000100:00100000:2.0:1784047593.235238:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409152 00000100:00100000:3.0:1784047593.235246:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709410304:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.235268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.235286:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784047593.235291:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709408896:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235308:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409280 00000100:00100000:2.0:1784047593.235311:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409280 00000100:00100000:3.0:1784047593.235321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.235337:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1784047593.235347:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709409408:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235347:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709409152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.235367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.235384:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709409920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.235405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.235415:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709410432:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.235437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.235464:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409792 00000100:00100000:3.0:1784047593.235468:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409792 00000100:00100000:3.0:1784047593.235501:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410304 00000100:00100000:3.0:1784047593.235504:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410304 00000100:00100000:2.0:1784047593.235555:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709409152:12345-0@lo:400:kworker.0 Request processed in 209us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.235563:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1784047593.235592:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409408 00000100:00100000:2.0:1784047593.235595:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409408 00000100:00100000:2.0:1784047593.235668:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409920 00000100:00100000:2.0:1784047593.235672:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409920 00000100:00100000:2.0:1784047593.235685:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410432 00000100:00100000:2.0:1784047593.235687:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410432 00000100:00100000:2.0:1784047593.235701:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1784047593.235707:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709409280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235744:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870705709409280:12345-0@lo:400:kworker.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.235750:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1784047593.235761:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1784047593.235767:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709409408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235794:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709409408:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.235800:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1784047593.235811:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1784047593.235816:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709409920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235843:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709409920:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.235849:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1784047593.235860:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1784047593.235865:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709410432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235893:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709410432:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.235900:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1784047593.235926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.235957:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709410176:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.235984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.236430:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709409152:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236456:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784047593.236466:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709409024:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.236525:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709409536:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.236571:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709410048:0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236594:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.236655:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709410560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047593.236678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.236713:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409664 00000100:00100000:2.0:1784047593.236719:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409664 00000100:00100000:2.0:1784047593.236759:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410176 00000100:00100000:2.0:1784047593.236763:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410176 00000100:00100000:2.0:1784047593.236789:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1784047593.236798:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709409792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236842:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709409792:12345-0@lo:400:kworker.0 Request processed in 45us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.236848:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1784047593.236865:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1784047593.236872:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709409664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236905:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709409664:12345-0@lo:400:kworker.0 Request processed in 34us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.236911:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1784047593.236936:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1784047593.236941:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709410176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047593.236973:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709410176:12345-0@lo:400:kworker.0 Request processed in 32us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.236979:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1784047593.237006:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409024 00000100:00100000:2.0:1784047593.237009:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409024 00000100:00100000:3.0:1784047593.237111:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1784047593.237121:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709410304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.237159:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709410304:12345-0@lo:400:kworker.0 Request processed in 41us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.237165:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00080000:3.0:1784047593.237184:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047593.237188:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047593.237191:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709409536 00000100:00080000:3.0:1784047593.237192:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784047593.237196:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709409536 00000100:00080000:3.0:1784047593.237201:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047593.237223:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709408896 00000100:00100000:3.0:1784047593.237227:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709408896 00000100:00100000:1.0:1784047593.237228:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410048 00000100:00100000:1.0:1784047593.237230:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410048 00000100:00100000:1.0:1784047593.237240:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410560 00000100:00100000:1.0:1784047593.237242:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410560 00000100:00100000:3.0:1784047593.237252:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784047593.237257:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:3645:x1870705709408896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047593.237262:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1784047593.237267:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1870705709409536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.237292:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+15:3645:x1870705709408896:12345-0@lo:400:kworker.0 Request processed in 35us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.237299:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784047593.237301:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1870705709409536:12345-0@lo:400:kworker.0 Request processed in 35us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.237307:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1784047593.237320:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:1.0:1784047593.237325:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709410048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.237357:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709408896:0@lo:400:kworker.0 00000100:00100000:0.0:1784047593.238097:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1784047593.238116:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709410560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047593.238153:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1784047593.238453:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1784047593.238461:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709409024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243168:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709409408:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243199:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709409920:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243215:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709410432:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243230:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709410304:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243244:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870705709409280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709409792:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243426:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709409536:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243440:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709410048:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243455:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709409664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.243470:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709410176:0@lo:400:kworker.0 00000100:00100000:3.0:1784047593.246315:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709410688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047593.246437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.246548:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410688 00000100:00100000:3.0:1784047593.246560:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410688 00000100:00100000:3.0:1784047593.246679:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:3.0:1784047593.246693:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709410688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047593.246751:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1784047593.246806:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709410688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.246814:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:3.0:1784047593.246890:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709410688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047593.246955:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709410048:12345-0@lo:400:kworker.0 Request processed in 4690us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.246965:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1784047593.250420:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709410560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12295us (13723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.250443:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1784047593.251045:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709410560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047593.258869:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709409024:12345-0@lo:400:kworker.0 Request processed in 20393us (22352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.258891:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1784047593.259436:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709409024:0@lo:400:kworker.0 10000000:01000000:2.0:1784047593.362910:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784047593.362922:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cbc79c6800 from 61 10000000:01000000:2.0:1784047593.362929:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784047593.362998:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.363012:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.363026:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047593.363062:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709410816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.363152:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.363213:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.363311:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410816 00000100:00100000:1.0:1784047593.363320:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410816 00000100:00100000:1.0:1784047593.363385:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784047593.363395:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+15:6515:x1870705709410816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047593.363411:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047593.363428:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff28800/0x4426598c0c775fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775fbd expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.363457:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff28800/0x4426598c0c775fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775fbd expref: 16 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.363468:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff28800/0x4426598c0c775fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fbd expref: 16 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.363479:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28800, rc 0) 00000100:00100000:1.0:1784047593.363528:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709410816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.363535:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784047593.363699:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709410816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047593.363725:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fc4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.363736:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fc4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047593.363814:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709410944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.363846:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.363881:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.363988:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709410944 00000100:00100000:3.0:1784047593.363993:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709410944 00000100:00100000:3.0:1784047593.364032:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784047593.364041:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709410944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.364182:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709410944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.364190:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784047593.364296:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709410944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.364327:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.364367:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.364387:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.364958:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411072 00000100:00100000:3.0:1784047593.364968:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411072 00000100:00100000:3.0:1784047593.365069:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784047593.365079:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709411072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.365217:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709411072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.365226:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784047593.365332:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.368238:0:95406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95406:1870705709411200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.368374:0:95406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.368436:0:95406:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.368523:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411200 00000100:00100000:1.0:1784047593.368533:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411200 00000100:00100000:1.0:1784047593.368595:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784047593.368677:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:95406:x1870705709411200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.368869:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+16:95406:x1870705709411200:12345-0@lo:502:llog_process_th.0 Request processed in 196us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.368877:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784047593.371681:0:95406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95406:1870705709411200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047593.371937:0:95406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95406:1870705709411328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047593.372055:0:95406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.372112:0:95406:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.372962:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411328 00000100:00100000:3.0:1784047593.372977:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411328 00000100:00100000:3.0:1784047593.373061:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784047593.373075:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:95406:x1870705709411328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047593.373300:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+16:95406:x1870705709411328:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.373319:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784047593.373877:0:95406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95406:1870705709411328:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784047593.373928:0:95406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1784047593.378191:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1784047593.378246:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047593.378263:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fc4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.378304:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fc4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047593.378319:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784047593.378322:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:0.0:1784047593.378325:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784047593.378376:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.378385:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.378398:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.378431:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.378906:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.379037:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.383938:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411456 00000100:00100000:3.0:1784047593.383961:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411456 00000100:00100000:3.0:1784047593.385037:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784047593.385052:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+16:6515:x1870705709411456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047593.385075:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047593.385100:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd6c000/0x4426598c0c775fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775fcb expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.385135:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd6c000/0x4426598c0c775fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775fcb expref: 17 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.385149:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd6c000/0x4426598c0c775fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fcb expref: 17 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.385160:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6c000, rc 0) 00000100:00100000:3.0:1784047593.385270:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709411456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (6364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.385277:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784047593.386497:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047593.386530:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fd2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.386572:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fd2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047593.386740:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.386807:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.386847:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.386901:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411584 00000100:00100000:1.0:1784047593.386909:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411584 00000100:00100000:1.0:1784047593.386960:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784047593.387030:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709411584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.387194:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709411584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.387203:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784047593.387330:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.387364:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.387408:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.387469:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b900 going to sleep for 11 seconds 00000100:00100000:0.0:1784047593.388099:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411712 00000100:00100000:0.0:1784047593.388108:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411712 00000100:00100000:0.0:1784047593.388157:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784047593.388168:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709411712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.388520:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709411712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.388530:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784047593.388752:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709411712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.389241:0:95407:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95407:1870705709411840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047593.389314:0:95407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.389357:0:95407:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.389657:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411840 00000100:00100000:3.0:1784047593.389667:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411840 00000100:00100000:3.0:1784047593.389717:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784047593.389729:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:95407:x1870705709411840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047593.389905:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:95407:x1870705709411840:12345-0@lo:502:llog_process_th.0 Request processed in 178us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.389913:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784047593.390003:0:95407:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95407:1870705709411840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047593.390040:0:95407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784047593.390055:0:95407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047593.390057:0:95407:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:2.0:1784047593.390064:0:95407:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1784047593.395923:0:95407:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95407:1870705709411968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047593.396051:0:95407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.396459:0:95407:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047593.396563:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709411968 00000100:00100000:0.0:1784047593.396572:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709411968 00000100:00100000:0.0:1784047593.396719:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784047593.396743:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:95407:x1870705709411968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.397006:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+17:95407:x1870705709411968:12345-0@lo:502:llog_process_th.0 Request processed in 263us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.397016:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784047593.397509:0:95407:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95407:1870705709411968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047593.397574:0:95407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047593.397584:0:95407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047593.397586:0:95407:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1784047593.397592:0:95407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:0.0:1784047593.397931:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:0.0:1784047593.397959:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784047593.397971:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fd2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.397980:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fd2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047593.397989:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784047593.397991:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccc355c000 from 61 10000000:01000000:0.0:1784047593.397994:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784047593.398426:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.398436:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.398449:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.398478:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.398546:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.398763:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.402769:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412096 00000100:00100000:3.0:1784047593.402874:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412096 00000100:00100000:3.0:1784047593.403003:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784047593.403017:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+17:6515:x1870705709412096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047593.403041:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047593.403065:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd6ca00/0x4426598c0c775fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775fd9 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.403112:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd6ca00/0x4426598c0c775fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775fd9 expref: 18 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.403126:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd6ca00/0x4426598c0c775fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fd9 expref: 18 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.403138:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6ca00, rc 0) 00000100:00100000:3.0:1784047593.403277:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709412096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.403285:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784047593.403409:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.403455:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.403466:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.403577:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.403671:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.404806:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.404920:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412224 00000100:00100000:1.0:1784047593.404930:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412224 00000100:00100000:1.0:1784047593.404983:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784047593.404995:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709412224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.405810:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.405879:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.405951:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.405975:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.406179:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709412224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1184us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.406192:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784047593.406535:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412352 00000100:00100000:1.0:1784047593.406543:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412352 00000100:00100000:1.0:1784047593.406571:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784047593.406579:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709412352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.406746:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709412352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.406761:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784047593.406926:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.408119:0:95408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95408:1870705709412480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.408494:0:95408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.408549:0:95408:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.408693:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412480 00000100:00100000:1.0:1784047593.408701:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412480 00000100:00100000:1.0:1784047593.408759:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784047593.408770:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:95408:x1870705709412480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.408941:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:95408:x1870705709412480:12345-0@lo:502:llog_process_th.0 Request processed in 172us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.408950:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784047593.409114:0:95408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95408:1870705709412480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.409897:0:95408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95408:1870705709412608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.409976:0:95408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.410007:0:95408:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbcaa61840 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.410138:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412608 00000100:00100000:1.0:1784047593.410145:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412608 00000100:00100000:1.0:1784047593.410515:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784047593.410526:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:95408:x1870705709412608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.410706:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+18:95408:x1870705709412608:12345-0@lo:502:llog_process_th.0 Request processed in 182us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.410714:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784047593.410893:0:95408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95408:1870705709412608:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784047593.410931:0:95408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1784047593.411676:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1784047593.411723:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047593.411735:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.411748:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047593.411760:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784047593.411763:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:0.0:1784047593.411766:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047593.411806:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.411815:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.411825:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.411851:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.411905:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.412592:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66840 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.418116:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412736 00000100:00100000:3.0:1784047593.418139:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412736 00000100:00100000:3.0:1784047593.418494:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784047593.418507:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+18:6515:x1870705709412736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047593.418531:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047593.418557:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd6c800/0x4426598c0c775fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775fe7 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.418649:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd6c800/0x4426598c0c775fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775fe7 expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.418663:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd6c800/0x4426598c0c775fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fe7 expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.418675:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6c800, rc 0) 00000100:00100000:3.0:1784047593.418808:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709412736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 303us (6901us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.418815:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784047593.422855:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047593.422898:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.422914:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047593.423045:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.423398:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.423454:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73480 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.423654:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412864 00000100:00100000:3.0:1784047593.423663:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412864 00000100:00100000:3.0:1784047593.423742:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784047593.423753:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709412864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.423945:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709412864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.423954:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784047593.424077:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.424143:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.424227:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.424255:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909be40 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.424568:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709412992 00000100:00100000:3.0:1784047593.424574:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709412992 00000100:00100000:3.0:1784047593.424633:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784047593.424642:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709412992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.424871:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709412992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.424879:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784047593.425555:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709412992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.426564:0:95409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95409:1870705709413120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784047593.426985:0:95409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.427038:0:95409:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.427374:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413120 00000100:00100000:3.0:1784047593.427383:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413120 00000100:00100000:3.0:1784047593.427490:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784047593.427501:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:95409:x1870705709413120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784047593.427735:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+19:95409:x1870705709413120:12345-0@lo:502:llog_process_th.0 Request processed in 226us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.427744:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784047593.427868:0:95409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95409:1870705709413120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784047593.427905:0:95409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784047593.427918:0:95409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784047593.427921:0:95409:0:(obd_config.c:1561:class_process_config()) marker 52 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:1.0:1784047593.427928:0:95409:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1784047593.428093:0:95409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95409:1870705709413248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.428144:0:95409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.430067:0:95409:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce7e73480 going to sleep for 11 seconds 00000100:00100000:2.0:1784047593.430344:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413248 00000100:00100000:2.0:1784047593.430356:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413248 00000100:00100000:0.0:1784047593.430584:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784047593.432201:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:95409:x1870705709413248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.432655:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+19:95409:x1870705709413248:12345-0@lo:502:llog_process_th.0 Request processed in 2058us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.432668:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784047593.432881:0:95409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95409:1870705709413248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784047593.432931:0:95409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784047593.432942:0:95409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047593.432945:0:95409:0:(obd_config.c:1561:class_process_config()) marker 52 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:2.0:1784047593.432951:0:95409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:1.0:1784047593.433189:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:1.0:1784047593.433474:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784047593.433490:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.433504:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775fee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784047593.433515:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784047593.433518:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccf756a000 from 61 10000000:01000000:1.0:1784047593.433522:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784047593.433570:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.433579:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.433590:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047593.433654:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709413376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.434039:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.435575:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b32540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047593.435707:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413376 00000100:00100000:0.0:1784047593.435719:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413376 00000100:00100000:0.0:1784047593.435984:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784047593.435996:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+19:6515:x1870705709413376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.436017:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047593.436040:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c775ff5 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.436078:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c775ff5 expref: 20 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.436102:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775ff5 expref: 20 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.436112:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5600, rc 0) 00000100:00100000:0.0:1784047593.436206:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709413376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.436343:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784047593.436441:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709413376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047593.436463:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775ffc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.436474:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775ffc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047593.436581:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709413504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.436670:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.437110:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b32540 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.437317:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413504 00000100:00100000:3.0:1784047593.437324:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413504 00000100:00100000:3.0:1784047593.437364:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784047593.437374:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709413504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.437671:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709413504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.437678:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784047593.437949:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709413504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.438005:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709413632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.438149:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.438341:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b32540 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.438376:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413632 00000100:00100000:3.0:1784047593.438381:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413632 00000100:00100000:3.0:1784047593.438452:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784047593.438460:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709413632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.438579:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709413632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.438587:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784047593.438707:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709413632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.439513:0:95410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95410:1870705709413760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.439579:0:95410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.439938:0:95410:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b32480 going to sleep for 11 seconds 00000100:00100000:0.0:1784047593.440185:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413760 00000100:00100000:0.0:1784047593.440194:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413760 00000100:00100000:0.0:1784047593.440379:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784047593.440389:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:95410:x1870705709413760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.440555:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:95410:x1870705709413760:12345-0@lo:502:llog_process_th.0 Request processed in 165us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.440563:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784047593.440713:0:95410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95410:1870705709413760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.440779:0:95410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95410:1870705709413888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.440822:0:95410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.440852:0:95410:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc61c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047593.440942:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709413888 00000100:00100000:0.0:1784047593.440948:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709413888 00000100:00100000:0.0:1784047593.440968:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784047593.440974:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:95410:x1870705709413888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.441049:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:95410:x1870705709413888:12345-0@lo:502:llog_process_th.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.441063:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784047593.441177:0:95410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95410:1870705709413888:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784047593.441198:0:95410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1784047593.441694:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1784047593.441727:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784047593.441740:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775ffc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.441752:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775ffc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047593.441763:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784047593.441767:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1784047593.441771:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784047593.441805:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.441814:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.441825:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.441846:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.441906:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.441935:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.441987:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414016 00000100:00100000:1.0:1784047593.441993:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414016 00000100:00100000:1.0:1784047593.442021:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784047593.442028:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+20:6515:x1870705709414016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047593.442039:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047593.442055:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cceff29c00/0x4426598c0c77600a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776003 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.442151:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cceff29c00/0x4426598c0c77600a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776003 expref: 21 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.442163:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cceff29c00/0x4426598c0c77600a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776003 expref: 21 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.442174:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29c00, rc 0) 00000100:00100000:1.0:1784047593.442416:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709414016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 387us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.442424:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784047593.442591:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.442728:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77600a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.442758:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77600a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.442838:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.442872:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.442946:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:3.0:1784047593.442980:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414144 00000100:00100000:3.0:1784047593.442986:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414144 00000100:00100000:3.0:1784047593.443051:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784047593.443061:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709414144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.443479:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709414144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.443488:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784047593.443580:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.443767:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.443818:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.443848:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd5a66900 going to sleep for 11 seconds 00000100:00100000:2.0:1784047593.443892:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414272 00000100:00100000:2.0:1784047593.443897:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414272 00000100:00100000:2.0:1784047593.443973:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784047593.443984:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709414272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.444099:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709414272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.444106:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784047593.444579:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047593.448147:0:95411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784047593.457759:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784047593.457823:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784047593.457841:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77600a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.457858:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c77600a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047593.458170:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784047593.458175:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ccfe6b8800 from 61 10000000:01000000:3.0:1784047593.458179:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784047593.458424:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.458434:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.458448:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047593.458482:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.458587:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.458877:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047593.458933:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414400 00000100:00100000:2.0:1784047593.458943:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414400 00000100:00100000:2.0:1784047593.459047:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784047593.459060:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:6515:x1870705709414400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047593.459141:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047593.459164:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46600/0x4426598c0c776018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776011 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.459198:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46600/0x4426598c0c776018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776011 expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.459212:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46600/0x4426598c0c776018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776011 expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.459411:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46600, rc 0) 00000100:00100000:2.0:1784047593.459524:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709414400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 466us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.459532:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784047593.459879:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.459900:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.459912:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.460013:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.460050:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.460094:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc133ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.460201:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414528 00000100:00100000:1.0:1784047593.460399:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414528 00000100:00100000:1.0:1784047593.460495:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784047593.460506:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709414528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.460714:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709414528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.460722:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784047593.461065:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.461129:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.461202:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.461482:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc133ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.461532:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414656 00000100:00100000:1.0:1784047593.461545:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414656 00000100:00100000:1.0:1784047593.461585:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784047593.461592:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709414656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.461733:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709414656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.461741:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784047593.461875:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709414656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.462462:0:95412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95412:1870705709414784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784047593.462502:0:95412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.462563:0:95412:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc6c8b900 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.467813:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414784 00000100:00100000:1.0:1784047593.467836:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414784 00000100:00100000:1.0:1784047593.467990:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784047593.468003:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:95412:x1870705709414784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.468520:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:95412:x1870705709414784:12345-0@lo:502:llog_process_th.0 Request processed in 518us (6015us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.468530:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784047593.468689:0:95412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95412:1870705709414784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.468898:0:95412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95412:1870705709414912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.468954:0:95412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.468984:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709414912 00000100:00100000:1.0:1784047593.468989:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709414912 00000100:00100000:1.0:1784047593.469015:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784047593.469023:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:95412:x1870705709414912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784047593.469424:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:95412:x1870705709414912:12345-0@lo:502:llog_process_th.0 Request processed in 400us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047593.469432:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784047593.469481:0:95412:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc799da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.469497:0:95412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e36843b-2016-43fe-8842-da5818d68597:95412:1870705709414912:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784047593.469529:0:95412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1784047593.471725:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1784047593.471782:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784047593.471798:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.471813:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047593.471828:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784047593.471832:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784047593.471835:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784047593.471892:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.471902:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.471941:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047593.471974:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.472065:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.472243:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047593.484191:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415040 00000100:00100000:2.0:1784047593.484511:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415040 00000100:00100000:3.0:1784047593.484846:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784047593.484859:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709415040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047593.484881:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047593.484905:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebd6da00/0x4426598c0c776026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77601f expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.484943:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebd6da00/0x4426598c0c776026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77601f expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.484956:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebd6da00/0x4426598c0c776026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77601f expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.484967:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6da00, rc 0) 00000100:00100000:3.0:1784047593.485072:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709415040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (13006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.485088:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784047593.485556:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.485582:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.485697:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047593.485847:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.485893:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.485984:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc133ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1784047593.486021:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415168 00000100:00100000:2.0:1784047593.486028:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415168 00000100:00100000:2.0:1784047593.486186:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784047593.486197:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709415168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784047593.486992:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709415168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 794us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.487002:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784047593.487145:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.489819:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.489989:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.490110:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc133ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.490437:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415296 00000100:00100000:1.0:1784047593.490450:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415296 00000100:00100000:1.0:1784047593.490529:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784047593.490541:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709415296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.491982:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709415296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1434us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.491997:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784047593.492168:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784047593.495039:0:95413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784047593.495388:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784047593.495433:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784047593.495448:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.495485:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047593.495498:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784047593.495501:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc5e4b380 from 1 10000000:01000000:3.0:1784047593.495505:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784047593.495556:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.495565:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.495577:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047593.495644:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.495736:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047593.495802:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415424 00000100:00100000:2.0:1784047593.495812:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415424 00000100:00100000:3.0:1784047593.495878:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79efc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784047593.495881:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784047593.495892:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709415424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047593.495908:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047593.495926:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c776034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c77602d expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.495960:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c776034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c77602d expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.495974:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c776034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77602d expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047593.495984:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46e00, rc 0) 00000100:00100000:2.0:1784047593.496040:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709415424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.496047:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784047593.496200:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047593.496234:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047593.496244:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047593.496381:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784047593.496413:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047593.496489:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784047593.497093:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415552 00000100:00100000:1.0:1784047593.497102:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415552 00000100:00100000:1.0:1784047593.497193:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784047593.497204:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709415552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.497656:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709415552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 454us (1241us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047593.497666:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784047593.499945:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709415552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784047593.500069:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784047593.500116:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.500130:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047593.747409:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047593.748351:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709415680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047593.748567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047593.748922:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047593.748933:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047593.748978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047593.749096:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415680 00000100:00100000:0.0:1784047593.749108:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415680 00000100:00100000:0.0:1784047593.749239:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1784047593.749252:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709415680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784047593.749305:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047593.749379:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709415680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.749387:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1784047593.749407:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415808 00000100:00100000:0.0:1784047593.749410:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415808 00000100:00100000:3.0:1784047593.749507:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709415680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784047593.752194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:2.0:1784047593.752228:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709415808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047593.752277:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047593.752399:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709415808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047593.752426:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:3.0:1784047593.753022:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047593.929741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047593.929899:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500160 00000100:00100000:0.0:1784047593.929913:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500160 00000100:00100000:0.0:1784047593.929990:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 168 00000100:00100000:0.0:1784047593.930002:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd44e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+8:70965:x1870705689500160:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.930025:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047593.930058:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b4800/0x4426598c0c77603b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae562 expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.930097:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b4800/0x4426598c0c77603b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae562 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.930112:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b4800/0x4426598c0c77603b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae562 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.930150:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4800, rc 0) 00000100:00100000:0.0:1784047593.930236:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd44e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689500160:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 236us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.930244:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 168 00000100:00100000:2.0:1784047593.933307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047593.933423:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500288 00000100:00100000:0.0:1784047593.933436:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500288 00000100:00100000:0.0:1784047593.933504:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 169 00000100:00100000:0.0:1784047593.933516:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcd44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689500288:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.933774:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcd44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689500288:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 259us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.934152:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 169 00000100:00100000:2.0:1784047593.940483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047593.941679:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500416 00000100:00100000:0.0:1784047593.941696:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500416 00000100:00100000:0.0:1784047593.941780:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 170 00000100:00100000:0.0:1784047593.941791:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689500416:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784047593.942002:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689500416:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 212us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.942010:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 170 00000100:00100000:2.0:1784047593.949015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047593.949346:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500544 00000100:00100000:0.0:1784047593.949360:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500544 00000100:00100000:0.0:1784047593.949449:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 171 00000100:00100000:0.0:1784047593.949462:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73362:x1870705689500544:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784047593.949892:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73362:x1870705689500544:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 431us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.949914:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 171 00000100:00100000:2.0:1784047593.968423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047593.968526:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500672 00000100:00100000:3.0:1784047593.968540:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500672 00000100:00100000:3.0:1784047593.968670:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 172 00000100:00100000:3.0:1784047593.968683:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73362:x1870705689500672:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784047593.968906:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:73362:x1870705689500672:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 224us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047593.968915:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 172 00000100:00100000:2.0:1784047593.984400:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047593.985347:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500800 00000100:00100000:0.0:1784047593.985363:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500800 00000100:00100000:0.0:1784047593.985443:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:0.0:1784047593.985457:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689500800:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784047593.985479:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047593.985507:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cbc67b5e00/0x4426598c0c776042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae569 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.985546:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cbc67b5e00/0x4426598c0c776042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae569 expref: 10 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.985560:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cbc67b5e00/0x4426598c0c776042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae569 expref: 10 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047593.985571:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5e00, rc 0) 00000100:00100000:0.0:1784047593.985708:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689500800:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 254us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047593.985717:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:2.0:1784047593.998288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047593.998408:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689500928 00000100:00100000:1.0:1784047593.998421:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689500928 00000100:00100000:1.0:1784047593.998503:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 174 00000100:00100000:1.0:1784047593.998516:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689500928:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784047593.998720:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689500928:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 206us (446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784047593.998730:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 174 00000100:00100000:1.0:1784047594.125451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047594.125497:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047594.125526:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047594.125550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047594.125573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047594.125639:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501568 00000100:00100000:1.0:1784047594.125650:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501568 00000100:00100000:1.0:1784047594.125720:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501440 00000100:00100000:1.0:1784047594.125723:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501440 00000100:00100000:1.0:1784047594.125747:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2678 00000100:00100000:1.0:1784047594.125758:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689501568:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047594.125847:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689501568:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047594.125855:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2678 00000100:00100000:1.0:1784047594.125873:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2679 00000100:00100000:1.0:1784047594.125893:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689501440:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047594.125919:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689501440:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047594.125925:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2679 00000100:00100000:1.0:1784047594.125946:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501312 00000100:00100000:1.0:1784047594.125949:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501312 00000100:00100000:1.0:1784047594.125975:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501184 00000100:00100000:1.0:1784047594.125978:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501184 00000100:00100000:1.0:1784047594.125994:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1438 00000100:00100000:1.0:1784047594.125999:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689501312:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047594.126026:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689501312:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047594.126044:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1438 00000100:00100000:1.0:1784047594.126056:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1439 00000100:00100000:1.0:1784047594.126061:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689501184:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047594.126083:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689501184:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 22us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047594.126089:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1439 00000100:00100000:3.0:1784047594.127156:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501056 00000100:00100000:3.0:1784047594.127170:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501056 00000100:00100000:3.0:1784047594.127226:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 175 00000100:00100000:3.0:1784047594.127237:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689501056:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047594.127388:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689501056:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 152us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047594.127397:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 175 00000100:00080000:3.0:1784047594.127439:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047594.127446:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047594.127450:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784047594.127453:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784047594.771524:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047594.773041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784047594.773080:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709415936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784047594.773308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047594.773950:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709415936 00000100:00100000:3.0:1784047594.773962:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709415936 00000100:00100000:3.0:1784047594.774039:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:3.0:1784047594.774053:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709415936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047594.774553:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709416064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047594.774670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047594.775090:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416064 00000100:00100000:1.0:1784047594.775099:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416064 00000100:00100000:1.0:1784047594.775142:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1784047594.775151:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709416064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784047594.775291:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784047594.775362:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709416064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 211us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047594.775370:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00002000:00000024:3.0:1784047594.775509:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047594.775552:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709415936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1503us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047594.775559:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:0.0:1784047594.776502:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc93bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709416064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047594.776526:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709415936:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784047595.794926:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047596.819893:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784047597.093073:0:95510:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 12:46:34 (1784047594) 00000100:00100000:1.0:1784047597.154036:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.154075:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501824 00000100:00100000:1.0:1784047597.154085:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501824 00000100:00100000:1.0:1784047597.154151:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1462 00000100:00100000:1.0:1784047597.154161:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+10:73542:x1870705689501824:12345-192.168.204.40@tcp:36:mkdir.0 00010000:00010000:1.0:1784047597.154223:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047597.154293:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c775e58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae50e expref: 10 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.154339:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:1.0:1784047597.154345:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047597.154412:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.154427:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.154437:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.154452:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.154459:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.154465:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784047597.155305:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784047597.157487:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157514:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157538:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.157559:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007134a0c5 reply state 00000000326fc232 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157574:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157585:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047597.157588:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.157593:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784047597.157600:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1784047597.157633:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157652:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157659:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157666:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157672:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.157677:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157685:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157696:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:2.0:1784047597.157699:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.157702:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157709:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c776049 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.157725:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007134a0c5 reply state 00000000326fc232 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157746:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.157753:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99ccfebe4500) 00010000:00010000:2.0:1784047597.157761:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.157764:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784047597.158027:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:73542:x1870705689501824:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 3863us (3994us total) trans 124554051587 rc 0/0 00000100:00100000:2.0:1784047597.158036:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1462 00000100:00100000:2.0:1784047597.178072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.178156:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689501952 00000100:00100000:0.0:1784047597.178174:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689501952 00000100:00100000:0.0:1784047597.178240:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1463 00000100:00100000:0.0:1784047597.178250:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:73543:x1870705689501952:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047597.178275:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.178296:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77605e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae570 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.178357:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776065 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.181931:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.181956:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047597.182027:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047597.182032:0:66220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047597.182060:0:66220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.182098:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77605e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae570 expref: 13 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.182123:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae570 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.182133:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047597.182136:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047597.182140:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b4200, rc 0) 00000100:00100000:0.0:1784047597.182233:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+12:73543:x1870705689501952:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 3982us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047597.182243:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1463 00000100:00100000:3.0:1784047597.187053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.187132:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689502208 00000100:00100000:0.0:1784047597.187142:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689502208 00000100:00100000:0.0:1784047597.187211:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1464 00000100:00100000:0.0:1784047597.187222:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+12:73543:x1870705689502208:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047597.187244:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.187347:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784047597.187448:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776065 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae570 expref: 12 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.187468:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047597.187473:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.187487:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c77606c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae577 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188096:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188116:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188125:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188135:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188142:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188162:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188239:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.188248:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189366:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047597.189472:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1784047597.189495:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189503:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189509:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189515:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047597.189519:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189537:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189550:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047597.189553:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.189858:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189869:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c776081 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189890:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189897:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189904:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189910:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189915:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047597.189918:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189924:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189932:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047597.189935:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.189938:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189944:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189954:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189967:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189972:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189977:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047597.189980:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189986:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.189995:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99ccfebe4500) 00010000:00010000:0.0:1784047597.189998:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.190001:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.190006:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77607a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.190044:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c77606c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae577 expref: 12 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.190054:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047597.190057:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.190060:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c77606c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae577 expref: 12 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.190082:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5400, rc 0) 00000100:00100000:0.0:1784047597.190215:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:73543:x1870705689502208:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2993us (3172us total) trans 0 rc 301/301 00000100:00100000:0.0:1784047597.190226:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1464 00000100:00100000:2.0:1784047597.197449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.197534:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689502336 00000100:00100000:3.0:1784047597.197544:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689502336 00000100:00100000:3.0:1784047597.197641:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1465 00000100:00100000:3.0:1784047597.197653:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:73543:x1870705689502336:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1784047597.197676:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.197698:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c776088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae57e expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.197775:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d000/0x4426598c0c77608f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.198077:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d000/0x4426598c0c77608f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.198091:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d000/0x4426598c0c77608f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047597.198142:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047597.198147:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047597.198168:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d000/0x4426598c0c77608f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.198205:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c776088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae57e expref: 13 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.198222:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d000/0x4426598c0c77608f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae57e expref: 12 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.198231:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:3.0:1784047597.198234:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047597.198238:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6d000, rc 0) 00000100:00100000:3.0:1784047597.199191:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+12:73543:x1870705689502336:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1537us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047597.199202:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1465 00000100:00100000:3.0:1784047597.202420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.202569:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689502592 00000100:00100000:0.0:1784047597.202579:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689502592 00000100:00100000:0.0:1784047597.202658:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1466 00000100:00100000:0.0:1784047597.202670:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+12:73543:x1870705689502592:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1784047597.202692:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.202712:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae585 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.202799:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.202814:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.202826:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.202837:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.202845:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.202851:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047597.202956:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1784047597.203034:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203053:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203060:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203067:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203073:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047597.203077:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203085:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203096:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047597.203100:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.203104:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203111:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77609d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203123:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203138:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203144:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203149:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047597.203151:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203158:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203166:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99ccfebe4500) 00010000:00010000:0.0:1784047597.203168:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.203171:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203177:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c7760a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203209:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776096 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae585 expref: 14 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203219:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047597.203221:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784047597.203225:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae585 expref: 14 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.203243:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5400, rc 0) 00000100:00100000:0.0:1784047597.203303:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+13:73543:x1870705689502592:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 635us (891us total) trans 124554051588 rc 301/301 00000100:00100000:0.0:1784047597.203311:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1466 00000100:00100000:2.0:1784047597.211880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.213464:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689502848 00000100:00100000:0.0:1784047597.213478:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689502848 00000100:00100000:0.0:1784047597.213562:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1467 00000100:00100000:0.0:1784047597.213574:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+13:73543:x1870705689502848:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:0.0:1784047597.213684:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.213703:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.213716:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.213856:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061257083 reply state 0000000088da7e2b transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.213868:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.213876:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047597.213879:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1784047597.213882:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784047597.213888:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:0.0:1784047597.213969:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+15:73543:x1870705689502848:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 396us (3408us total) trans 124554051589 rc 0/0 00000100:00100000:0.0:1784047597.213984:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1467 00000100:00100000:1.0:1784047597.223690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.223782:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689503104 00000100:00100000:3.0:1784047597.223801:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689503104 00000100:00100000:3.0:1784047597.223860:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 244 00000100:00100000:3.0:1784047597.223871:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+15:73543:x1870705689503104:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1784047597.224117:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+16:73543:x1870705689503104:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 247us (436us total) trans 124554051590 rc 0/0 00000100:00100000:3.0:1784047597.224126:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 244 00000100:00100000:3.0:1784047597.243441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.243516:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689503232 00000100:00100000:2.0:1784047597.243537:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689503232 00000100:00100000:2.0:1784047597.243780:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1468 00000100:00100000:2.0:1784047597.243794:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+16:73544:x1870705689503232:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.243821:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.243843:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7760b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae58c expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.243914:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.243930:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.243943:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.243954:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.243961:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.243983:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244077:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a000/0x4426598c0c7760ce lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244091:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a000/0x4426598c0c7760ce lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244098:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a000/0x4426598c0c7760ce lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047597.244135:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1784047597.244139:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047597.244174:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a000/0x4426598c0c7760ce lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244187:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244194:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244200:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244207:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244214:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.244218:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244231:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244244:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:2.0:1784047597.244247:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.244252:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244258:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c7760c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244270:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244275:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244281:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244287:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.244289:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244296:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244303:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99ccfebe4500) 00010000:00010000:2.0:1784047597.244306:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.244309:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244324:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c7760c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244352:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c7760b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae58c expref: 18 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244367:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a000/0x4426598c0c7760ce lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae58c expref: 17 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.244374:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047597.244377:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784047597.244379:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a000, rc 0) 00000100:00100000:2.0:1784047597.244448:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+17:73544:x1870705689503232:12345-192.168.204.40@tcp:101:touch.0 Request processed in 655us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047597.244455:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1468 00000100:00100000:2.0:1784047597.249342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.249432:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689503488 00000100:00100000:3.0:1784047597.249442:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689503488 00000100:00100000:3.0:1784047597.249503:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1469 00000100:00100000:3.0:1784047597.249514:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+17:73544:x1870705689503488:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.249558:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.249593:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c7760d5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae593 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.249726:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.249755:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.249769:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.249785:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.249792:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.249799:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047597.250101:0:66220:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x723:0x0], count =95 00000004:00080000:3.0:1784047597.250109:0:66220:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x723:0x0]+95 in llog 00000004:00080000:3.0:1784047597.250129:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x782:0x0], index 0: 0 00010000:00010000:3.0:1784047597.250279:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c7760ea lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250289:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c7760ea lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250296:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c7760ea lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250336:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250344:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250350:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250357:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250362:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6dc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047597.250367:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250374:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250389:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:3.0:1784047597.250393:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047597.250398:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250405:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c7760dc lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.250417:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031637f7a reply state 0000000012cfaba5 transno 124554051591 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250428:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250443:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff99ccc37d2700) 00010000:00010000:3.0:1784047597.250445:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.250448:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784047597.250483:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c7760d5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae593 expref: 20 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250500:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c7760ea lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae593 expref: 19 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.250508:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2d00) 00010000:00010000:3.0:1784047597.250510:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047597.250513:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6d800, rc 0) 00000100:00100000:3.0:1784047597.250628:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+20:73544:x1870705689503488:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1090us (1271us total) trans 124554051591 rc 0/0 00000100:00100000:3.0:1784047597.250638:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1469 00000100:00100000:1.0:1784047597.266244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.266352:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689503744 00000100:00100000:3.0:1784047597.266364:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689503744 00000100:00100000:3.0:1784047597.266438:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1470 00000100:00100000:3.0:1784047597.266452:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+20:73544:x1870705689503744:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:3.0:1784047597.266516:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047597.266561:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c7760ea lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae593 expref: 20 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.266589:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2d00) 00010000:00010000:3.0:1784047597.266601:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047597.266676:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.266698:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.266710:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.266846:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbe23911 reply state 00000000717b840c transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.266860:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.266867:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:3.0:1784047597.266870:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.266873:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047597.266984:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+21:73544:x1870705689503744:12345-192.168.204.40@tcp:36:touch.0 Request processed in 535us (752us total) trans 124554051592 rc 0/0 00000100:00100000:3.0:1784047597.266992:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1470 00000100:00100000:1.0:1784047597.275152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.280385:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689503872 00000100:00100000:3.0:1784047597.280400:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689503872 00000100:00100000:3.0:1784047597.284078:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1471 00000100:00100000:3.0:1784047597.284100:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+21:73544:x1870705689503872:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.284129:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.284154:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c7760ff lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae59a expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.284219:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c7760ff lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae59a expref: 22 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.284247:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d400/0x4426598c0c7760ff lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae59a expref: 22 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.284269:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:3.0:1784047597.284272:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047597.284277:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6d400, rc 0) 00000100:00100000:3.0:1784047597.284349:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+22:73544:x1870705689503872:12345-192.168.204.40@tcp:101:touch.0 Request processed in 257us (9206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047597.284357:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1471 00000100:00100000:0.0:1784047597.296532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.297373:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689504000 00000100:00100000:3.0:1784047597.297384:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689504000 00000100:00100000:3.0:1784047597.297465:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5015 00000100:00100000:3.0:1784047597.297478:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+5:2400:x1870705689504000:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047597.297917:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+6:2400:x1870705689504000:12345-192.168.204.40@tcp:2:touch.0 Request processed in 441us (1403us total) trans 4294968758 rc 0/0 00000100:00100000:3.0:1784047597.297927:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5015 00000100:00080000:1.0:1784047597.298078:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047597.306537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.307046:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689504256 00000100:00100000:0.0:1784047597.307058:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689504256 00000100:00100000:0.0:1784047597.307116:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 245 00000100:00100000:0.0:1784047597.307130:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+22:73544:x1870705689504256:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.308225:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+23:73544:x1870705689504256:12345-192.168.204.40@tcp:35:touch.0 Request processed in 1093us (1704us total) trans 124554051593 rc 0/0 00000100:00100000:0.0:1784047597.308237:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 245 00000100:00100000:3.0:1784047597.312984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.313018:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689504512 00000100:00100000:3.0:1784047597.313026:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689504512 00000100:00100000:3.0:1784047597.313068:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1472 00000100:00100000:3.0:1784047597.313077:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+23:73544:x1870705689504512:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.313099:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.313119:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776106 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5a1 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.313223:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.313236:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.313245:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.314385:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.314396:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.314405:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047597.315972:0:66219:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x783:0x0], index 0: 0 00010000:00010000:2.0:1784047597.316155:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77611b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.316170:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77611b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318410:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77611b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318480:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318508:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318515:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318536:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318542:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6dc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.318547:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318554:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318572:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047597.318575:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.318580:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318586:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c77610d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.318602:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7d05f10 reply state 000000005184c7c3 transno 124554051594 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318748:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318757:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff99ccc37d2d00) 00010000:00010000:2.0:1784047597.318765:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.318769:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047597.318818:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776106 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5a1 expref: 26 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318835:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77611b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5a1 expref: 25 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.318841:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc34a7c00) 00010000:00010000:2.0:1784047597.318843:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047597.318846:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24ae00, rc 0) 00000100:00100000:2.0:1784047597.318958:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+26:73544:x1870705689504512:12345-192.168.204.40@tcp:101:touch.0 Request processed in 5881us (5980us total) trans 124554051594 rc 0/0 00000100:00100000:2.0:1784047597.318968:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1472 00000100:00100000:0.0:1784047597.330642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.330762:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689504768 00000100:00100000:3.0:1784047597.330774:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689504768 00000100:00100000:3.0:1784047597.330836:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1473 00000100:00100000:3.0:1784047597.330848:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+26:73544:x1870705689504768:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:3.0:1784047597.330911:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047597.330939:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ae00/0x4426598c0c77611b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5a1 expref: 26 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.330956:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc34a7c00) 00010000:00010000:3.0:1784047597.330966:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047597.331031:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.331046:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.331056:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.331163:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004127c4ce reply state 00000000e8f7da62 transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.331176:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.331182:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:3.0:1784047597.331185:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.331188:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047597.331329:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+27:73544:x1870705689504768:12345-192.168.204.40@tcp:36:touch.0 Request processed in 483us (697us total) trans 124554051595 rc 0/0 00000100:00100000:3.0:1784047597.331338:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1473 00000100:00100000:0.0:1784047597.336235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.337777:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689504896 00000100:00100000:3.0:1784047597.337790:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689504896 00000100:00100000:3.0:1784047597.337857:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1474 00000100:00100000:3.0:1784047597.337868:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+27:73544:x1870705689504896:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.337894:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.337917:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c776130 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5a8 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.337975:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c776130 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5a8 expref: 28 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.338011:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6dc00/0x4426598c0c776130 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5a8 expref: 28 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.338032:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:3.0:1784047597.338035:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047597.338038:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebd6dc00, rc 0) 00000100:00100000:3.0:1784047597.338108:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+28:73544:x1870705689504896:12345-192.168.204.40@tcp:101:touch.0 Request processed in 241us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047597.338116:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1474 00000100:00100000:1.0:1784047597.341066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.341124:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689505024 00000100:00100000:3.0:1784047597.341133:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689505024 00000100:00100000:1.0:1784047597.341225:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5016 00000100:00100000:1.0:1784047597.341238:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689505024:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.341509:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689505024:12345-192.168.204.40@tcp:2:touch.0 Request processed in 274us (450us total) trans 4294968759 rc 0/0 00000100:00100000:1.0:1784047597.341542:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5016 00000100:00100000:0.0:1784047597.349792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.349938:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689505280 00000100:00100000:1.0:1784047597.349949:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689505280 00000100:00100000:1.0:1784047597.350057:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 246 00000100:00100000:1.0:1784047597.350068:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+28:73544:x1870705689505280:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:1.0:1784047597.350424:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+29:73544:x1870705689505280:12345-192.168.204.40@tcp:35:touch.0 Request processed in 355us (641us total) trans 124554051596 rc 0/0 00000100:00100000:1.0:1784047597.350432:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 246 00000100:00100000:0.0:1784047597.354105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.354193:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689505536 00000100:00100000:2.0:1784047597.354203:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689505536 00000100:00100000:2.0:1784047597.354307:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1475 00000100:00100000:2.0:1784047597.354317:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+29:73544:x1870705689505536:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.354341:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.354362:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c776137 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5af expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.354487:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.354503:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.354515:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.354557:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.354573:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.354582:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047597.355181:0:66219:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x784:0x0], index 0: 0 00010000:00010000:2.0:1784047597.355508:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77614c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355530:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77614c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355539:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77614c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355576:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355584:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355590:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355596:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355602:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24aa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.355640:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355648:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355661:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047597.355664:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.355667:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355674:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c77613e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.355687:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012cd2a0b reply state 00000000ac40997b transno 124554051597 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355698:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.355704:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff99ccc34a7f00) 00010000:00010000:2.0:1784047597.355706:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.355708:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047597.356067:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c776137 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5af expref: 32 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.356083:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77614c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5af expref: 31 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.356091:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc34a7000) 00010000:00010000:2.0:1784047597.356094:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047597.356103:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b200, rc 0) 00000100:00100000:2.0:1784047597.356182:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+32:73544:x1870705689505536:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1866us (2090us total) trans 124554051597 rc 0/0 00000100:00100000:2.0:1784047597.356191:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1475 00000100:00100000:2.0:1784047597.365331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.365419:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689505792 00000100:00100000:3.0:1784047597.365430:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689505792 00000100:00100000:3.0:1784047597.365497:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1476 00000100:00100000:3.0:1784047597.365509:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+32:73544:x1870705689505792:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:3.0:1784047597.365598:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047597.365674:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77614c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5af expref: 32 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.365695:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc34a7000) 00010000:00010000:3.0:1784047597.365708:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047597.365776:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.365790:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.365820:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.365928:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ec1a88d reply state 0000000025096fbf transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.365941:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.365947:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:3.0:1784047597.365950:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.365952:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047597.366046:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+33:73544:x1870705689505792:12345-192.168.204.40@tcp:36:touch.0 Request processed in 538us (738us total) trans 124554051598 rc 0/0 00000100:00100000:3.0:1784047597.366054:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1476 00000100:00100000:1.0:1784047597.372716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.372956:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689505920 00000100:00100000:2.0:1784047597.372967:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689505920 00000100:00100000:2.0:1784047597.373072:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1477 00000100:00100000:2.0:1784047597.373083:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+33:73544:x1870705689505920:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.373108:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.373145:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c776161 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5b6 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.373203:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c776161 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5b6 expref: 34 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.373218:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b800/0x4426598c0c776161 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5b6 expref: 34 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.373235:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:2.0:1784047597.373238:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047597.373242:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b800, rc 0) 00000100:00100000:2.0:1784047597.373305:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:73544:x1870705689505920:12345-192.168.204.40@tcp:101:touch.0 Request processed in 223us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047597.373312:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1477 00000100:00100000:0.0:1784047597.377280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.377879:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689506048 00000100:00100000:1.0:1784047597.377890:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689506048 00000100:00100000:1.0:1784047597.377977:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5017 00000100:00100000:1.0:1784047597.377989:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689506048:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.378209:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+8:2402:x1870705689506048:12345-192.168.204.40@tcp:2:touch.0 Request processed in 221us (938us total) trans 4294968760 rc 0/0 00000100:00100000:1.0:1784047597.378217:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5017 00000100:00100000:1.0:1784047597.383044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.383210:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689506304 00000100:00100000:0.0:1784047597.383220:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689506304 00000100:00100000:0.0:1784047597.383275:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 247 00000100:00100000:0.0:1784047597.383287:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+34:73544:x1870705689506304:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.383850:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+35:73544:x1870705689506304:12345-192.168.204.40@tcp:35:touch.0 Request processed in 563us (814us total) trans 124554051599 rc 0/0 00000100:00100000:0.0:1784047597.383859:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 247 00000100:00100000:2.0:1784047597.394198:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.394360:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689506560 00000100:00100000:0.0:1784047597.394370:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689506560 00000100:00100000:0.0:1784047597.394428:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1478 00000100:00100000:0.0:1784047597.394438:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+35:73544:x1870705689506560:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047597.394475:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.394497:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776168 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5bd expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.394664:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.394682:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.394694:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.394709:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.394716:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.394723:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784047597.395076:0:66219:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x785:0x0], index 0: 0 00010000:00010000:2.0:1784047597.399151:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c77617d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399189:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c77617d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399201:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c77617d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399241:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399248:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399254:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399261:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399267:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.399271:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399278:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399290:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047597.399293:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.399297:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399303:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77616f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.399324:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e08785d4 reply state 000000001ce4f734 transno 124554051600 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399337:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.399345:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff99cbc9aa9100) 00010000:00010000:2.0:1784047597.399347:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.399351:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047597.403711:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776168 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5bd expref: 38 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.403748:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c77617d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5bd expref: 37 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.403759:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc34a7400) 00010000:00010000:2.0:1784047597.403762:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047597.403766:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a200, rc 0) 00000100:00100000:2.0:1784047597.403857:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+38:73544:x1870705689506560:12345-192.168.204.40@tcp:101:touch.0 Request processed in 9417us (9664us total) trans 124554051600 rc 0/0 00000100:00100000:2.0:1784047597.403868:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1478 00000100:00100000:3.0:1784047597.415108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.415491:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689506816 00000100:00100000:2.0:1784047597.415502:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689506816 00000100:00100000:2.0:1784047597.415582:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1479 00000100:00100000:2.0:1784047597.415595:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+38:73544:x1870705689506816:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:2.0:1784047597.415701:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047597.415731:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c77617d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5bd expref: 38 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.415770:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc34a7400) 00010000:00010000:2.0:1784047597.415798:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047597.416234:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.416252:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.416265:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.416381:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e17bd32b reply state 00000000df41c7e6 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.416395:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.416413:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:3.0:1784047597.416416:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.416419:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047597.416528:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+39:73544:x1870705689506816:12345-192.168.204.40@tcp:36:touch.0 Request processed in 925us (1418us total) trans 124554051601 rc 0/0 00000100:00100000:3.0:1784047597.416537:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1479 00000100:00100000:1.0:1784047597.422822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.423335:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689506944 00000100:00100000:2.0:1784047597.423350:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689506944 00000100:00100000:2.0:1784047597.423422:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1480 00000100:00100000:2.0:1784047597.423436:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+39:73544:x1870705689506944:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.423463:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.423485:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c776192 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5c4 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.423564:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c776192 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5c4 expref: 40 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.423582:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a200/0x4426598c0c776192 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5c4 expref: 40 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.423603:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:2.0:1784047597.423633:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047597.423638:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a200, rc 0) 00000100:00100000:2.0:1784047597.423714:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+40:73544:x1870705689506944:12345-192.168.204.40@tcp:101:touch.0 Request processed in 281us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047597.423722:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1480 00000100:00100000:2.0:1784047597.430862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.431121:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689507072 00000100:00100000:0.0:1784047597.431133:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689507072 00000100:00100000:0.0:1784047597.431202:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5018 00000100:00100000:0.0:1784047597.431213:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+8:2401:x1870705689507072:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:0.0:1784047597.431429:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689507072:12345-192.168.204.40@tcp:2:touch.0 Request processed in 217us (577us total) trans 4294968761 rc 0/0 00000100:00100000:0.0:1784047597.431437:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5018 00000100:00100000:1.0:1784047597.437274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.437748:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689507328 00000100:00100000:3.0:1784047597.437760:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689507328 00000100:00100000:3.0:1784047597.437827:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 248 00000100:00100000:3.0:1784047597.437837:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+40:73544:x1870705689507328:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:3.0:1784047597.438161:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+41:73544:x1870705689507328:12345-192.168.204.40@tcp:35:touch.0 Request processed in 324us (896us total) trans 124554051602 rc 0/0 00000100:00100000:3.0:1784047597.438171:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 248 00000100:00100000:1.0:1784047597.450158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.450262:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689507584 00000100:00100000:2.0:1784047597.450275:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689507584 00000100:00100000:2.0:1784047597.450348:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1481 00000100:00100000:2.0:1784047597.450380:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+41:73544:x1870705689507584:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.450412:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.450434:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776199 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5cb expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.450556:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.450574:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.450586:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.450601:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.450661:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.450670:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047597.451025:0:66219:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x786:0x0], index 0: 0 00010000:00010000:2.0:1784047597.451226:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c7761ae lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451236:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c7761ae lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451244:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c7761ae lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451291:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451299:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451305:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451312:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451318:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047597.451322:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451329:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451341:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047597.451344:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047597.451348:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451353:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7761a0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.451366:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070520b25 reply state 00000000a12124c4 transno 124554051603 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451377:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451390:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff99ccc34a7400) 00010000:00010000:2.0:1784047597.451393:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.451395:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047597.451431:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776199 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5cb expref: 44 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451447:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c7761ae lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5cb expref: 43 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.451454:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc34a7800) 00010000:00010000:2.0:1784047597.451457:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047597.451459:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b400, rc 0) 00000100:00100000:2.0:1784047597.451545:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+44:73544:x1870705689507584:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1168us (1396us total) trans 124554051603 rc 0/0 00000100:00100000:2.0:1784047597.451554:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1481 00000100:00100000:2.0:1784047597.461686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.461831:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689507840 00000100:00100000:3.0:1784047597.461842:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689507840 00000100:00100000:3.0:1784047597.461903:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1482 00000100:00100000:3.0:1784047597.461913:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+44:73544:x1870705689507840:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:3.0:1784047597.461989:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047597.462019:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c7761ae lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5cb expref: 44 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.462037:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc34a7800) 00010000:00010000:3.0:1784047597.462058:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047597.462113:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.462145:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.462156:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.462262:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f50bc041 reply state 000000003da758dd transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.462275:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.462281:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:3.0:1784047597.462284:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.462287:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047597.462380:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+45:73544:x1870705689507840:12345-192.168.204.40@tcp:36:touch.0 Request processed in 467us (703us total) trans 124554051604 rc 0/0 00000100:00100000:3.0:1784047597.462387:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1482 00000100:00100000:1.0:1784047597.465673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.466489:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689507968 00000100:00100000:3.0:1784047597.466501:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689507968 00000100:00100000:3.0:1784047597.466639:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1483 00000100:00100000:3.0:1784047597.466659:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+45:73544:x1870705689507968:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.466684:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.466706:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030e00/0x4426598c0c7761c3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5d2 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.466765:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030e00/0x4426598c0c7761c3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5d2 expref: 46 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.466810:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030e00/0x4426598c0c7761c3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5d2 expref: 46 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.466830:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:3.0:1784047597.466834:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047597.466837:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030e00, rc 0) 00000100:00100000:3.0:1784047597.466904:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+46:73544:x1870705689507968:12345-192.168.204.40@tcp:101:touch.0 Request processed in 257us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047597.466913:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1483 00000100:00100000:2.0:1784047597.475262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.475341:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689508096 00000100:00100000:3.0:1784047597.475352:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689508096 00000100:00100000:3.0:1784047597.475414:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5019 00000100:00100000:3.0:1784047597.475424:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689508096:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047597.475688:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+10:2401:x1870705689508096:12345-192.168.204.40@tcp:2:touch.0 Request processed in 264us (437us total) trans 4294968762 rc 0/0 00000100:00100000:3.0:1784047597.475697:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5019 00000100:00100000:1.0:1784047597.480303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.484251:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689508352 00000100:00100000:0.0:1784047597.484267:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689508352 00000100:00100000:0.0:1784047597.484338:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 249 00000100:00100000:0.0:1784047597.484349:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+46:73544:x1870705689508352:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.485467:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+47:73544:x1870705689508352:12345-192.168.204.40@tcp:35:touch.0 Request processed in 1115us (5174us total) trans 124554051605 rc 0/0 00000100:00100000:0.0:1784047597.485478:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 249 00000100:00100000:0.0:1784047597.501863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.502049:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689508608 00000100:00100000:3.0:1784047597.502060:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689508608 00000100:00100000:3.0:1784047597.502167:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1484 00000100:00100000:3.0:1784047597.502179:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+47:73544:x1870705689508608:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.502204:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.502226:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c7761ca lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5d9 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.502342:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.502372:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.502385:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.502415:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.502423:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.502430:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784047597.502795:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x787:0x0], index 0: 0 00010000:00010000:3.0:1784047597.503009:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7761df lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503019:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7761df lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503026:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7761df lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503061:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503068:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503074:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503088:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503094:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047597.503099:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503106:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503118:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:3.0:1784047597.503121:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047597.503125:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503131:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761d1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784047597.503144:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d55d302e reply state 000000003d80dc52 transno 124554051606 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503154:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503160:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff99ccc37d2a00) 00010000:00010000:3.0:1784047597.503162:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047597.503164:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784047597.503196:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c7761ca lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5d9 expref: 50 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503210:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7761df lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5d9 expref: 49 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.503225:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccc37d2c00) 00010000:00010000:3.0:1784047597.503227:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047597.503229:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030000, rc 0) 00000100:00100000:3.0:1784047597.503289:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+50:73544:x1870705689508608:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1111us (1436us total) trans 124554051606 rc 0/0 00000100:00100000:3.0:1784047597.503297:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1484 00000100:00100000:2.0:1784047597.513340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.513464:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689508864 00000100:00100000:1.0:1784047597.513475:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689508864 00000100:00100000:1.0:1784047597.513578:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1485 00000100:00100000:1.0:1784047597.513590:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+50:73544:x1870705689508864:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:1.0:1784047597.513689:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047597.513717:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7761df lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5d9 expref: 50 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.513735:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccc37d2c00) 00010000:00010000:1.0:1784047597.513746:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047597.513818:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.513832:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.513842:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.513957:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be5c562a reply state 00000000164987e3 transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.513976:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.513982:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:1.0:1784047597.513985:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.513988:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047597.514098:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+51:73544:x1870705689508864:12345-192.168.204.40@tcp:36:touch.0 Request processed in 510us (768us total) trans 124554051607 rc 0/0 00000100:00100000:1.0:1784047597.514106:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1485 00000100:00100000:1.0:1784047597.520916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.521017:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689508992 00000100:00100000:3.0:1784047597.521026:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689508992 00000100:00100000:3.0:1784047597.521143:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1486 00000100:00100000:3.0:1784047597.521154:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+51:73544:x1870705689508992:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.521179:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.521201:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c7761f4 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5e0 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.521257:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c7761f4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5e0 expref: 52 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.521272:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031e00/0x4426598c0c7761f4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5e0 expref: 52 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.521290:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:3.0:1784047597.521294:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047597.521298:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031e00, rc 0) 00000100:00100000:3.0:1784047597.521364:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+52:73544:x1870705689508992:12345-192.168.204.40@tcp:101:touch.0 Request processed in 212us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047597.521386:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1486 00000100:00100000:1.0:1784047597.528456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.531850:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689509120 00000100:00100000:3.0:1784047597.531866:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689509120 00000100:00100000:3.0:1784047597.531934:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5020 00000100:00100000:3.0:1784047597.531945:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+10:2401:x1870705689509120:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047597.532307:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+11:2401:x1870705689509120:12345-192.168.204.40@tcp:2:touch.0 Request processed in 362us (3861us total) trans 4294968763 rc 0/0 00000100:00100000:3.0:1784047597.532316:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5020 00000100:00100000:1.0:1784047597.541289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.542232:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689509376 00000100:00100000:3.0:1784047597.542245:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689509376 00000100:00100000:3.0:1784047597.542300:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 250 00000100:00100000:3.0:1784047597.542311:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+52:73544:x1870705689509376:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:3.0:1784047597.542636:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+53:73544:x1870705689509376:12345-192.168.204.40@tcp:35:touch.0 Request processed in 326us (1355us total) trans 124554051608 rc 0/0 00000100:00100000:3.0:1784047597.542645:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 250 00000100:00100000:1.0:1784047597.550411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.550511:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689509632 00000100:00100000:3.0:1784047597.550537:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689509632 00000100:00100000:3.0:1784047597.550638:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1487 00000100:00100000:3.0:1784047597.550650:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+53:73544:x1870705689509632:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.550676:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.550698:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761fb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5e7 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551150:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551167:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551178:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551194:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551201:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551207:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784047597.551502:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x788:0x0], index 0: 0 00010000:00010000:0.0:1784047597.551691:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c776210 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551702:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c776210 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551735:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c776210 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551770:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551777:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551782:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551788:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551794:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047597.551798:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551921:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551933:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047597.551936:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047597.551940:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551946:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c776202 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.551957:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000548fb3c3 reply state 00000000caf63ae6 transno 124554051609 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551973:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.551979:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff99cbc9aa9800) 00010000:00010000:0.0:1784047597.551981:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.551984:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784047597.552013:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c7761fb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5e7 expref: 56 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.552028:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c776210 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5e7 expref: 55 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.552035:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:0.0:1784047597.552037:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047597.552039:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cbc67b5800, rc 0) 00000100:00100000:0.0:1784047597.552110:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+56:73544:x1870705689509632:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1463us (1708us total) trans 124554051609 rc 0/0 00000100:00100000:0.0:1784047597.552123:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1487 00000100:00100000:1.0:1784047597.560709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.560795:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689509888 00000100:00100000:2.0:1784047597.560807:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689509888 00000100:00100000:2.0:1784047597.560869:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1488 00000100:00100000:2.0:1784047597.560880:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+56:73544:x1870705689509888:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:2.0:1784047597.560946:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047597.560975:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c776210 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5e7 expref: 56 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.561011:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:2.0:1784047597.561023:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047597.561084:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.561097:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.561109:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047597.561242:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cfe145d reply state 0000000012588861 transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.561257:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.561263:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:2.0:1784047597.561266:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047597.561269:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784047597.561366:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+57:73544:x1870705689509888:12345-192.168.204.40@tcp:36:touch.0 Request processed in 486us (666us total) trans 124554051610 rc 0/0 00000100:00100000:2.0:1784047597.561373:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1488 00000100:00100000:1.0:1784047597.566356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.566423:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689510016 00000100:00100000:3.0:1784047597.566434:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689510016 00000100:00100000:3.0:1784047597.566505:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1489 00000100:00100000:3.0:1784047597.566525:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+57:73544:x1870705689510016:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:3.0:1784047597.566552:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047597.566586:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c776225 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5ee expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.566676:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c776225 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5ee expref: 58 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.566691:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031200/0x4426598c0c776225 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5ee expref: 58 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047597.566708:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:3.0:1784047597.566711:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784047597.566714:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031200, rc 0) 00000100:00100000:3.0:1784047597.566777:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+58:73544:x1870705689510016:12345-192.168.204.40@tcp:101:touch.0 Request processed in 262us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047597.566784:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1489 00000100:00100000:2.0:1784047597.570463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.570544:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689510144 00000100:00100000:3.0:1784047597.570555:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689510144 00000100:00100000:3.0:1784047597.570639:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5021 00000100:00100000:3.0:1784047597.570649:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+11:2402:x1870705689510144:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047597.570865:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+12:2402:x1870705689510144:12345-192.168.204.40@tcp:2:touch.0 Request processed in 217us (409us total) trans 4294968764 rc 0/0 00000100:00100000:3.0:1784047597.570874:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5021 00000100:00100000:1.0:1784047597.586711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.586881:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689510400 00000100:00100000:3.0:1784047597.586891:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689510400 00000100:00100000:3.0:1784047597.586969:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 251 00000100:00100000:3.0:1784047597.586980:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+58:73544:x1870705689510400:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:3.0:1784047597.587294:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+59:73544:x1870705689510400:12345-192.168.204.40@tcp:35:touch.0 Request processed in 314us (593us total) trans 124554051611 rc 0/0 00000100:00100000:3.0:1784047597.587303:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 251 00000100:00100000:2.0:1784047597.595045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.595246:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689510656 00000100:00100000:0.0:1784047597.595256:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689510656 00000100:00100000:0.0:1784047597.595320:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1490 00000100:00100000:0.0:1784047597.595331:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+59:73544:x1870705689510656:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047597.595357:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.595378:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c77622c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5f5 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.595481:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.595508:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.595530:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.595545:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.595551:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.595556:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784047597.595924:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x789:0x0], index 0: 0 00010000:00010000:1.0:1784047597.600367:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c776241 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600395:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c776241 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600410:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c776241 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600455:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600462:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600467:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600473:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600478:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.600483:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.600489:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.601202:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.601221:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.601228:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.601236:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776233 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.601252:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ba27e85 reply state 0000000070e35122 transno 124554051612 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.601263:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.601269:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff99cbc9aa9a00) 00010000:00010000:1.0:1784047597.601271:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.601275:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.601389:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c77622c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5f5 expref: 62 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.601406:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c776241 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5f5 expref: 61 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.601414:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99ccfebe4e00) 00010000:00010000:1.0:1784047597.601416:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.601419:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29a00, rc 0) 00000100:00100000:1.0:1784047597.601552:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+62:73544:x1870705689510656:12345-192.168.204.40@tcp:101:touch.0 Request processed in 6222us (6519us total) trans 124554051612 rc 0/0 00000100:00100000:1.0:1784047597.601562:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1490 00000100:00100000:2.0:1784047597.607685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.608535:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689510912 00000100:00100000:0.0:1784047597.608553:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689510912 00000100:00100000:0.0:1784047597.608745:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1491 00000100:00100000:0.0:1784047597.608757:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+62:73544:x1870705689510912:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.608834:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.608861:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c776241 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5f5 expref: 62 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.608880:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99ccfebe4e00) 00010000:00010000:0.0:1784047597.608890:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.608948:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.608981:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.608991:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.609112:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000edda7e44 reply state 00000000e075e279 transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.612093:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.612104:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:0.0:1784047597.612107:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.612112:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.612284:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+63:73544:x1870705689510912:12345-192.168.204.40@tcp:36:touch.0 Request processed in 3524us (4609us total) trans 124554051613 rc 0/0 00000100:00100000:0.0:1784047597.612294:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1491 00000100:00100000:0.0:1784047597.621306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.621481:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689511040 00000100:00100000:2.0:1784047597.621491:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689511040 00000100:00100000:2.0:1784047597.621565:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1492 00000100:00100000:2.0:1784047597.621592:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+63:73544:x1870705689511040:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.621645:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.621668:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c776256 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae5fc expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.621734:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c776256 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5fc expref: 64 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.621750:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ba00/0x4426598c0c776256 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae5fc expref: 64 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.621768:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:2.0:1784047597.621771:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047597.621775:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24ba00, rc 0) 00000100:00100000:2.0:1784047597.621851:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+64:73544:x1870705689511040:12345-192.168.204.40@tcp:101:touch.0 Request processed in 263us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047597.621858:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1492 00000100:00100000:2.0:1784047597.628859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.629062:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689511168 00000100:00100000:3.0:1784047597.629078:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689511168 00000100:00100000:3.0:1784047597.629174:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5022 00000100:00100000:3.0:1784047597.629191:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+12:2401:x1870705689511168:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047597.629472:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+13:2401:x1870705689511168:12345-192.168.204.40@tcp:2:touch.0 Request processed in 285us (631us total) trans 4294968765 rc 0/0 00000100:00100000:3.0:1784047597.629481:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5022 00000100:00100000:3.0:1784047597.633491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.633660:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689511424 00000100:00100000:1.0:1784047597.633670:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689511424 00000100:00100000:1.0:1784047597.633746:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 252 00000100:00100000:1.0:1784047597.633756:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+64:73544:x1870705689511424:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:1.0:1784047597.634310:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+65:73544:x1870705689511424:12345-192.168.204.40@tcp:35:touch.0 Request processed in 554us (828us total) trans 124554051614 rc 0/0 00000100:00100000:1.0:1784047597.634319:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 252 00000100:00100000:0.0:1784047597.644061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.644280:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689511680 00000100:00100000:1.0:1784047597.644291:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689511680 00000100:00100000:1.0:1784047597.644357:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1493 00000100:00100000:1.0:1784047597.644369:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+65:73544:x1870705689511680:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.644394:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.644416:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c77625d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae603 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.644558:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.644573:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.644585:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.644599:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.644647:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.644655:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.645333:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78a:0x0], index 0: 0 00010000:00010000:1.0:1784047597.645471:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776272 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645481:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776272 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645489:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776272 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645535:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645543:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645549:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645556:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645562:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.645566:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645573:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645585:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.645588:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.645602:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645634:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776264 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.645648:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca52f0ca reply state 0000000083350048 transno 124554051615 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645660:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.645667:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff99ccfebe4a00) 00010000:00010000:1.0:1784047597.645669:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.645672:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.645705:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c77625d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae603 expref: 68 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.646452:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776272 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae603 expref: 67 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.646463:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047597.646466:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.646468:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29600, rc 0) 00000100:00100000:1.0:1784047597.646556:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+68:73544:x1870705689511680:12345-192.168.204.40@tcp:101:touch.0 Request processed in 2188us (2505us total) trans 124554051615 rc 0/0 00000100:00100000:1.0:1784047597.646565:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1493 00000100:00100000:2.0:1784047597.657192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.657280:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689511936 00000100:00100000:0.0:1784047597.657292:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689511936 00000100:00100000:0.0:1784047597.657355:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1494 00000100:00100000:0.0:1784047597.657365:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+68:73544:x1870705689511936:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.657421:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.657449:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776272 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae603 expref: 68 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.657486:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047597.657497:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.657566:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.657580:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.657590:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.657835:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093b4aa8b reply state 00000000dc35358c transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.657848:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.657855:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:0.0:1784047597.657857:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.657860:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.658021:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+69:73544:x1870705689511936:12345-192.168.204.40@tcp:36:touch.0 Request processed in 657us (837us total) trans 124554051616 rc 0/0 00000100:00100000:0.0:1784047597.658029:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1494 00000100:00100000:3.0:1784047597.665419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.665538:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689512064 00000100:00100000:1.0:1784047597.665548:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689512064 00000100:00100000:1.0:1784047597.665647:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1495 00000100:00100000:1.0:1784047597.665658:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+69:73544:x1870705689512064:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.665697:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.665728:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776287 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae60a expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.665784:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776287 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae60a expref: 70 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.665798:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28400/0x4426598c0c776287 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae60a expref: 70 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.665830:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:1.0:1784047597.665833:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047597.665836:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28400, rc 0) 00000100:00100000:1.0:1784047597.665884:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+70:73544:x1870705689512064:12345-192.168.204.40@tcp:101:touch.0 Request processed in 228us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047597.665891:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1495 00000100:00100000:1.0:1784047597.671730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047597.671898:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689512192 00000100:00100000:2.0:1784047597.671909:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689512192 00000100:00100000:2.0:1784047597.671974:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5023 00000100:00100000:2.0:1784047597.671985:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+13:2401:x1870705689512192:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:2.0:1784047597.672224:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+14:2401:x1870705689512192:12345-192.168.204.40@tcp:2:touch.0 Request processed in 240us (505us total) trans 4294968766 rc 0/0 00000100:00100000:2.0:1784047597.672233:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5023 00000100:00100000:2.0:1784047597.681905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.682029:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689512448 00000100:00100000:0.0:1784047597.682038:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689512448 00000100:00100000:0.0:1784047597.682135:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 253 00000100:00100000:0.0:1784047597.682144:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+70:73544:x1870705689512448:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.682428:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+71:73544:x1870705689512448:12345-192.168.204.40@tcp:35:touch.0 Request processed in 285us (534us total) trans 124554051617 rc 0/0 00000100:00100000:0.0:1784047597.682447:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 253 00000100:00100000:3.0:1784047597.686565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.686669:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689512704 00000100:00100000:1.0:1784047597.686677:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689512704 00000100:00100000:1.0:1784047597.686735:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1496 00000100:00100000:1.0:1784047597.686746:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+71:73544:x1870705689512704:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.686768:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.686789:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c77628e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae611 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.686890:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.686923:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.686935:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.686949:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.686956:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.686963:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.687259:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78b:0x0], index 0: 0 00010000:00010000:1.0:1784047597.687390:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762a3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687400:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687407:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687437:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687445:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687450:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687462:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687469:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.687473:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687480:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687491:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.687494:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.687498:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687505:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776295 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.687530:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f48919b7 reply state 00000000a88fea62 transno 124554051618 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687542:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687548:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff99ccfebe4200) 00010000:00010000:1.0:1784047597.687551:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.687553:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.687582:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c77628e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae611 expref: 74 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687596:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762a3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae611 expref: 73 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.687702:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99ccfebe4600) 00010000:00010000:1.0:1784047597.687705:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.687707:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29400, rc 0) 00000100:00100000:1.0:1784047597.687777:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+74:73544:x1870705689512704:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1032us (1221us total) trans 124554051618 rc 0/0 00000100:00100000:1.0:1784047597.687785:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1496 00000100:00100000:2.0:1784047597.698524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.699043:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689512960 00000100:00100000:0.0:1784047597.699055:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689512960 00000100:00100000:0.0:1784047597.699168:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1497 00000100:00100000:0.0:1784047597.699180:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+74:73544:x1870705689512960:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.699260:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.699289:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762a3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae611 expref: 74 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.699309:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99ccfebe4600) 00010000:00010000:0.0:1784047597.699319:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.699374:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.699387:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.699397:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.699504:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef769426 reply state 00000000756081c8 transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.699528:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.699535:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:0.0:1784047597.699537:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.699547:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.699965:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+75:73544:x1870705689512960:12345-192.168.204.40@tcp:36:touch.0 Request processed in 785us (1458us total) trans 124554051619 rc 0/0 00000100:00100000:0.0:1784047597.699974:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1497 00000100:00100000:2.0:1784047597.718062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.719430:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689513088 00000100:00100000:3.0:1784047597.719443:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689513088 00000100:00100000:2.0:1784047597.719680:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1498 00000100:00100000:2.0:1784047597.719692:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+75:73544:x1870705689513088:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047597.719863:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047597.719889:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c7762b8 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae618 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.719948:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c7762b8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae618 expref: 76 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.719964:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24aa00/0x4426598c0c7762b8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae618 expref: 76 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047597.720059:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:2.0:1784047597.720063:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784047597.720067:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24aa00, rc 0) 00000100:00100000:2.0:1784047597.720523:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+76:73544:x1870705689513088:12345-192.168.204.40@tcp:101:touch.0 Request processed in 822us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047597.720531:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1498 00000100:00100000:3.0:1784047597.723929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.725203:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689513216 00000100:00100000:1.0:1784047597.725215:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689513216 00000100:00100000:1.0:1784047597.725280:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5024 00000100:00100000:1.0:1784047597.725290:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+14:2402:x1870705689513216:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.725531:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+15:2402:x1870705689513216:12345-192.168.204.40@tcp:2:touch.0 Request processed in 241us (1613us total) trans 4294968767 rc 0/0 00000100:00100000:1.0:1784047597.725540:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5024 00000100:00100000:1.0:1784047597.732844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.736730:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689513472 00000100:00100000:3.0:1784047597.736748:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689513472 00000100:00100000:3.0:1784047597.736837:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 254 00000100:00100000:3.0:1784047597.736849:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+76:73544:x1870705689513472:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:3.0:1784047597.737219:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+77:73544:x1870705689513472:12345-192.168.204.40@tcp:35:touch.0 Request processed in 371us (4383us total) trans 124554051620 rc 0/0 00000100:00100000:3.0:1784047597.737229:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 254 00000100:00100000:0.0:1784047597.749728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.749882:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689513728 00000100:00100000:1.0:1784047597.749893:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689513728 00000100:00100000:1.0:1784047597.749969:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1499 00000100:00100000:1.0:1784047597.749982:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+77:73544:x1870705689513728:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.750023:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.750053:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c7762bf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae61f expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750174:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750210:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750225:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750242:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750250:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750257:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.750815:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78c:0x0], index 0: 0 00010000:00010000:1.0:1784047597.750951:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762d4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750961:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.750968:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751000:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751106:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751114:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751132:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751138:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.751141:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751148:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751160:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.751163:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.751167:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751174:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762c6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.751189:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033fe2927 reply state 00000000dc0fedda transno 124554051621 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751200:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751207:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff99ccfebe4700) 00010000:00010000:1.0:1784047597.751209:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.751212:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.751245:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c7762bf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae61f expref: 80 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751260:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762d4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae61f expref: 79 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.751274:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99ccfebe4d00) 00010000:00010000:1.0:1784047597.751277:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.751279:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff29400, rc 0) 00000100:00100000:1.0:1784047597.751355:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+80:73544:x1870705689513728:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1375us (1638us total) trans 124554051621 rc 0/0 00000100:00100000:1.0:1784047597.751364:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1499 00000100:00100000:1.0:1784047597.759067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.759356:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689513984 00000100:00100000:0.0:1784047597.759367:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689513984 00000100:00100000:0.0:1784047597.759545:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1500 00000100:00100000:0.0:1784047597.759558:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+80:73544:x1870705689513984:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.759745:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.759775:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c7762d4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae61f expref: 80 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.759795:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99ccfebe4d00) 00010000:00010000:0.0:1784047597.759805:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.759862:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.759876:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.759885:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.760102:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004012c247 reply state 00000000f7a939eb transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.760116:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.760265:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:0.0:1784047597.760268:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.760271:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.760831:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+81:73544:x1870705689513984:12345-192.168.204.40@tcp:36:touch.0 Request processed in 1274us (1773us total) trans 124554051622 rc 0/0 00000100:00100000:0.0:1784047597.760841:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1500 00000100:00100000:2.0:1784047597.763097:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.763503:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689514112 00000100:00100000:0.0:1784047597.763526:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689514112 00000100:00100000:0.0:1784047597.763665:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1501 00000100:00100000:0.0:1784047597.763678:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+81:73544:x1870705689514112:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047597.763708:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.763732:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7762e9 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae626 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.763797:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7762e9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae626 expref: 82 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.763813:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89e00/0x4426598c0c7762e9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae626 expref: 82 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.763835:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:0.0:1784047597.763838:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784047597.763842:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89e00, rc 0) 00000100:00100000:0.0:1784047597.763895:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+82:73544:x1870705689514112:12345-192.168.204.40@tcp:101:touch.0 Request processed in 220us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047597.763902:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1501 00000100:00100000:2.0:1784047597.771869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.772008:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689514240 00000100:00100000:1.0:1784047597.772019:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689514240 00000100:00100000:1.0:1784047597.772145:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5025 00000100:00100000:1.0:1784047597.772158:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+15:2401:x1870705689514240:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.772642:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+16:2401:x1870705689514240:12345-192.168.204.40@tcp:2:touch.0 Request processed in 486us (789us total) trans 4294968768 rc 0/0 00000100:00100000:1.0:1784047597.772653:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5025 00000100:00100000:1.0:1784047597.776602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.776851:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689514496 00000100:00100000:3.0:1784047597.776875:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689514496 00000100:00100000:3.0:1784047597.776974:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 255 00000100:00100000:3.0:1784047597.776985:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+82:73544:x1870705689514496:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:3.0:1784047597.777340:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+83:73544:x1870705689514496:12345-192.168.204.40@tcp:35:touch.0 Request processed in 354us (747us total) trans 124554051623 rc 0/0 00000100:00100000:3.0:1784047597.777349:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 255 00000100:00100000:2.0:1784047597.784724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.787494:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689514752 00000100:00100000:1.0:1784047597.787522:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689514752 00000100:00100000:1.0:1784047597.787686:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1502 00000100:00100000:1.0:1784047597.787698:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+83:73544:x1870705689514752:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.787725:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.787750:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762f0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae62d expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.787860:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.787899:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.787913:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.787930:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.787938:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.787945:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.790965:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78d:0x0], index 0: 0 00010000:00010000:1.0:1784047597.792726:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776305 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792748:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776305 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792760:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776305 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792804:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792811:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792817:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792836:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792843:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.792858:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792868:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792882:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.792885:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.792890:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792897:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c7762f7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.792912:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001eb442f5 reply state 000000001f7cf7ae transno 124554051624 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792923:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.792929:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff99ccfebe4100) 00010000:00010000:1.0:1784047597.792932:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.792935:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.794239:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c7762f0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae62d expref: 86 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.794277:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776305 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae62d expref: 85 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.794316:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99ccfebe4b00) 00010000:00010000:1.0:1784047597.794318:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.794322:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28200, rc 0) 00000100:00100000:1.0:1784047597.794430:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+86:73544:x1870705689514752:12345-192.168.204.40@tcp:101:touch.0 Request processed in 6732us (9715us total) trans 124554051624 rc 0/0 00000100:00100000:1.0:1784047597.794440:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1502 00000100:00100000:2.0:1784047597.799392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.799466:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689515008 00000100:00100000:0.0:1784047597.799477:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689515008 00000100:00100000:0.0:1784047597.799554:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1503 00000100:00100000:0.0:1784047597.799566:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+86:73544:x1870705689515008:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.799656:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.799687:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776305 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae62d expref: 86 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.799708:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99ccfebe4b00) 00010000:00010000:0.0:1784047597.799720:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.799784:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.799798:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.799809:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.799920:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fbe80e8 reply state 00000000efc1e6ed transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.799933:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.799939:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047597.799942:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.799945:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.802726:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+87:73544:x1870705689515008:12345-192.168.204.40@tcp:36:touch.0 Request processed in 3150us (3342us total) trans 124554051625 rc 0/0 00000100:00100000:0.0:1784047597.802760:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1503 00000100:00100000:2.0:1784047597.807700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.807811:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689515136 00000100:00100000:0.0:1784047597.807822:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689515136 00000100:00100000:0.0:1784047597.807891:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1504 00000100:00100000:0.0:1784047597.807903:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+87:73544:x1870705689515136:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047597.807941:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.807964:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77631a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae634 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.808033:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77631a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae634 expref: 88 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.808048:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89000/0x4426598c0c77631a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae634 expref: 88 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.808066:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047597.808069:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784047597.808074:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89000, rc 0) 00000100:00100000:0.0:1784047597.808144:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+88:73544:x1870705689515136:12345-192.168.204.40@tcp:101:touch.0 Request processed in 234us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047597.808151:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1504 00000100:00100000:2.0:1784047597.816070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.816333:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689515264 00000100:00100000:1.0:1784047597.816344:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689515264 00000100:00100000:1.0:1784047597.816427:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5026 00000100:00100000:1.0:1784047597.816439:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+16:2402:x1870705689515264:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.816741:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+17:2402:x1870705689515264:12345-192.168.204.40@tcp:2:touch.0 Request processed in 303us (681us total) trans 4294968769 rc 0/0 00000100:00100000:1.0:1784047597.816748:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5026 00000100:00100000:3.0:1784047597.821679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.822333:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689515520 00000100:00100000:0.0:1784047597.822345:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689515520 00000100:00100000:0.0:1784047597.822424:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 256 00000100:00100000:0.0:1784047597.822435:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+88:73544:x1870705689515520:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.823100:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+89:73544:x1870705689515520:12345-192.168.204.40@tcp:35:touch.0 Request processed in 664us (1425us total) trans 124554051626 rc 0/0 00000100:00100000:0.0:1784047597.823123:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 256 00000100:00100000:2.0:1784047597.829875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.830197:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689515776 00000100:00100000:1.0:1784047597.830206:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689515776 00000100:00100000:1.0:1784047597.830290:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1505 00000100:00100000:1.0:1784047597.830302:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+89:73544:x1870705689515776:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.830328:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.830351:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776321 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae63b expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.830477:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.830493:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.830529:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.830547:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.830553:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.830560:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.831677:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78e:0x0], index 0: 0 00010000:00010000:1.0:1784047597.832153:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776336 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832170:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776336 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832181:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776336 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832220:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832229:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832235:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832242:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832548:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.832552:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832560:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832573:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.832576:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.832581:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832587:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776328 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.832601:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df600eb6 reply state 00000000a5c35585 transno 124554051627 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832657:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832663:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff99ccfebe4400) 00010000:00010000:1.0:1784047597.832665:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.832667:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.832702:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776321 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae63b expref: 92 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832726:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776336 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae63b expref: 91 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.832747:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:1.0:1784047597.832749:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.832751:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cceff28200, rc 0) 00000100:00100000:1.0:1784047597.832828:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+92:73544:x1870705689515776:12345-192.168.204.40@tcp:101:touch.0 Request processed in 2527us (2979us total) trans 124554051627 rc 0/0 00000100:00100000:1.0:1784047597.832837:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1505 00000100:00100000:1.0:1784047597.847794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.848412:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689516032 00000100:00100000:0.0:1784047597.848424:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689516032 00000100:00100000:0.0:1784047597.848491:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1506 00000100:00100000:0.0:1784047597.848503:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+92:73544:x1870705689516032:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.848586:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.848650:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776336 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae63b expref: 92 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.848671:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:0.0:1784047597.848685:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.848757:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.848772:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.848782:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.848897:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016e6ab46 reply state 000000000cc22873 transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.848912:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.848918:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:0.0:1784047597.848920:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.848940:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.849176:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+93:73544:x1870705689516032:12345-192.168.204.40@tcp:36:touch.0 Request processed in 674us (1392us total) trans 124554051628 rc 0/0 00000100:00100000:0.0:1784047597.849184:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1506 00010000:00010000:2.0:1784047597.853148:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047597.856389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.856568:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689516160 00000100:00100000:0.0:1784047597.856582:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689516160 00000100:00100000:0.0:1784047597.856812:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1507 00000100:00100000:0.0:1784047597.856824:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+93:73544:x1870705689516160:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047597.856860:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.856884:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89200/0x4426598c0c77634b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae642 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.856960:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89200/0x4426598c0c77634b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae642 expref: 94 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.856978:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89200/0x4426598c0c77634b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae642 expref: 94 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.857000:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:0.0:1784047597.857004:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784047597.857007:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89200, rc 0) 00000100:00100000:0.0:1784047597.857125:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+94:73544:x1870705689516160:12345-192.168.204.40@tcp:101:touch.0 Request processed in 302us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047597.857133:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1507 00000100:00100000:3.0:1784047597.863121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.863214:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689516288 00000100:00100000:1.0:1784047597.863225:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689516288 00000100:00100000:0.0:1784047597.863367:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5027 00000100:00100000:0.0:1784047597.863380:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+17:2401:x1870705689516288:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:0.0:1784047597.864190:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+18:2401:x1870705689516288:12345-192.168.204.40@tcp:2:touch.0 Request processed in 811us (1076us total) trans 4294968770 rc 0/0 00000100:00100000:0.0:1784047597.864213:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5027 00000100:00100000:1.0:1784047597.870359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.870702:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689516544 00000100:00100000:3.0:1784047597.870713:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689516544 00000100:00100000:3.0:1784047597.870882:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 257 00000100:00100000:3.0:1784047597.870894:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+94:73544:x1870705689516544:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:3.0:1784047597.871301:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+95:73544:x1870705689516544:12345-192.168.204.40@tcp:35:touch.0 Request processed in 407us (1022us total) trans 124554051629 rc 0/0 00000100:00100000:3.0:1784047597.871310:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 257 00000100:00100000:2.0:1784047597.875343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.875459:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689516800 00000100:00100000:1.0:1784047597.875470:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689516800 00000100:00100000:1.0:1784047597.875545:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1508 00000100:00100000:1.0:1784047597.875691:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+95:73544:x1870705689516800:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.875778:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.875802:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776352 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae649 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.875919:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.875935:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.876018:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.876038:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.876060:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.876068:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.877088:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78f:0x0], index 0: 0 00010000:00010000:1.0:1784047597.877245:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c776367 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877258:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c776367 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877267:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c776367 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877447:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877456:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877463:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877470:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877477:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.877482:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877509:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877537:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.877540:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.877544:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877550:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28200/0x4426598c0c776359 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.877659:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a4b6db7 reply state 00000000a8e28432 transno 124554051630 ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877672:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877678:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff99ccfebe4300) 00010000:00010000:1.0:1784047597.877680:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.877683:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.877787:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29600/0x4426598c0c776352 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae649 expref: 98 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877806:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c776367 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae649 expref: 97 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.877814:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:1.0:1784047597.877816:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.877818:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce000, rc 0) 00000100:00100000:1.0:1784047597.878042:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+98:73544:x1870705689516800:12345-192.168.204.40@tcp:101:touch.0 Request processed in 2486us (2770us total) trans 124554051630 rc 0/0 00000100:00100000:1.0:1784047597.878052:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1508 00000100:00100000:3.0:1784047597.882831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.882917:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689517056 00000100:00100000:0.0:1784047597.882928:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689517056 00000100:00100000:0.0:1784047597.883002:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1509 00000100:00100000:0.0:1784047597.883013:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+98:73544:x1870705689517056:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.883086:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.883118:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce000/0x4426598c0c776367 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae649 expref: 98 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.883137:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:0.0:1784047597.883150:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.883215:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.883227:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.883236:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.883600:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b26de97b reply state 000000007303b57a transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.883789:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.883797:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:0.0:1784047597.883799:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.883817:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.883923:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+99:73544:x1870705689517056:12345-192.168.204.40@tcp:36:touch.0 Request processed in 909us (1100us total) trans 124554051631 rc 0/0 00000100:00100000:0.0:1784047597.883931:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1509 00000100:00100000:2.0:1784047597.888838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.888922:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689517184 00000100:00100000:1.0:1784047597.888932:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689517184 00000100:00100000:1.0:1784047597.889004:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1510 00000100:00100000:1.0:1784047597.889016:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+99:73544:x1870705689517184:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.889042:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.889066:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c77637c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae650 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.889133:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c77637c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae650 expref: 100 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.889150:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf800/0x4426598c0c77637c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae650 expref: 100 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.889169:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:1.0:1784047597.889172:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047597.889175:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf800, rc 0) 00000100:00100000:1.0:1784047597.889425:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+100:73544:x1870705689517184:12345-192.168.204.40@tcp:101:touch.0 Request processed in 410us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047597.889432:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1510 00000100:00100000:2.0:1784047597.893970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.894099:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689517312 00000100:00100000:1.0:1784047597.894111:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689517312 00000100:00100000:1.0:1784047597.894179:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5028 00000100:00100000:1.0:1784047597.894190:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+18:2401:x1870705689517312:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.894441:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+19:2401:x1870705689517312:12345-192.168.204.40@tcp:2:touch.0 Request processed in 252us (480us total) trans 4294968771 rc 0/0 00000100:00100000:1.0:1784047597.894449:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5028 00000100:00100000:2.0:1784047597.898316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.898482:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689517568 00000100:00100000:0.0:1784047597.898494:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689517568 00000100:00100000:0.0:1784047597.898575:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 258 00000100:00100000:0.0:1784047597.898587:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+100:73544:x1870705689517568:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.898935:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+101:73544:x1870705689517568:12345-192.168.204.40@tcp:35:touch.0 Request processed in 349us (626us total) trans 124554051632 rc 0/0 00000100:00100000:0.0:1784047597.898943:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 258 00000100:00100000:2.0:1784047597.902505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.902642:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689517824 00000100:00100000:1.0:1784047597.902652:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689517824 00000100:00100000:1.0:1784047597.902713:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1511 00000100:00100000:1.0:1784047597.902734:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+101:73544:x1870705689517824:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.902759:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.902781:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfe00/0x4426598c0c776383 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae657 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.902904:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.902920:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.902933:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.902960:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.902968:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.902975:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.903469:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x790:0x0], index 0: 0 00010000:00010000:1.0:1784047597.903670:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776398 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.903680:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776398 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.903688:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776398 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904101:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904110:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904116:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904123:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904129:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.904133:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904142:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904156:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.904160:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.904164:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904184:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77638a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.904199:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005951089d reply state 00000000bc489ab7 transno 124554051633 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904212:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.904218:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff99ccfebe4b00) 00010000:00010000:1.0:1784047597.904221:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.904224:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.904262:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfe00/0x4426598c0c776383 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae657 expref: 104 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.905063:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776398 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae657 expref: 103 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.905075:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99ccfebe4d00) 00010000:00010000:1.0:1784047597.905077:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.905080:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce200, rc 0) 00000100:00100000:1.0:1784047597.905172:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+104:73544:x1870705689517824:12345-192.168.204.40@tcp:101:touch.0 Request processed in 2438us (2676us total) trans 124554051633 rc 0/0 00000100:00100000:1.0:1784047597.905182:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1511 00000100:00100000:2.0:1784047597.911027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.911110:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689518080 00000100:00100000:0.0:1784047597.911122:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689518080 00000100:00100000:0.0:1784047597.911204:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1512 00000100:00100000:0.0:1784047597.911215:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+104:73544:x1870705689518080:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.911286:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.911314:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776398 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae657 expref: 104 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.911332:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99ccfebe4d00) 00010000:00010000:0.0:1784047597.911343:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.911847:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.911863:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.911873:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.911999:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053e1ad96 reply state 00000000cb0891f9 transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.912012:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.912020:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:0.0:1784047597.912022:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.912026:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.912130:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+105:73544:x1870705689518080:12345-192.168.204.40@tcp:36:touch.0 Request processed in 915us (1111us total) trans 124554051634 rc 0/0 00000100:00100000:0.0:1784047597.912139:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1512 00000100:00100000:2.0:1784047597.915825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.915909:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689518208 00000100:00100000:1.0:1784047597.915920:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689518208 00000100:00100000:1.0:1784047597.915990:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1513 00000100:00100000:1.0:1784047597.916002:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+105:73544:x1870705689518208:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.916043:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.916073:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfe00/0x4426598c0c7763ad lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae65e expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.916139:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfe00/0x4426598c0c7763ad lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae65e expref: 106 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.916154:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfe00/0x4426598c0c7763ad lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae65e expref: 106 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.916174:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:1.0:1784047597.916177:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047597.916181:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfe00, rc 0) 00000100:00100000:1.0:1784047597.916251:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+106:73544:x1870705689518208:12345-192.168.204.40@tcp:101:touch.0 Request processed in 252us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047597.916259:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1513 00000100:00100000:2.0:1784047597.919538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047597.919635:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689518336 00000100:00100000:3.0:1784047597.919649:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689518336 00000100:00100000:3.0:1784047597.919714:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5029 00000100:00100000:3.0:1784047597.919733:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+19:2401:x1870705689518336:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047597.920356:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+20:2401:x1870705689518336:12345-192.168.204.40@tcp:2:touch.0 Request processed in 622us (825us total) trans 4294968772 rc 0/0 00000100:00100000:3.0:1784047597.920364:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5029 00000100:00100000:3.0:1784047597.924427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.924879:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689518592 00000100:00100000:0.0:1784047597.924890:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689518592 00000100:00100000:0.0:1784047597.924954:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 259 00000100:00100000:0.0:1784047597.924964:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+106:73544:x1870705689518592:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.925242:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+107:73544:x1870705689518592:12345-192.168.204.40@tcp:35:touch.0 Request processed in 278us (824us total) trans 124554051635 rc 0/0 00000100:00100000:0.0:1784047597.925250:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 259 00000100:00100000:2.0:1784047597.930475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.930688:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689518848 00000100:00100000:1.0:1784047597.930698:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689518848 00000100:00100000:1.0:1784047597.930780:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1514 00000100:00100000:1.0:1784047597.930793:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+107:73544:x1870705689518848:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.930818:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.930840:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c7763b4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae665 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.930944:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.930971:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.931000:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.931017:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.931024:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.931030:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.932785:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x791:0x0], index 0: 0 00010000:00010000:1.0:1784047597.933113:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7763c9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933129:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7763c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933220:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7763c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933269:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933678:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933685:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933692:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933712:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cec00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.933789:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933797:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933811:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.933814:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.933818:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933825:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763bb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047597.933843:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da4cf7df reply state 000000001e4d2d7e transno 124554051636 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933855:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933861:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff99ccfebe4600) 00010000:00010000:1.0:1784047597.933863:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.933867:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.933910:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c7763b4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae665 expref: 110 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.933925:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7763c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae665 expref: 109 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.934027:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047597.934030:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.934033:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf000, rc 0) 00000100:00100000:1.0:1784047597.934204:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+110:73544:x1870705689518848:12345-192.168.204.40@tcp:101:touch.0 Request processed in 3413us (3737us total) trans 124554051636 rc 0/0 00000100:00100000:1.0:1784047597.934214:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1514 00000100:00100000:1.0:1784047597.941792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.941896:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689519104 00000100:00100000:0.0:1784047597.941906:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689519104 00000100:00100000:0.0:1784047597.942072:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1515 00000100:00100000:0.0:1784047597.942085:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+110:73544:x1870705689519104:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.942707:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.942807:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7763c9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae665 expref: 110 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.942850:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047597.942863:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.942924:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.942937:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.943126:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.944899:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e40672be reply state 0000000045066831 transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.944921:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.944931:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:0.0:1784047597.944934:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.944937:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.945206:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+111:73544:x1870705689519104:12345-192.168.204.40@tcp:36:touch.0 Request processed in 3111us (3486us total) trans 124554051637 rc 0/0 00000100:00100000:0.0:1784047597.945217:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1515 00000100:00100000:2.0:1784047597.950830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.950909:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689519232 00000100:00100000:0.0:1784047597.950920:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689519232 00000100:00100000:0.0:1784047597.950996:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1516 00000100:00100000:0.0:1784047597.951007:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+111:73544:x1870705689519232:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047597.951035:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047597.951070:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88c00/0x4426598c0c7763de lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae66c expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.951133:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88c00/0x4426598c0c7763de lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae66c expref: 112 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.951149:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88c00/0x4426598c0c7763de lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae66c expref: 112 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.951164:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:0.0:1784047597.951167:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784047597.951170:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88c00, rc 0) 00000100:00100000:0.0:1784047597.951230:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+112:73544:x1870705689519232:12345-192.168.204.40@tcp:101:touch.0 Request processed in 225us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047597.951237:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1516 00000100:00100000:2.0:1784047597.957563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.957669:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689519360 00000100:00100000:0.0:1784047597.957678:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689519360 00000100:00100000:0.0:1784047597.957739:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5030 00000100:00100000:0.0:1784047597.957748:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+20:2399:x1870705689519360:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:0.0:1784047597.957964:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+21:2399:x1870705689519360:12345-192.168.204.40@tcp:2:touch.0 Request processed in 215us (409us total) trans 4294968773 rc 0/0 00000100:00100000:0.0:1784047597.957973:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5030 00000100:00100000:2.0:1784047597.963669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.963758:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689519616 00000100:00100000:0.0:1784047597.963768:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689519616 00000100:00100000:0.0:1784047597.963826:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 260 00000100:00100000:0.0:1784047597.963837:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+112:73544:x1870705689519616:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047597.964434:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+113:73544:x1870705689519616:12345-192.168.204.40@tcp:35:touch.0 Request processed in 596us (772us total) trans 124554051638 rc 0/0 00000100:00100000:0.0:1784047597.964458:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 260 00000100:00100000:2.0:1784047597.968360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.968648:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689519872 00000100:00100000:1.0:1784047597.968663:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689519872 00000100:00100000:1.0:1784047597.968744:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1517 00000100:00100000:1.0:1784047597.968755:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+113:73544:x1870705689519872:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.968783:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.968807:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c7763e5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae673 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.968970:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.968986:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.968998:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969012:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969018:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969032:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047597.969646:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x792:0x0], index 0: 0 00010000:00010000:1.0:1784047597.969808:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7763fa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969820:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7763fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969828:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7763fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969862:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969870:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969876:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969883:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969890:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cec00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047597.969895:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969902:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969927:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047597.969930:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047597.969934:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.969940:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c7763ec lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047597.970727:0:94386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94386:1870705709416192:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784047597.970818:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047597.970852:0:94386:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc909bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047597.970986:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416192 00000100:00100000:0.0:1784047597.970993:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416192 00000004:00010000:1.0:1784047597.971152:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d28c48b reply state 000000008642ec2e transno 124554051639 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.971166:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.971173:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff99ccfebe4e00) 00010000:00010000:1.0:1784047597.971175:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047597.971178:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047597.971219:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c7763e5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae673 expref: 116 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.971234:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7763fa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae673 expref: 115 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.971243:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047597.971245:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047597.971247:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce800, rc 0) 00000100:00100000:1.0:1784047597.971312:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+116:73544:x1870705689519872:12345-192.168.204.40@tcp:101:touch.0 Request processed in 2558us (2962us total) trans 124554051639 rc 0/0 00000100:00100000:1.0:1784047597.971320:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1517 00000100:00100000:0.0:1784047597.971763:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031 00000100:00100000:0.0:1784047597.971774:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94386:x1870705709416192:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784047597.971814:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1954 00000100:00080000:2.0:1784047597.973041:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047597.980804:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94386:x1870705709416192:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9026us (9979us total) trans 4294968774 rc 0/0 00000100:00100000:1.0:1784047597.980819:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031 00000100:00100000:2.0:1784047597.981501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047597.981649:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689520128 00000100:00100000:0.0:1784047597.981662:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689520128 00000100:00100000:0.0:1784047597.981733:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1518 00000100:00100000:0.0:1784047597.981742:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+116:73544:x1870705689520128:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:0.0:1784047597.981798:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047597.981826:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7763fa lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae673 expref: 116 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.981844:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047597.981862:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047597.981923:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.981938:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.982122:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047597.982237:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065a6883d reply state 0000000020baf987 transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.982286:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047597.982295:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:0.0:1784047597.982298:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047597.982300:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047597.982587:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+117:73544:x1870705689520128:12345-192.168.204.40@tcp:36:touch.0 Request processed in 844us (1088us total) trans 124554051640 rc 0/0 00000100:00100000:0.0:1784047597.982595:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1518 00000100:00100000:3.0:1784047597.984442:0:94386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfde0c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94386:1870705709416192:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784047597.984479:0:94386:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x792:0x0]-[0x280000401:0x7c1:0x0] 00000100:00100000:2.0:1784047597.986920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.987257:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689520256 00000100:00100000:1.0:1784047597.987280:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689520256 00000100:00100000:1.0:1784047597.987368:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1519 00000100:00100000:1.0:1784047597.987381:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+117:73544:x1870705689520256:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047597.987413:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047597.987438:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77640f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae67a expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.987520:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77640f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae67a expref: 118 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.987538:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfc00/0x4426598c0c77640f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae67a expref: 118 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047597.987558:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:1.0:1784047597.987561:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047597.987566:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cfc00, rc 0) 00000100:00100000:1.0:1784047597.987892:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+118:73544:x1870705689520256:12345-192.168.204.40@tcp:101:touch.0 Request processed in 512us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047597.987900:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1519 00000100:00100000:2.0:1784047597.996482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047597.997351:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689520384 00000100:00100000:1.0:1784047597.997364:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689520384 00000100:00100000:1.0:1784047597.997432:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5032 00000100:00100000:1.0:1784047597.997444:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+21:2401:x1870705689520384:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047597.998248:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+22:2401:x1870705689520384:12345-192.168.204.40@tcp:2:touch.0 Request processed in 803us (1771us total) trans 4294968775 rc 0/0 00000100:00100000:1.0:1784047597.998259:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5032 00000100:00100000:2.0:1784047598.005319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047598.005520:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689520640 00000100:00100000:0.0:1784047598.005531:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689520640 00000100:00100000:0.0:1784047598.005678:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 261 00000100:00100000:0.0:1784047598.005689:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+118:73544:x1870705689520640:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047598.006152:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+119:73544:x1870705689520640:12345-192.168.204.40@tcp:35:touch.0 Request processed in 463us (842us total) trans 124554051641 rc 0/0 00000100:00100000:0.0:1784047598.006161:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 261 00000100:00100000:2.0:1784047598.011028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.011243:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689520896 00000100:00100000:1.0:1784047598.011255:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689520896 00000100:00100000:1.0:1784047598.011401:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1520 00000100:00100000:1.0:1784047598.011413:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+119:73544:x1870705689520896:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047598.011440:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047598.011462:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c776416 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae681 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.011596:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.011649:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.011662:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.011680:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.011688:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.011700:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047598.012034:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x793:0x0], index 0: 0 00010000:00010000:1.0:1784047598.012205:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77642b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012215:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77642b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012224:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77642b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012259:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012267:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012273:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012281:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012288:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cee00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.012292:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012299:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012311:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047598.012314:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.012318:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012334:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77641d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047598.012348:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3c144d9 reply state 000000000f962096 transno 124554051642 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012358:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012363:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff99ccfebe4d00) 00010000:00010000:1.0:1784047598.012366:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047598.012368:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047598.012411:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c776416 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae681 expref: 122 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012423:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77642b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae681 expref: 121 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.012431:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:1.0:1784047598.012433:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047598.012435:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce600, rc 0) 00000100:00100000:1.0:1784047598.012500:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+122:73544:x1870705689520896:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1089us (1481us total) trans 124554051642 rc 0/0 00000100:00100000:1.0:1784047598.012519:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1520 00000100:00100000:2.0:1784047598.017555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.017698:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689521152 00000100:00100000:1.0:1784047598.017707:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689521152 00000100:00100000:1.0:1784047598.017805:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1521 00000100:00100000:1.0:1784047598.017817:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+122:73544:x1870705689521152:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:1.0:1784047598.017894:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047598.017922:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77642b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae681 expref: 122 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.017942:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:1.0:1784047598.017952:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047598.018009:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.018022:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.018032:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047598.018157:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001204d0c2 reply state 00000000cb454da5 transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.018170:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.018176:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047598.018179:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047598.018181:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047598.018277:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+123:73544:x1870705689521152:12345-192.168.204.40@tcp:36:touch.0 Request processed in 462us (732us total) trans 124554051643 rc 0/0 00000100:00100000:1.0:1784047598.018285:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1521 00000100:00100000:2.0:1784047598.023249:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.023326:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689521280 00000100:00100000:1.0:1784047598.023337:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689521280 00000100:00100000:1.0:1784047598.023401:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1522 00000100:00100000:1.0:1784047598.023426:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+123:73544:x1870705689521280:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047598.023450:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047598.023471:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c776440 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae688 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.023541:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c776440 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae688 expref: 124 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.023556:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cec00/0x4426598c0c776440 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae688 expref: 124 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.023573:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047598.023575:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784047598.023579:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cec00, rc 0) 00000100:00100000:1.0:1784047598.023660:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+124:73544:x1870705689521280:12345-192.168.204.40@tcp:101:touch.0 Request processed in 235us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047598.023667:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1522 00000100:00100000:3.0:1784047598.027772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.028100:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689521408 00000100:00100000:1.0:1784047598.028112:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689521408 00000100:00100000:2.0:1784047598.028260:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5033 00000100:00100000:2.0:1784047598.028287:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+22:2402:x1870705689521408:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:2.0:1784047598.028695:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+23:2402:x1870705689521408:12345-192.168.204.40@tcp:2:touch.0 Request processed in 410us (931us total) trans 4294968776 rc 0/0 00000100:00100000:2.0:1784047598.028703:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5033 00000100:00100000:2.0:1784047598.031143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.031282:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689521664 00000100:00100000:1.0:1784047598.031292:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689521664 00000100:00100000:1.0:1784047598.032020:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 262 00000100:00100000:1.0:1784047598.032035:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+124:73544:x1870705689521664:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:1.0:1784047598.033027:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+125:73544:x1870705689521664:12345-192.168.204.40@tcp:35:touch.0 Request processed in 993us (1892us total) trans 124554051644 rc 0/0 00000100:00100000:1.0:1784047598.033037:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 262 00000100:00100000:0.0:1784047598.042070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047598.042125:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689521920 00000100:00100000:2.0:1784047598.042135:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689521920 00000100:00100000:2.0:1784047598.042203:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1523 00000100:00100000:2.0:1784047598.042214:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+125:73544:x1870705689521920:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:2.0:1784047598.042239:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047598.042261:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776447 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae68f expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.042400:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.042416:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.042429:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.042444:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.042451:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.042458:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784047598.042897:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x794:0x0], index 0: 0 00010000:00010000:2.0:1784047598.043037:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77645c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043047:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77645c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043354:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77645c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043396:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043403:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043413:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043419:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043425:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047598.043429:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043436:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043448:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047598.043451:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047598.043546:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.043708:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c77644e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047598.043998:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050f734de reply state 0000000012ddf154 transno 124554051645 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.044011:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.044018:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff99ccc34a7b00) 00010000:00010000:2.0:1784047598.044020:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047598.044024:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784047598.044063:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776447 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae68f expref: 128 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.044078:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77645c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae68f expref: 127 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047598.044086:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:2.0:1784047598.044089:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047598.044091:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b200, rc 0) 00000100:00100000:2.0:1784047598.044167:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+128:73544:x1870705689521920:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1952us (2106us total) trans 124554051645 rc 0/0 00000100:00100000:2.0:1784047598.044177:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1523 00000100:00100000:3.0:1784047598.050049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.050404:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689522176 00000100:00100000:1.0:1784047598.050430:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689522176 00000100:00100000:1.0:1784047598.050577:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1524 00000100:00100000:1.0:1784047598.050589:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+128:73544:x1870705689522176:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:1.0:1784047598.050696:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047598.050740:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b200/0x4426598c0c77645c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae68f expref: 128 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.050760:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccc34a7600) 00010000:00010000:1.0:1784047598.050784:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047598.051078:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.051096:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.051106:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047598.051233:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005276d378 reply state 000000009679c301 transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.051246:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.051252:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:1.0:1784047598.051255:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047598.051257:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047598.051412:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+129:73544:x1870705689522176:12345-192.168.204.40@tcp:36:touch.0 Request processed in 824us (1373us total) trans 124554051646 rc 0/0 00000100:00100000:1.0:1784047598.051421:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1524 00000100:00100000:2.0:1784047598.055202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047598.055289:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689522304 00000100:00100000:0.0:1784047598.055299:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689522304 00000100:00100000:0.0:1784047598.055390:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1525 00000100:00100000:0.0:1784047598.055400:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+129:73544:x1870705689522304:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047598.055421:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047598.055440:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c776471 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae696 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047598.055492:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c776471 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae696 expref: 130 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047598.055531:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88000/0x4426598c0c776471 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae696 expref: 130 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047598.056008:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:0.0:1784047598.056013:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784047598.056017:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88000, rc 0) 00000100:00100000:0.0:1784047598.056070:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+130:73544:x1870705689522304:12345-192.168.204.40@tcp:101:touch.0 Request processed in 672us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.056077:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1525 00000100:00100000:2.0:1784047598.059733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047598.060031:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689522432 00000100:00100000:3.0:1784047598.060041:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689522432 00000100:00100000:3.0:1784047598.060107:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5034 00000100:00100000:3.0:1784047598.060119:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+23:2400:x1870705689522432:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:3.0:1784047598.060420:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+24:2400:x1870705689522432:12345-192.168.204.40@tcp:2:touch.0 Request processed in 302us (708us total) trans 4294968777 rc 0/0 00000100:00100000:3.0:1784047598.060429:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5034 00000100:00100000:2.0:1784047598.064228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047598.064350:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689522688 00000100:00100000:0.0:1784047598.064361:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689522688 00000100:00100000:0.0:1784047598.064461:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 263 00000100:00100000:0.0:1784047598.064472:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+130:73544:x1870705689522688:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:0.0:1784047598.065144:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+131:73544:x1870705689522688:12345-192.168.204.40@tcp:35:touch.0 Request processed in 671us (922us total) trans 124554051647 rc 0/0 00000100:00100000:0.0:1784047598.065154:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 263 00000100:00100000:2.0:1784047598.068548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.068668:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689522944 00000100:00100000:1.0:1784047598.068678:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689522944 00000100:00100000:1.0:1784047598.068754:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1526 00000100:00100000:1.0:1784047598.068764:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+131:73544:x1870705689522944:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:1.0:1784047598.068802:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047598.068827:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c776478 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae69d expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.068930:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.068947:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.068956:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.068973:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.068979:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.068986:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784047598.069335:0:66220:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x795:0x0], index 0: 0 00010000:00010000:1.0:1784047598.069472:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77648d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069481:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77648d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069498:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77648d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069560:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069568:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069573:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069581:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069587:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.069592:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069599:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069638:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047598.069641:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.069646:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069653:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf200/0x4426598c0c77647f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047598.069667:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004469752e reply state 00000000f6014f20 transno 124554051648 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069689:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069695:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff99cd02171a00) 00010000:00010000:1.0:1784047598.069697:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047598.069700:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047598.069731:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c776478 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae69d expref: 134 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069745:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77648d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae69d expref: 133 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.069751:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171f00) 00010000:00010000:1.0:1784047598.069753:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047598.069755:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf000, rc 0) 00000100:00100000:1.0:1784047598.069820:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+134:73544:x1870705689522944:12345-192.168.204.40@tcp:101:touch.0 Request processed in 1057us (1282us total) trans 124554051648 rc 0/0 00000100:00100000:1.0:1784047598.069827:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1526 00000100:00100000:2.0:1784047598.074139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.074218:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689523200 00000100:00100000:1.0:1784047598.074229:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689523200 00000100:00100000:1.0:1784047598.074294:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1527 00000100:00100000:1.0:1784047598.074304:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+134:73544:x1870705689523200:12345-192.168.204.40@tcp:36:touch.0 00010000:00010000:1.0:1784047598.074364:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047598.074405:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c77648d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae69d expref: 134 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.074422:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171f00) 00010000:00010000:1.0:1784047598.074445:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047598.074500:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.074523:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.074534:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784047598.074683:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006642c266 reply state 0000000028d8fd0f transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.074696:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.074703:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:1.0:1784047598.074705:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047598.074708:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047598.075564:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+135:73544:x1870705689523200:12345-192.168.204.40@tcp:36:touch.0 Request processed in 1249us (1422us total) trans 124554051649 rc 0/0 00000100:00100000:1.0:1784047598.075574:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1527 00000100:00100000:2.0:1784047598.084169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047598.084329:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689523328 00000100:00100000:0.0:1784047598.084338:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689523328 00000100:00100000:0.0:1784047598.084459:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1528 00000100:00100000:0.0:1784047598.084470:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+135:73544:x1870705689523328:12345-192.168.204.40@tcp:101:touch.0 00010000:00010000:0.0:1784047598.084494:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047598.084529:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db000/0x4426598c0c7764a2 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6a4 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047598.084600:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db000/0x4426598c0c7764a2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6a4 expref: 136 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047598.084669:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db000/0x4426598c0c7764a2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6a4 expref: 136 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047598.084688:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:0.0:1784047598.084692:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784047598.084696:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27db000, rc 0) 00000100:00100000:0.0:1784047598.084758:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+136:73544:x1870705689523328:12345-192.168.204.40@tcp:101:touch.0 Request processed in 290us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.084777:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1528 00000100:00100000:2.0:1784047598.096899:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.099886:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689523456 00000100:00100000:1.0:1784047598.099903:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689523456 00000100:00100000:1.0:1784047598.100100:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5035 00000100:00100000:1.0:1784047598.100111:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+24:2402:x1870705689523456:12345-192.168.204.40@tcp:2:touch.0 00000100:00100000:1.0:1784047598.100338:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+25:2402:x1870705689523456:12345-192.168.204.40@tcp:2:touch.0 Request processed in 228us (3620us total) trans 4294968778 rc 0/0 00000100:00100000:1.0:1784047598.100346:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5035 00000100:00100000:2.0:1784047598.103247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047598.103341:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689523712 00000100:00100000:1.0:1784047598.103367:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689523712 00000100:00100000:1.0:1784047598.103485:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 264 00000100:00100000:1.0:1784047598.103495:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+136:73544:x1870705689523712:12345-192.168.204.40@tcp:35:touch.0 00000100:00100000:1.0:1784047598.103839:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+137:73544:x1870705689523712:12345-192.168.204.40@tcp:35:touch.0 Request processed in 344us (600us total) trans 124554051650 rc 0/0 00000100:00100000:1.0:1784047598.103848:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 264 00000100:00100000:2.0:1784047598.354991:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709416576:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.355105:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709417088:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.355144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709417600:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.355183:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784047598.355188:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709416704:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.355225:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709417216:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.355258:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709417728:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.355306:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416576 00000100:00100000:2.0:1784047598.355313:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416576 00000100:00100000:2.0:1784047598.355364:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416704 00000100:00100000:2.0:1784047598.355368:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416704 00000100:00100000:2.0:1784047598.355385:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417728 00000100:00100000:2.0:1784047598.355387:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417728 00000100:00100000:2.0:1784047598.355403:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1784047598.355411:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709416576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355469:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709416576:12345-0@lo:400:kworker.0 Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047598.355490:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1784047598.355520:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1784047598.355527:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709416704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355558:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709416704:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047598.355564:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1784047598.355576:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1784047598.355582:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709417728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355630:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709417728:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047598.355636:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00080000:2.0:1784047598.355653:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047598.355657:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047598.355691:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709416704:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355702:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709417728:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.355711:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709416576:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.355876:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709416448:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.355909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047598.355936:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709416960:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047598.356029:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709417472:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047598.356069:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784047598.356075:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709416320:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047598.356133:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709416832:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047598.356169:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709417344:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047598.356217:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417088 00000100:00100000:0.0:1784047598.356221:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417088 00000100:00100000:0.0:1784047598.356266:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417600 00000100:00100000:0.0:1784047598.356270:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417600 00000100:00100000:0.0:1784047598.356286:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417216 00000100:00100000:0.0:1784047598.356289:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417216 00000100:00100000:0.0:1784047598.356309:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:0.0:1784047598.356316:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709417088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356356:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709417088:12345-0@lo:400:kworker.0 Request processed in 40us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.356363:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:0.0:1784047598.356376:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:0.0:1784047598.356382:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709417600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356409:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709417600:12345-0@lo:400:kworker.0 Request processed in 28us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.356415:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:0.0:1784047598.356426:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1784047598.356432:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356459:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709417216:12345-0@lo:400:kworker.0 Request processed in 28us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.356465:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1784047598.356486:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416320 00000100:00100000:0.0:1784047598.356490:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416320 00000100:00100000:0.0:1784047598.356527:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784047598.356533:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709416320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356566:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709416320:12345-0@lo:400:kworker.0 Request processed in 34us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.356572:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1784047598.356687:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047598.356698:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047598.356722:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709416320:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.356746:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416448 00000100:00100000:0.0:1784047598.356748:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416448 00000100:00080000:0.0:1784047598.356765:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047598.356784:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416832 00000100:00100000:0.0:1784047598.356787:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416832 00000100:00080000:0.0:1784047598.356800:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047598.356812:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417344 00000100:00100000:0.0:1784047598.356814:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417344 00000100:00100000:0.0:1784047598.356825:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1784047598.356830:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709416448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.357166:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709416448:12345-0@lo:400:kworker.0 Request processed in 335us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.357174:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1784047598.357202:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709416448:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.357222:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1784047598.357229:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709416832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.357263:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709416832:12345-0@lo:400:kworker.0 Request processed in 35us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.357271:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1784047598.357292:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709416832:0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.357310:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1784047598.357316:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709417344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047598.357348:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709417344:12345-0@lo:400:kworker.0 Request processed in 33us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047598.357363:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1784047598.357389:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709417344:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.357690:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709417216:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.357704:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709417088:0@lo:400:kworker.0 00000100:00100000:2.0:1784047598.357716:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709417600:0@lo:400:kworker.0 00000100:00100000:3.0:1784047598.358536:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709416960 00000100:00100000:3.0:1784047598.358546:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709416960 00000100:00100000:3.0:1784047598.358588:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417472 00000100:00100000:3.0:1784047598.358591:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417472 00000100:00100000:3.0:1784047598.358630:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:3.0:1784047598.358638:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709416960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047598.358705:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709416960:12345-0@lo:400:kworker.0 Request processed in 67us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047598.358711:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:3.0:1784047598.358728:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1784047598.358734:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709417472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047598.358764:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfeb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709417472:12345-0@lo:400:kworker.0 Request processed in 30us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047598.358769:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1784047598.358818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709416960:0@lo:400:kworker.0 00000100:00100000:3.0:1784047598.358851:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709417472:0@lo:400:kworker.0 00000100:00100000:3.0:1784047598.359294:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709417856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047598.359336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047598.359373:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047598.359378:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709417984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047598.359401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047598.359629:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417856 00000100:00100000:1.0:1784047598.359635:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417856 00000100:00100000:1.0:1784047598.359662:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709417984 00000100:00100000:1.0:1784047598.359665:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709417984 00000100:00100000:1.0:1784047598.359679:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1784047598.359686:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709417856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047598.359714:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1784047598.359765:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709417856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047598.359772:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1784047598.359786:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:1.0:1784047598.359793:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709417984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047598.359809:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:1.0:1784047598.359838:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709417984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047598.359844:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1784047598.359952:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709417984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047598.359964:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709417856:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784047598.867490:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047598.868902:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784047598.868928:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709418112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047598.869004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047598.869305:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418112 00000100:00100000:2.0:1784047598.869315:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418112 00000100:00100000:2.0:1784047598.869373:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1784047598.869385:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709418112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047598.869420:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047598.869477:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870705709418112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047598.869484:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1784047598.869551:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709418112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784047598.869868:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709418240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047598.869900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047598.869965:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418240 00000100:00100000:3.0:1784047598.869970:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418240 00000100:00100000:3.0:1784047598.870001:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1784047598.870008:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709418240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047598.870025:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047598.872154:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709418240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2138us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047598.872168:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:1.0:1784047598.874729:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709418240:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1784047598.875649:0:94368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051650 is committed 00010000:00010000:1.0:1784047598.876026:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876040:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876049:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876056:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876061:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876069:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876193:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff99ccfebe4500) 00010000:00010000:1.0:1784047598.876197:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876203:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876210:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29000/0x4426598c0c776050 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876231:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876237:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876258:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876264:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876267:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876273:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876283:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047598.876285:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876288:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876293:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776057 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876308:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876314:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876319:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876323:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876326:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876343:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876352:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047598.876355:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784047598.876358:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876364:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4400/0x4426598c0c7760b2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876377:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876384:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876389:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876395:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6cc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876410:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876417:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876440:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff99ccc37d2700) 00010000:00010000:1.0:1784047598.876442:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876446:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876459:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6cc00/0x4426598c0c7760e3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876478:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876484:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876490:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876509:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876512:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876518:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876527:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:1.0:1784047598.876530:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876533:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876539:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c400/0x4426598c0c7760f8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876550:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876557:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876569:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876574:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876577:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876583:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876591:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff99ccc37d2d00) 00010000:00010000:1.0:1784047598.876593:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876596:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876601:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6c200/0x4426598c0c776114 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876671:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876677:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876682:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876687:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6d800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876690:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876705:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876715:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:1.0:1784047598.876718:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876721:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876726:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d800/0x4426598c0c776129 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876738:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876744:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876749:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876755:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24be00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876757:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876763:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876770:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff99ccc34a7f00) 00010000:00010000:1.0:1784047598.876772:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876775:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876789:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776145 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876805:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876811:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876818:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876823:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876826:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876832:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876839:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:1.0:1784047598.876842:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876844:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876850:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c77615a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876860:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876867:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876879:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876884:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876888:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876894:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876902:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff99cbc9aa9100) 00010000:00010000:1.0:1784047598.876904:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876907:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876913:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4200/0x4426598c0c776176 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876928:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876934:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876939:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876944:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.876946:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876963:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876972:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:1.0:1784047598.876975:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.876977:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876983:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c77618b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.876996:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877003:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877009:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877014:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.877017:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877022:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877031:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff99ccc34a7400) 00010000:00010000:1.0:1784047598.877032:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.877035:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877047:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7761a7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877062:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877068:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877074:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877079:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.877083:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877089:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877096:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:1.0:1784047598.877099:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.877102:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877108:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7761bc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877865:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877876:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877890:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877896:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.877899:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877906:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877916:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff99ccc37d2a00) 00010000:00010000:1.0:1784047598.877918:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.877921:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877928:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c7761d8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877943:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877949:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877967:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877972:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.877975:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877991:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.877999:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:1.0:1784047598.878002:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878004:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878010:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28600/0x4426598c0c7761ed lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878022:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878028:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878034:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878039:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878041:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878047:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878055:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff99cbc9aa9800) 00010000:00010000:1.0:1784047598.878057:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878059:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878070:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5000/0x4426598c0c776209 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878087:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878094:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878100:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878105:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878108:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878125:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878133:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:1.0:1784047598.878136:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878138:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878144:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77621e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878154:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878160:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878173:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878178:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878181:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878188:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878195:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff99cbc9aa9a00) 00010000:00010000:1.0:1784047598.878197:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878200:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878205:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4a00/0x4426598c0c77623a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878219:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878225:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878230:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878236:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878238:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878259:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878278:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:1.0:1784047598.878281:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878283:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878289:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5800/0x4426598c0c77624f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878301:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878307:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878313:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878318:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878321:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878327:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878335:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff99ccfebe4a00) 00010000:00010000:1.0:1784047598.878336:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878339:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878352:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29a00/0x4426598c0c77626b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878367:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878373:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878379:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878383:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b4c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878386:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878391:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878399:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:1.0:1784047598.878401:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878404:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878410:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b4c00/0x4426598c0c776280 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878419:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878425:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878437:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878442:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878445:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878450:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878458:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff99ccfebe4200) 00010000:00010000:1.0:1784047598.878461:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878463:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878469:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28a00/0x4426598c0c77629c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878482:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878489:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878509:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878514:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cbc67b5400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878517:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878534:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878544:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:1.0:1784047598.878546:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878549:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878554:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cbc67b5400/0x4426598c0c7762b1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878566:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878571:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878577:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878582:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878584:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878590:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878597:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff99ccfebe4700) 00010000:00010000:1.0:1784047598.878599:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878602:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878638:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29800/0x4426598c0c7762cd lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878654:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878659:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878665:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878669:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878672:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878678:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878686:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:1.0:1784047598.878689:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878692:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878697:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88200/0x4426598c0c7762e2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878708:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878713:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878725:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878730:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff28c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878733:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878740:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878748:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff99ccfebe4100) 00010000:00010000:1.0:1784047598.878750:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878753:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878759:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff28c00/0x4426598c0c7762fe lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878774:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878780:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878786:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878791:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878794:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878811:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878820:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:1.0:1784047598.878823:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878825:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878832:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88e00/0x4426598c0c776313 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878844:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878849:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878854:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878858:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878861:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878866:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878873:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff99ccfebe4400) 00010000:00010000:1.0:1784047598.878875:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878878:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878889:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29400/0x4426598c0c77632f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878904:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878910:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878916:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878920:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878923:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878928:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878936:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:1.0:1784047598.878938:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878941:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878946:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88a00/0x4426598c0c776344 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878956:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878961:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878973:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878978:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cceff29200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.878981:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878987:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.878995:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff99ccfebe4300) 00010000:00010000:1.0:1784047598.878997:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.878999:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879004:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cceff29200/0x4426598c0c776360 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879019:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879025:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879031:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879037:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b88800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879039:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879053:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879061:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:1.0:1784047598.879063:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879065:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879070:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b88800/0x4426598c0c776375 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879081:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879087:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879091:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879095:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879098:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879103:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879109:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff99ccfebe4b00) 00010000:00010000:1.0:1784047598.879111:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879114:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879125:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c776391 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879139:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879144:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879149:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879153:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879155:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879160:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879168:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:1.0:1784047598.879170:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879172:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879177:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89400/0x4426598c0c7763a6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879186:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879192:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879202:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879207:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879210:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879217:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879223:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff99ccfebe4600) 00010000:00010000:1.0:1784047598.879226:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879228:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879233:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7763c2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879246:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879253:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879259:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879264:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879266:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879280:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879288:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:1.0:1784047598.879290:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879293:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879298:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89c00/0x4426598c0c7763d7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879309:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879315:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879322:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879327:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879330:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879336:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879343:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff99ccfebe4e00) 00010000:00010000:1.0:1784047598.879346:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879348:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879359:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7763f3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879373:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879379:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879385:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879390:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce3b89a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879393:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879400:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879407:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:1.0:1784047598.879409:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879411:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879417:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce3b89a00/0x4426598c0c776408 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879426:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879431:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879443:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879447:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cea00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879450:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879456:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879463:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff99ccfebe4d00) 00010000:00010000:1.0:1784047598.879465:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879468:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879473:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c776424 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879485:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879504:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879510:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879514:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879517:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879531:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879539:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:1.0:1784047598.879541:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879543:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879548:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776439 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879559:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879566:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879572:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879577:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879579:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879584:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879590:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff99ccc34a7b00) 00010000:00010000:1.0:1784047598.879592:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879594:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879603:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776455 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879645:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879650:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879656:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879661:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879664:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879671:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879679:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:1.0:1784047598.879682:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879684:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879690:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c77646a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879700:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879707:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879718:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879722:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879724:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879730:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879739:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff99cd02171a00) 00010000:00010000:1.0:1784047598.879740:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879743:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879747:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c776486 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879761:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879765:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879770:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879774:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047598.879776:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879791:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879799:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:1.0:1784047598.879802:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047598.879804:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047598.879810:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c77649b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047599.240831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047599.240883:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047599.240920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047599.240938:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047599.240970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047599.241052:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524224 00000100:00100000:1.0:1784047599.241062:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524224 00000100:00100000:1.0:1784047599.241122:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524352 00000100:00100000:1.0:1784047599.241125:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524352 00000100:00100000:1.0:1784047599.241145:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2683 00000100:00100000:1.0:1784047599.241154:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+25:2400:x1870705689524224:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047599.241218:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+25:2400:x1870705689524224:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047599.241226:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2683 00000100:00100000:1.0:1784047599.241242:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2684 00000100:00100000:1.0:1784047599.241247:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689524352:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047599.241267:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689524352:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 20us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047599.241273:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2684 00000100:00100000:1.0:1784047599.241289:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689523840 00000100:00100000:1.0:1784047599.241292:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689523840 00000100:00100000:1.0:1784047599.241355:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 177 00000100:00100000:1.0:1784047599.241363:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689523840:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047599.241387:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689523840:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047599.241393:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 177 00000100:00100000:1.0:1784047599.241427:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689523968 00000100:00100000:1.0:1784047599.241430:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689523968 00000100:00100000:1.0:1784047599.241460:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524096 00000100:00100000:1.0:1784047599.241463:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524096 00000100:00100000:1.0:1784047599.241504:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1446 00000100:00100000:1.0:1784047599.241512:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+31:2400:x1870705689523968:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047599.241566:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+31:2400:x1870705689523968:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 55us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047599.241572:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1446 00000100:00100000:1.0:1784047599.241585:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1447 00000100:00100000:1.0:1784047599.241591:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689524096:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047599.241649:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689524096:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 58us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047599.241655:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1447 00000100:00080000:3.0:1784047599.241846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047599.241850:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784047599.241853:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047599.241855:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047599.765736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047599.766040:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524480 00000100:00100000:0.0:1784047599.766053:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524480 00000100:00100000:0.0:1784047599.766124:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1529 00000100:00100000:0.0:1784047599.766135:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+31:73571:x1870705689524480:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:0.0:1784047599.766199:0:67153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:0.0:1784047599.766272:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+31:73571:x1870705689524480:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 139us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047599.766280:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1529 00000100:00100000:2.0:1784047599.772545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047599.773058:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524608 00000100:00100000:1.0:1784047599.773069:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524608 00000100:00100000:1.0:1784047599.773145:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1530 00000100:00100000:1.0:1784047599.773156:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:73571:x1870705689524608:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1784047599.773202:0:66220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1784047599.773285:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:73571:x1870705689524608:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 131us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047599.773312:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1530 00000100:00100000:3.0:1784047599.787554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047599.788325:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524736 00000100:00100000:2.0:1784047599.788335:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524736 00000100:00100000:2.0:1784047599.788407:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2190 00000100:00100000:2.0:1784047599.788419:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+25:73571:x1870705689524736:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:2.0:1784047599.788453:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784047599.788546:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+25:73571:x1870705689524736:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 129us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047599.788554:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2190 00000100:00100000:3.0:1784047599.791468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047599.791813:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689524864 00000100:00100000:0.0:1784047599.791824:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689524864 00000100:00100000:0.0:1784047599.791910:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2191 00000100:00100000:0.0:1784047599.791920:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+7:73571:x1870705689524864:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1784047599.791946:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047599.792046:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c846d7a-6357-4e9c-a620-e35737ede709+7:73571:x1870705689524864:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 126us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047599.792053:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2191 00000100:00100000:1.0:1784047599.892041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709418368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784047599.892128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047599.892327:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418368 00000100:00100000:3.0:1784047599.892336:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418368 00000100:00100000:3.0:1784047599.892391:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1784047599.892400:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709418368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047599.892422:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047599.892486:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709418368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047599.892494:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:2.0:1784047599.892647:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709418368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047599.893086:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709418496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047599.893118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784047599.893203:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047599.893248:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418496 00000100:00100000:0.0:1784047599.893253:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418496 00000100:00100000:0.0:1784047599.893292:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1784047599.893299:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709418496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047599.893313:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784047599.893395:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709418496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047599.893420:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1784047599.901465:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709418496:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1784047600.617206:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968778 is committed 00000001:00080000:3.0:1784047600.617235:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968774 is committed 00000100:00100000:2.0:1784047600.754474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047600.754652:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689525120 00000100:00100000:0.0:1784047600.754663:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689525120 00000100:00100000:0.0:1784047600.754747:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1531 00000100:00100000:0.0:1784047600.754837:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+31:73613:x1870705689525120:12345-192.168.204.40@tcp:36:mcreate.0 00010000:00010000:0.0:1784047600.754894:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047600.754936:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebd6d000/0x4426598c0c77608f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae57e expref: 31 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.754953:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047600.754958:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047600.755022:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755037:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755047:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755063:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755070:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755076:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755486:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755504:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755511:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755518:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755524:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047600.755529:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755536:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755544:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047600.755547:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047600.755550:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755556:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047600.755567:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd0616d9 reply state 00000000a56406f7 transno 124554051651 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755579:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.755584:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cbc9aa9500) 00010000:00010000:0.0:1784047600.755592:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047600.755595:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047600.755727:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+32:73613:x1870705689525120:12345-192.168.204.40@tcp:36:mcreate.0 Request processed in 892us (1279us total) trans 124554051651 rc 0/0 00000100:00100000:0.0:1784047600.755735:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1531 00000100:00100000:3.0:1784047600.780968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047600.781041:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689525248 00000100:00100000:0.0:1784047600.781051:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689525248 00000100:00100000:0.0:1784047600.781114:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1532 00000100:00100000:0.0:1784047600.781124:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+32:73616:x1870705689525248:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:0.0:1784047600.781146:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047600.781168:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6ab expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.781237:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c7764be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.781252:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c7764be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.781265:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c7764be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047600.781311:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784047600.781665:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784047600.781697:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c7764be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.781725:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ab expref: 34 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.781746:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c7764be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ab expref: 33 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.781773:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047600.781777:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784047600.781781:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27db800, rc 0) 00000100:00100000:0.0:1784047600.781851:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+33:73616:x1870705689525248:12345-192.168.204.40@tcp:101:rm.0 Request processed in 727us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047600.781859:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1532 00000100:00100000:0.0:1784047600.784806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047600.785864:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689525376 00000100:00100000:2.0:1784047600.785875:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689525376 00000100:00100000:2.0:1784047600.785948:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1533 00000100:00100000:2.0:1784047600.785959:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+33:73616:x1870705689525376:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:2.0:1784047600.785982:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047600.786017:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c7764c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6b2 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786081:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786097:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786109:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786120:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786127:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786133:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786231:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786241:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786249:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047600.786293:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1784047600.786298:0:68026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784047600.786446:0:68026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786476:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786485:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786491:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786497:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786504:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786509:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047600.786513:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786520:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786532:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:2.0:1784047600.786535:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047600.786539:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786545:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7764cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786559:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786570:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786576:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786580:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047600.786583:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786589:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786596:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cbc9aa9500) 00010000:00010000:2.0:1784047600.786598:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047600.786600:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786625:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7764d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786653:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c7764c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6b2 expref: 35 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786787:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6b2 expref: 34 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047600.786795:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99ccd2342e00) 00010000:00010000:2.0:1784047600.786797:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047600.786805:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24be00, rc 0) 00000100:00100000:2.0:1784047600.786914:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:73616:x1870705689525376:12345-192.168.204.40@tcp:101:rm.0 Request processed in 955us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047600.786922:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1533 00000100:00100000:2.0:1784047600.811960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047600.812043:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689525632 00000100:00100000:0.0:1784047600.812053:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689525632 00000100:00100000:0.0:1784047600.812120:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1534 00000100:00100000:0.0:1784047600.812131:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+34:73616:x1870705689525632:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:0.0:1784047600.812185:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784047600.812214:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c7764da lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6b2 expref: 34 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.812234:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99ccd2342e00) 00010000:00010000:0.0:1784047600.812252:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c7764be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ab expref: 33 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.812262:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047600.812265:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047600.812284:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814063:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814095:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814114:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814122:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814129:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814212:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814220:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814227:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814453:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814472:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814480:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814488:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814506:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814513:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814540:0:66221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784047600.814561:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814568:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814574:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814581:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27dbe00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047600.814586:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814594:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814629:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99cbc9aa9a00) 00010000:00010000:0.0:1784047600.814633:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784047600.814637:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814645:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7764ef lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814806:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814814:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814820:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814827:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814833:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27dba00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047600.814836:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814842:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814851:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047600.814854:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047600.814857:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814864:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7764e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784047600.814872:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000abc51e9 reply state 00000000447c6cd9 transno 124554051652 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814883:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047600.814896:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cbc9aa9500) 00010000:00010000:0.0:1784047600.814898:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047600.814901:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047600.815055:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+34:73616:x1870705689525632:12345-192.168.204.40@tcp:36:rm.0 Request processed in 2922us (3103us total) trans 124554051652 rc 0/0 00000100:00100000:0.0:1784047600.815065:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1534 00010000:00010000:3.0:1784047600.815237:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784047600.815244:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047600.815250:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da800 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:3.0:1784047600.815254:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047600.815260:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047600.815270:0:15071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff99cbc9aa9a00) 00010000:00010000:3.0:1784047600.815273:0:15071:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784047600.815276:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047600.815303:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7764f6 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047600.815329:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047600.815332:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047600.815333:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047600.915124:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047601.939069:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784047602.963143:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047603.474900:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709418624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784047603.474989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047603.475063:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418624 00000100:00100000:1.0:1784047603.475074:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418624 00000100:00100000:1.0:1784047603.475128:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1784047603.475138:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709418624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047603.475175:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1784047603.475220:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709418624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047603.475228:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1784047603.475294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709418624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047603.475515:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709418880:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.475559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.475591:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709419392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.475654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.475679:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709419904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.475710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.475780:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784047603.475787:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709419008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.475814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.475836:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709419520:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.475865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.475885:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709420032:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.475906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.475943:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418880 00000100:00100000:3.0:1784047603.475947:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418880 00000100:00100000:3.0:1784047603.476007:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419008 00000100:00100000:3.0:1784047603.476010:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419008 00000100:00100000:3.0:1784047603.476035:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1784047603.476043:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709418880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476084:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709418880:12345-0@lo:400:kworker.0 Request processed in 42us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.476111:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1784047603.476128:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1784047603.476133:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709419008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476167:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709419008:12345-0@lo:400:kworker.0 Request processed in 33us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.476174:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1784047603.476196:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419392 00000100:00100000:3.0:1784047603.476199:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419392 00000100:00100000:3.0:1784047603.476228:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1784047603.476234:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709419392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476263:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709419392:12345-0@lo:400:kworker.0 Request processed in 29us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.476269:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00080000:3.0:1784047603.476295:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047603.476303:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047603.476315:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709419136:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.476363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0045aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709419648:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.476415:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709420160:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.476489:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784047603.476495:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709418752:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.476558:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709419264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.476639:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709419776:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047603.476696:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709418752 00000100:00100000:3.0:1784047603.476699:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709418752 00000100:00100000:3.0:1784047603.476729:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784047603.476744:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709418752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476784:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709418752:12345-0@lo:400:kworker.0 Request processed in 49us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.476877:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784047603.476907:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419136 00000100:00100000:3.0:1784047603.476910:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419136 00000100:00100000:3.0:1784047603.476934:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420160 00000100:00100000:3.0:1784047603.476937:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420160 00000100:00100000:3.0:1784047603.476946:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419264 00000100:00100000:3.0:1784047603.476948:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419264 00000100:00100000:3.0:1784047603.476959:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1784047603.476965:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709419136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.476995:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709419136:12345-0@lo:400:kworker.0 Request processed in 30us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.477002:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1784047603.477018:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419776 00000100:00100000:3.0:1784047603.477021:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419776 00000100:00100000:3.0:1784047603.477040:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1784047603.477045:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709420160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477073:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709420160:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.477088:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1784047603.477101:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1784047603.477107:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709419264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477134:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709419264:12345-0@lo:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.477140:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1784047603.477150:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1784047603.477156:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709419776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477179:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709419776:12345-0@lo:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047603.477185:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00080000:3.0:1784047603.477198:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784047603.477201:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784047603.477231:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709419008:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477243:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709418880:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477253:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709419392:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477284:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc6d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709418752:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477304:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709419264:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477314:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709419776:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.477323:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709419136:0@lo:400:kworker.0 00000100:00100000:1.0:1784047603.477424:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419904 00000100:00100000:1.0:1784047603.477433:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419904 00000100:00100000:1.0:1784047603.477473:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419520 00000100:00100000:1.0:1784047603.477477:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419520 00000100:00100000:1.0:1784047603.477503:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420032 00000100:00100000:1.0:1784047603.477506:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420032 00000100:00100000:1.0:1784047603.477531:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709419648 00000100:00100000:1.0:1784047603.477534:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709419648 00000100:00100000:1.0:1784047603.477557:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1784047603.477563:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709419904:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047603.477585:0:8431:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce495b480 x1870705709419904/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1784047614 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047603.477660:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709419904:12345-0@lo:400:kworker.0 Request processed in 97us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047603.477672:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1784047603.477693:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1784047603.477698:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709419520:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784047603.477709:0:8431:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef517800 x1870705709419520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1784047614 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047603.477734:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709419520:12345-0@lo:400:kworker.0 Request processed in 36us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047603.477740:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1784047603.477752:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1784047603.477757:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709420032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047603.477790:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709420032:12345-0@lo:400:kworker.0 Request processed in 33us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047603.477795:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1784047603.477806:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1784047603.477813:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709419648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047603.477839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709419648:12345-0@lo:400:kworker.0 Request processed in 27us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047603.477845:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00080000:1.0:1784047603.477890:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047603.477893:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784047603.477931:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709419520:0@lo:400:kworker.0 00000100:00100000:1.0:1784047603.477944:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709420032:0@lo:400:kworker.0 00000100:00100000:1.0:1784047603.477974:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709419904:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.478112:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0045aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709419648:0@lo:400:kworker.0 00000100:00100000:3.0:1784047603.478133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709420160:0@lo:400:kworker.0 00000100:00100000:2.0:1784047603.481745:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709420288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047603.481819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047603.481880:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420288 00000100:00100000:2.0:1784047603.481888:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420288 00000100:00100000:2.0:1784047603.481932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1784047603.481941:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709420288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047603.481976:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:2.0:1784047603.482021:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709420288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047603.482027:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1784047603.482084:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709420288:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784047603.986907:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047603.987144:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047603.987169:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709420416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047603.987294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047603.987431:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420416 00000100:00100000:2.0:1784047603.987450:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420416 00000100:00100000:2.0:1784047603.987511:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1784047603.987520:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709420416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784047603.987550:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1784047603.987564:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1dc00 x1870705709420416/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:734/0 lens 224/368 e 0 to 0 dl 1784047614 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047603.987634:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709420416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047603.987663:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1784047603.987752:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709420416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784047603.987976:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709420544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047603.988003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047603.988069:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420544 00000100:00100000:0.0:1784047603.988074:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420544 00000100:00100000:0.0:1784047603.988105:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1784047603.988113:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709420544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047603.988130:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047603.988170:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709420544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047603.988176:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:3.0:1784047603.988272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709420544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784047604.363587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047604.363664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047604.363691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047604.363710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047604.363779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047604.363810:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526144 00000100:00100000:1.0:1784047604.363819:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526144 00000100:00100000:1.0:1784047604.363881:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526272 00000100:00100000:1.0:1784047604.363885:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526272 00000100:00100000:1.0:1784047604.363910:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2689 00000100:00100000:1.0:1784047604.363922:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689526144:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000080:1.0:1784047604.363952:0:26192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0045aa00 x1870705689526144/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:735/0 lens 224/224 e 0 to 0 dl 1784047615 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047604.364012:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+5:2399:x1870705689526144:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047604.364020:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2689 00000100:00100000:1.0:1784047604.364041:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2690 00000100:00100000:1.0:1784047604.364047:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689526272:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047604.364072:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689526272:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047604.364078:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2690 00000100:00080000:1.0:1784047604.364099:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784047604.364103:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784047604.364428:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689525888 00000100:00100000:3.0:1784047604.364433:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689525888 00000100:00100000:2.0:1784047604.364594:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689525760 00000100:00100000:3.0:1784047604.364660:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526016 00000100:00100000:3.0:1784047604.364665:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526016 00000100:00100000:3.0:1784047604.364697:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1454 00000100:00100000:3.0:1784047604.364709:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+34:2400:x1870705689525888:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047604.364762:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+34:2400:x1870705689525888:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 57us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047604.364770:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1454 00000100:00100000:3.0:1784047604.364786:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1455 00000100:00100000:3.0:1784047604.364792:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689526016:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047604.364818:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689526016:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047604.364824:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1455 00000100:00100000:2.0:1784047604.364940:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689525760 00000100:00100000:2.0:1784047604.364977:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 179 00000100:00100000:2.0:1784047604.364984:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689525760:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047604.365019:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689525760:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047604.365026:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 179 00000100:00080000:1.0:1784047604.365123:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047604.365134:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047605.010902:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709420672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784047605.011016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047605.011082:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784047605.011090:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709420800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047605.011119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047605.011148:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420672 00000100:00100000:2.0:1784047605.011156:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420800 00000100:00100000:0.0:1784047605.011157:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420672 00000100:00100000:2.0:1784047605.011163:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420800 00000100:00100000:0.0:1784047605.011233:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1784047605.011243:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709420672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784047605.011266:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3922481152 avail 3690958848 00010000:00000080:0.0:1784047605.011281:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdcf9180 x1870705709420672/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:736/0 lens 224/368 e 0 to 0 dl 1784047616 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047605.011328:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709420672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047605.011335:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00080000:0.0:1784047605.011362:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047605.011367:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784047605.011395:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1784047605.011404:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709420800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047605.011414:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047605.011451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709420672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047605.011459:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709420800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047605.011467:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:2.0:1784047605.011487:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709420800:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784047605.011838:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047606.038702:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784047606.553080:0:94368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051652 is committed 00010000:00010000:1.0:1784047606.553151:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553165:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553172:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553179:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047606.553184:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553192:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553215:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cbc9aa9500) 00010000:00010000:1.0:1784047606.553218:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047606.553222:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553229:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7764b0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553252:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553258:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553263:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553285:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27db600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047606.553288:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553294:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553302:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a29d18d (ffff99cbc9aa9500) 00010000:00010000:1.0:1784047606.553304:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047606.553307:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047606.553312:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db600/0x4426598c0c7764e8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a29d18d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1784047606.894580:0:95906:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00010000:00010000:2.0:1784047607.064106:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047607.159416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.159535:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526528 00000100:00100000:2.0:1784047607.159545:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526528 00000100:00100000:3.0:1784047607.159716:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1535 00000100:00100000:3.0:1784047607.159732:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+30:73695:x1870705689526528:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.159767:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.159791:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7764fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6c0 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.159866:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c776504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.159880:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c776504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.159889:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c776504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047607.159937:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047607.159941:0:67153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047607.159978:0:67153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c776504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.160005:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c7764fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6c0 expref: 32 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.160039:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030a00/0x4426598c0c776504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6c0 expref: 31 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.160049:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:3.0:1784047607.160052:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047607.160055:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030a00, rc 0) 00000100:00100000:3.0:1784047607.160122:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+31:73695:x1870705689526528:12345-192.168.204.40@tcp:101:dd.0 Request processed in 394us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.160129:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1535 00000100:00080000:0.0:1784047607.160546:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047607.163851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.164128:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526400 00000100:00100000:3.0:1784047607.164139:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526400 00000100:00100000:3.0:1784047607.164199:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1536 00000100:00100000:3.0:1784047607.164209:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+31:73694:x1870705689526400:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.164229:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.164250:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c77650b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6b9 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.164316:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c776512 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.164331:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c776512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.164354:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c776512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047607.164400:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047607.164403:0:66219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047607.164423:0:66219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c776512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.164445:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c77650b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6b9 expref: 33 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.164463:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c776512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6b9 expref: 32 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.164472:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:3.0:1784047607.164475:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047607.164493:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031a00, rc 0) 00000100:00100000:3.0:1784047607.164561:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+32:73694:x1870705689526400:12345-192.168.204.40@tcp:101:dd.0 Request processed in 353us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.164568:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1536 00000100:00100000:1.0:1784047607.172105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.172148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.172229:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526656 00000100:00100000:3.0:1784047607.172240:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526656 00000100:00100000:3.0:1784047607.172291:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689526912 00000100:00100000:3.0:1784047607.172294:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689526912 00000100:00100000:3.0:1784047607.172321:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1537 00000100:00100000:3.0:1784047607.172331:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+33:73696:x1870705689526656:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.172362:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.172383:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c776519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6c7 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.172393:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1538 00000100:00100000:0.0:1784047607.172407:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+34:73695:x1870705689526912:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.172417:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.172429:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776520 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6ce expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.172446:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c776527 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.172460:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c776527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.172471:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c776527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047607.172507:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784047607.172510:0:66221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784047607.172529:0:66221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c776527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.172551:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c776519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6c7 expref: 36 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172558:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172569:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172591:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172650:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172659:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172674:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172722:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c77653c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172731:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c77653c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172739:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c77653c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.172748:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784047607.172751:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c776527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6c7 expref: 35 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.172764:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:3.0:1784047607.172767:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784047607.172770:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030000, rc 0) 00000100:00100000:3.0:1784047607.172823:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+36:73696:x1870705689526656:12345-192.168.204.40@tcp:101:dd.0 Request processed in 493us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.172830:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1537 00010000:00010000:0.0:1784047607.172849:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172857:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172863:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172869:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172874:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.172878:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172885:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172906:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.172909:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.172913:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172919:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77652e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172933:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172939:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172945:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172950:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27dbe00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.172954:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172959:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172967:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff99cce7530300) 00010000:00010000:0.0:1784047607.172970:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.172973:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.172979:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776535 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.173047:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776520 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ce expref: 36 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.173061:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c77653c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ce expref: 35 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.173068:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:0.0:1784047607.173071:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.173074:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27db800, rc 0) 00000100:00100000:0.0:1784047607.173112:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+35:73695:x1870705689526912:12345-192.168.204.40@tcp:101:dd.0 Request processed in 709us (962us total) trans 124554051653 rc 0/0 00000100:00100000:0.0:1784047607.173118:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1538 00000100:00100000:1.0:1784047607.176451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.177369:0:10393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689527040 00000100:00100000:3.0:1784047607.177382:0:10393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689527040 00000100:00100000:3.0:1784047607.177463:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 745 00000100:00100000:3.0:1784047607.177475:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c846d7a-6357-4e9c-a620-e35737ede709+35:2402:x1870705689527040:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784047607.177495:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.177529:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c776512 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6b9 expref: 35 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.177550:0:10393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:3.0:1784047607.177567:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784047607.177683:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c846d7a-6357-4e9c-a620-e35737ede709+34:2402:x1870705689527040:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 209us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.177691:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 745 00000100:00100000:1.0:1784047607.190975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.191026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.191068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.191176:0:25839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689527296 00000100:00100000:0.0:1784047607.191187:0:25839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689527296 00000100:00100000:0.0:1784047607.191262:0:25839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 746 00000100:00100000:0.0:1784047607.191273:0:25839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:2401:x1870705689527296:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047607.191290:0:25839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047607.191317:0:25839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030000/0x4426598c0c776527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6c7 expref: 34 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.191348:0:25839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc3e94a00) 00010000:00010000:0.0:1784047607.191354:0:25839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047607.191413:0:25839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c846d7a-6357-4e9c-a620-e35737ede709+33:2401:x1870705689527296:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 142us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.191421:0:25839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 746 00000100:00100000:2.0:1784047607.191707:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689527168 00000100:00100000:2.0:1784047607.191712:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689527168 00000100:00100000:2.0:1784047607.191745:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689527552 00000100:00100000:2.0:1784047607.191754:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689527552 00000100:00100000:2.0:1784047607.191780:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1539 00000100:00100000:2.0:1784047607.191787:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:73695:x1870705689527168:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.191805:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.191820:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c77654a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6d5 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.191854:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776551 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.191877:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776551 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.191888:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776551 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.191995:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c77654a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6d5 expref: 36 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192012:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24be00/0x4426598c0c776551 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6d5 expref: 35 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192019:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:2.0:1784047607.192022:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784047607.192025:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24be00, rc 0) 00000100:00100000:2.0:1784047607.192057:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+35:73695:x1870705689527168:12345-192.168.204.40@tcp:101:dd.0 Request processed in 271us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.192064:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1539 00000100:00100000:2.0:1784047607.192080:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1540 00000100:00100000:2.0:1784047607.192094:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:73694:x1870705689527552:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.192103:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.192111:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776558 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6dc expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192227:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192237:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192244:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192259:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192267:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192274:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192315:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c77656d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192324:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c77656d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192330:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c77656d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.192360:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1784047607.192446:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192454:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192460:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192467:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192473:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.192477:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192484:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192493:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.192495:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.192499:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192505:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c77655f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192516:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192522:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192534:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192540:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.192543:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192549:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192558:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff99ccd2342100) 00010000:00010000:2.0:1784047607.192561:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.192564:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192570:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c776566 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192656:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776558 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6dc expref: 37 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192671:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c77656d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6dc expref: 36 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.192678:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:2.0:1784047607.192680:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.192683:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b000, rc 0) 00000100:00100000:2.0:1784047607.192718:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+36:73694:x1870705689527552:12345-192.168.204.40@tcp:101:dd.0 Request processed in 625us (1649us total) trans 124554051654 rc 0/0 00000100:00100000:2.0:1784047607.192734:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1540 00000100:00100000:0.0:1784047607.197306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.197397:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689527808 00000100:00100000:1.0:1784047607.197408:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689527808 00000100:00100000:1.0:1784047607.197483:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1541 00000100:00100000:1.0:1784047607.197494:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+36:73695:x1870705689527808:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1784047607.197549:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047607.197578:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c77653c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ce expref: 36 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.198379:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:1.0:1784047607.198386:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047607.198586:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.199753:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.199773:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047607.199846:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051655 00000004:00010000:1.0:1784047607.199886:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cac57660 reply state 000000002ad923d8 transno 124554051656 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.199899:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.199907:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:1.0:1784047607.199910:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047607.199913:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047607.200172:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+38:73695:x1870705689527808:12345-192.168.204.40@tcp:36:dd.0 Request processed in 2676us (2872us total) trans 124554051656 rc 0/0 00000100:00100000:1.0:1784047607.200182:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1541 00000020:00080000:1.0:1784047607.200188:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784047607.203514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.203799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.204746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.204833:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689528320 00000100:00100000:0.0:1784047607.204843:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689528320 00000100:00100000:0.0:1784047607.204920:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5036 00000100:00100000:0.0:1784047607.204931:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+5:73695:x1870705689528320:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.204950:0:13594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.204981:0:13594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f19069/0x4426598c0c776582 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6f1 expref: -99 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.205006:0:13594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x783:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:0.0:1784047607.205030:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:0.0:1784047607.205035:0:13594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047607.205045:0:13594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f19069/0x4426598c0c776582 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6f1 expref: 6 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.205065:0:13594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051f19069/0x4426598c0c776582 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6f1 expref: 6 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.205079:0:13594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27db600, rc 0) 00010000:00000080:0.0:1784047607.205086:0:13594:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51f800 x1870705689528320/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.205144:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+6:73695:x1870705689528320:12345-192.168.204.40@tcp:101:dd.0 Request processed in 215us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.205152:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5036 00000100:00100000:2.0:1784047607.205400:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689527936 00000100:00100000:2.0:1784047607.205405:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689527936 00000100:00080000:1.0:1784047607.205529:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784047607.206287:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689528192 00000100:00100000:2.0:1784047607.206294:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689528192 00000100:00100000:0.0:1784047607.206297:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1542 00000100:00100000:0.0:1784047607.206306:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+39:73694:x1870705689527936:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.206328:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784047607.206329:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1543 00000100:00100000:2.0:1784047607.206348:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+39:73697:x1870705689528192:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.206356:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.206370:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776589 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6ea expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.206447:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c776590 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6e3 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.206474:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da200/0x4426598c0c776597 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.206487:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da200/0x4426598c0c776597 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.206498:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da200/0x4426598c0c776597 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.206740:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.206750:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.206759:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.206773:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.206780:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.206786:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.207106:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c776590 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6e3 expref: 42 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.207126:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da200/0x4426598c0c776597 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6e3 expref: 41 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.207134:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:0.0:1784047607.207137:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.207140:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27da200, rc 0) 00000100:00100000:0.0:1784047607.207227:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+41:73694:x1870705689527936:12345-192.168.204.40@tcp:101:dd.0 Request processed in 921us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.207235:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1542 00010000:00010000:2.0:1784047607.207287:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7765ac lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207304:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7765ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207312:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7765ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.207322:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1784047607.207421:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207428:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207433:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207439:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207668:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.207673:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207681:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207692:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.207695:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.207699:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207706:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c77659e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207723:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207728:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207734:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207738:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.207741:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207986:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.207995:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff99ccd2342100) 00010000:00010000:2.0:1784047607.207998:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.208001:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.208007:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765a5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.208051:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776589 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ea expref: 42 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.208065:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7765ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ea expref: 41 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.208083:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:2.0:1784047607.208085:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.208088:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b600, rc 0) 00000100:00100000:2.0:1784047607.210144:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+41:73697:x1870705689528192:12345-192.168.204.40@tcp:101:dd.0 Request processed in 3796us (6333us total) trans 124554051657 rc 0/0 00000100:00100000:2.0:1784047607.210156:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1543 00000100:00100000:0.0:1784047607.221214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.221264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.221394:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689528704 00000100:00100000:3.0:1784047607.221407:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689528704 00000100:00100000:3.0:1784047607.221478:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1544 00000100:00100000:3.0:1784047607.221512:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+41:73694:x1870705689528704:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.221584:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.221650:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c77656d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6dc expref: 41 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.221669:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:3.0:1784047607.221674:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047607.221853:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.221868:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.221878:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047607.221922:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051658 00000004:00010000:3.0:1784047607.221946:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cbe2212 reply state 000000008e674828 transno 124554051659 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.221974:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.221981:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:3.0:1784047607.221984:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.221986:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047607.222091:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+43:73694:x1870705689528704:12345-192.168.204.40@tcp:36:dd.0 Request processed in 584us (824us total) trans 124554051659 rc 0/0 00000100:00100000:3.0:1784047607.222099:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1544 00000020:00080000:3.0:1784047607.222103:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784047607.222564:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689528448 00000100:00100000:2.0:1784047607.222572:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689528448 00002000:00010000:2.0:1784047607.222600:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.222632:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec979880 with x1870705689528448 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.222643:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec979880. 00000100:00100000:2.0:1784047607.222663:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 606 00000100:00100000:2.0:1784047607.222671:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2402:x1870705689528448:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:2.0:1784047607.222831:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784047607.222835:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:2.0:1784047607.222838:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:2.0:1784047607.222840:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:2.0:1784047607.222842:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784047607.222851:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec979880 x1870705689528448/t4294968779(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.222889:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689528448:12345-192.168.204.40@tcp:10:dd.0 Request processed in 219us (1687us total) trans 4294968779 rc 0/0 00000100:00100000:2.0:1784047607.222897:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 606 00002000:00010000:2.0:1784047607.222900:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.222910:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec979880 with x1870705689528448 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.222915:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec979880. 00000100:00100000:1.0:1784047607.226369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.226474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.226576:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689528832 00000100:00100000:0.0:1784047607.226586:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689528832 00000100:00100000:0.0:1784047607.226679:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689529088 00000100:00100000:0.0:1784047607.226682:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689529088 00000100:00100000:0.0:1784047607.226715:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1545 00000100:00100000:0.0:1784047607.226725:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+44:73697:x1870705689528832:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.226750:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1784047607.226915:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1546 00000100:00100000:3.0:1784047607.226927:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+44:73698:x1870705689529088:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.226936:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.226953:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765c1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6ff expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.227109:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.227124:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.227135:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227178:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.227186:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7765d6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae6f8 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227188:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227207:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.227222:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dac00/0x4426598c0c7765dd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.227233:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dac00/0x4426598c0c7765dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.227241:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dac00/0x4426598c0c7765dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227272:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7765e4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227282:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7765e4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227292:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7765e4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.227300:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00010000:00010000:0.0:1784047607.227328:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7765d6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6f8 expref: 47 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.227362:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dac00/0x4426598c0c7765dd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6f8 expref: 47 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.227371:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:0.0:1784047607.227373:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.227377:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27dac00, rc 0) 00010000:00010000:2.0:1784047607.227398:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227407:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227414:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227420:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.227432:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+47:73697:x1870705689528832:12345-192.168.204.40@tcp:101:dd.0 Request processed in 708us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.227445:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1545 00010000:00010000:2.0:1784047607.227513:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.227518:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227525:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227536:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.227538:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.227542:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227548:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031c00/0x4426598c0c7765c8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227559:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227566:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227572:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227576:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ac00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.227579:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227585:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227604:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff99ccd2342100) 00010000:00010000:2.0:1784047607.227628:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.227632:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227638:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24ac00/0x4426598c0c7765cf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227676:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765c1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ff expref: 47 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227689:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7765e4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ff expref: 46 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.227696:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:2.0:1784047607.227698:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.227700:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a400, rc 0) 00000100:00100000:2.0:1784047607.227739:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+46:73698:x1870705689529088:12345-192.168.204.40@tcp:101:dd.0 Request processed in 816us (1265us total) trans 124554051660 rc 0/0 00000100:00100000:2.0:1784047607.228139:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1546 00000100:00100000:2.0:1784047607.229981:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.230113:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689529216 00000100:00100000:3.0:1784047607.230123:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689529216 00000100:00100000:3.0:1784047607.230182:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5037 00000100:00100000:3.0:1784047607.230193:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+7:73694:x1870705689529216:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.230210:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.230232:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c7765f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae706 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047607.230257:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x782:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:3.0:1784047607.230277:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:3.0:1784047607.230282:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047607.230290:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c7765f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae706 expref: 8 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.230353:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c7765f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae706 expref: 8 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.230366:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030000, rc 0) 00010000:00000080:3.0:1784047607.230374:0:26186:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdcfa680 x1870705689529216/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.230449:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+8:73694:x1870705689529216:12345-192.168.204.40@tcp:101:dd.0 Request processed in 258us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.230456:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5037 00000100:00100000:0.0:1784047607.234098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.234182:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689529472 00000100:00100000:3.0:1784047607.234194:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689529472 00000100:00100000:3.0:1784047607.234257:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1547 00000100:00100000:3.0:1784047607.234268:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+46:73697:x1870705689529472:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.234326:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.234364:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c7765ac lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ea expref: 46 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.234391:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:3.0:1784047607.234396:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047607.234885:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.234902:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.234912:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047607.235058:0:66219:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051661 00000004:00010000:3.0:1784047607.235085:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f99d2d2 reply state 000000009d067042 transno 124554051662 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.235098:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.235104:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:3.0:1784047607.235107:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.235110:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047607.235272:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+48:73697:x1870705689529472:12345-192.168.204.40@tcp:36:dd.0 Request processed in 1005us (1182us total) trans 124554051662 rc 0/0 00000100:00100000:3.0:1784047607.235281:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1547 00000020:00080000:3.0:1784047607.235287:0:66219:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784047607.238230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.238266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.238314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.238402:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689529600 00000100:00100000:0.0:1784047607.238413:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689529600 00000100:00100000:0.0:1784047607.238468:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689529856 00000100:00100000:0.0:1784047607.238472:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689529856 00000100:00100000:0.0:1784047607.238493:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1548 00000100:00100000:0.0:1784047607.238502:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+49:73698:x1870705689529600:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.238527:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.238560:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c776600 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae70d expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.238600:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c776607 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.238644:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c776607 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.238655:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c776607 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.238764:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c776600 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae70d expref: 51 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.238787:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db800/0x4426598c0c776607 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae70d expref: 50 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.238796:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:0.0:1784047607.238799:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.238803:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27db800, rc 0) 00000100:00100000:0.0:1784047607.238861:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+50:73698:x1870705689529600:12345-192.168.204.40@tcp:101:dd.0 Request processed in 360us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.238876:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1548 00000100:00100000:0.0:1784047607.238894:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1549 00000100:00100000:0.0:1784047607.238901:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+49:73696:x1870705689529856:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.238909:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.238919:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c77660e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae714 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239258:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239269:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239277:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239290:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239296:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239301:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239362:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776623 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239370:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776623 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239387:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776623 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.239397:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:0.0:1784047607.239480:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239488:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239495:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239501:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239507:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27db400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.239511:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239518:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.239530:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.239533:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.240086:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530112 00000100:00100000:3.0:1784047607.240094:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530112 00000100:00100000:3.0:1784047607.240148:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 265 00000100:00100000:3.0:1784047607.240157:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+52:73695:x1870705689530112:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:3.0:1784047607.240385:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+53:73695:x1870705689530112:12345-192.168.204.40@tcp:35:dd.0 Request processed in 227us (2069us total) trans 124554051664 rc 0/0 00000100:00100000:3.0:1784047607.240392:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 265 00010000:00010000:0.0:1784047607.242267:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242284:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776615 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242309:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242331:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242350:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242356:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.242360:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242369:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242392:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff99cce7530d00) 00010000:00010000:0.0:1784047607.242395:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.242400:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242406:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c77661c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242481:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c77660e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae714 expref: 53 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242501:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776623 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae714 expref: 52 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.242510:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:0.0:1784047607.242513:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.242523:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27dba00, rc 0) 00000100:00100000:3.0:1784047607.242911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.242947:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.242994:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530240 00000100:00100000:1.0:1784047607.243003:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530240 00002000:00010000:1.0:1784047607.243033:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.243038:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1df80 with x1870705689530240 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.243047:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1df80. 00000100:00100000:1.0:1784047607.243079:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 607 00000100:00100000:1.0:1784047607.243089:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+8:2401:x1870705689530240:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:1.0:1784047607.243364:0:24865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784047607.243368:0:24865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.243370:0:24865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:1.0:1784047607.243372:0:24865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.243374:0:24865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784047607.243383:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1df80 x1870705689530240/t4294968780(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.243475:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+9:2401:x1870705689530240:12345-192.168.204.40@tcp:10:dd.0 Request processed in 387us (566us total) trans 4294968780 rc 0/0 00000100:00100000:1.0:1784047607.243484:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 607 00002000:00010000:1.0:1784047607.243488:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.243491:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1df80 with x1870705689530240 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.243495:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1df80. 00000100:00100000:3.0:1784047607.243594:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530368 00000100:00100000:3.0:1784047607.243600:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530368 00000100:00100000:3.0:1784047607.243670:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5038 00000100:00100000:3.0:1784047607.243678:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+9:73697:x1870705689530368:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.243700:0:26196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.243716:0:26196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2888778/0x4426598c0c776631 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae71b expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047607.243733:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x785:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:3.0:1784047607.243752:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:3.0:1784047607.243758:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047607.243766:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2888778/0x4426598c0c776631 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae71b expref: 10 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.243781:0:26196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2888778/0x4426598c0c776631 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae71b expref: 10 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.243791:0:26196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600200, rc 0) 00010000:00000080:3.0:1784047607.243796:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1ce00 x1870705689530368/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.243842:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+10:73697:x1870705689530368:12345-192.168.204.40@tcp:101:dd.0 Request processed in 165us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.243849:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5038 00000100:00100000:0.0:1784047607.243933:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+52:73696:x1870705689529856:12345-192.168.204.40@tcp:101:dd.0 Request processed in 5030us (5665us total) trans 124554051663 rc 0/0 00000100:00100000:0.0:1784047607.243940:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1549 00000100:00100000:3.0:1784047607.250538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.250598:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530752 00000100:00100000:0.0:1784047607.250643:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530752 00000100:00100000:3.0:1784047607.250667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.250705:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689531136 00000100:00100000:0.0:1784047607.250708:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689531136 00000100:00100000:2.0:1784047607.250716:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1550 00000100:00100000:2.0:1784047607.250731:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+53:73698:x1870705689530752:12345-192.168.204.40@tcp:36:dd.0 00000100:00100000:0.0:1784047607.250744:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1551 00000100:00100000:0.0:1784047607.250754:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+53:73699:x1870705689531136:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.250767:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.250788:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776638 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae729 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.250810:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047607.250837:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7765e4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6ff expref: 54 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.250878:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:2.0:1784047607.250883:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047607.250912:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.250925:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.250936:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.250968:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.250976:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.250981:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251038:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77664d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251047:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77664d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251054:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77664d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.251062:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784047607.251141:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251148:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251154:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251161:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251166:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.251170:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251176:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251184:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.251187:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.251197:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251204:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c77663f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251221:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251228:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251233:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251238:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce033aa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.251241:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251246:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251254:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff99cce7530a00) 00010000:00010000:0.0:1784047607.251257:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.251259:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251264:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c776646 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251305:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c776638 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae729 expref: 55 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251349:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77664d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae729 expref: 54 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.251357:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:0.0:1784047607.251359:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.251362:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033a200, rc 0) 00000100:00100000:0.0:1784047607.251437:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+54:73699:x1870705689531136:12345-192.168.204.40@tcp:101:dd.0 Request processed in 684us (769us total) trans 124554051665 rc 0/0 00000100:00100000:0.0:1784047607.251445:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1551 00000100:00100000:3.0:1784047607.252099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.252130:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530880 00000100:00100000:1.0:1784047607.252144:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530880 00000100:00100000:1.0:1784047607.252186:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1552 00000100:00100000:1.0:1784047607.252196:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+54:73696:x1870705689530880:12345-192.168.204.40@tcp:101:dd.0 00000100:00100000:3.0:1784047607.252203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:1.0:1784047607.252209:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.252223:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c77665b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae722 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047607.252229:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530496 00000100:00100000:3.0:1784047607.252234:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530496 00010000:00010000:1.0:1784047607.252249:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776662 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047607.252256:0:24868:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00010000:00010000:1.0:1784047607.252261:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776662 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1784047607.252270:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1ed80 with x1870705689530496 ext(0->18446744073709551615) 00010000:00010000:1.0:1784047607.252275:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776662 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047607.252280:0:24868:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1ed80. 00000100:00100000:3.0:1784047607.252305:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 608 00000100:00100000:3.0:1784047607.252313:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+10:2399:x1870705689530496:12345-192.168.204.40@tcp:10:dd.0 00010000:00010000:1.0:1784047607.252376:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c77665b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae722 expref: 56 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.252393:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce200/0x4426598c0c776662 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae722 expref: 55 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.252399:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:1.0:1784047607.252402:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784047607.252405:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce200, rc 0) 00000100:00100000:1.0:1784047607.252446:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+55:73696:x1870705689530880:12345-192.168.204.40@tcp:101:dd.0 Request processed in 252us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.252453:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1552 00002000:00010000:3.0:1784047607.252479:0:24868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784047607.252484:0:24868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.252486:0:24868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:3.0:1784047607.252488:0:24868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.252491:0:24868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784047607.252499:0:24868:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1ed80 x1870705689530496/t4294968781(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784047607.252501:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.252523:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.252538:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047607.252559:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689530496:12345-192.168.204.40@tcp:10:dd.0 Request processed in 245us (355us total) trans 4294968781 rc 0/0 00000100:00100000:3.0:1784047607.252570:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 608 00002000:00010000:3.0:1784047607.252573:0:24868:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.252575:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1ed80 with x1870705689530496 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.252581:0:24868:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1ed80. 00000001:00080000:2.0:1784047607.252625:0:66221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051666 00000004:00010000:2.0:1784047607.252651:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073f46bf8 reply state 0000000031757f89 transno 124554051667 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.252664:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.252671:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:2.0:1784047607.252674:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047607.252676:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784047607.252733:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+57:73698:x1870705689530752:12345-192.168.204.40@tcp:36:dd.0 Request processed in 2005us (2204us total) trans 124554051667 rc 0/0 00000100:00100000:2.0:1784047607.252740:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1550 00000020:00080000:2.0:1784047607.252744:0:66221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784047607.257714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.257759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.257783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.257788:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689531392 00000100:00100000:1.0:1784047607.257810:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689531392 00000100:00100000:3.0:1784047607.257817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.257864:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 266 00000100:00100000:1.0:1784047607.257876:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+57:73694:x1870705689531392:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.258174:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+58:73694:x1870705689531392:12345-192.168.204.40@tcp:35:dd.0 Request processed in 300us (480us total) trans 124554051668 rc 0/0 00000100:00100000:1.0:1784047607.258183:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 266 00000100:00100000:1.0:1784047607.258208:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689531776 00000100:00100000:1.0:1784047607.258212:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689531776 00000100:00100000:1.0:1784047607.258235:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689531648 00000100:00100000:1.0:1784047607.258237:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689531648 00000100:00100000:1.0:1784047607.258252:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532032 00000100:00100000:1.0:1784047607.258255:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532032 00000100:00100000:1.0:1784047607.258268:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1553 00000100:00100000:1.0:1784047607.258275:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+60:73699:x1870705689531776:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.258285:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.258306:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c776670 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae730 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258353:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776677 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258367:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776677 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258388:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776677 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047607.258442:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1554 00000100:00100000:2.0:1784047607.258455:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+61:73696:x1870705689531648:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1784047607.258473:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c776670 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae730 expref: 62 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258484:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047607.258504:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf400/0x4426598c0c776677 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae730 expref: 61 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258513:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c776623 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae714 expref: 61 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258515:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:1.0:1784047607.258522:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784047607.258526:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf400, rc 0) 00010000:00010000:2.0:1784047607.258537:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:2.0:1784047607.258543:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047607.258557:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+60:73699:x1870705689531776:12345-192.168.204.40@tcp:101:dd.0 Request processed in 282us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.258564:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1553 00000100:00100000:1.0:1784047607.258580:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1555 00000100:00100000:1.0:1784047607.258587:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+59:73700:x1870705689532032:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.258595:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.258645:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c77667e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae737 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258660:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258671:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258680:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784047607.258719:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051669 00010000:00010000:1.0:1784047607.258742:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784047607.258743:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d78be87 reply state 0000000068dd4e59 transno 124554051670 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258763:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258766:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258780:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.258781:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:2.0:1784047607.258787:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047607.258791:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784047607.258803:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258823:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258832:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784047607.258842:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+63:73696:x1870705689531648:12345-192.168.204.40@tcp:36:dd.0 Request processed in 389us (1057us total) trans 124554051670 rc 0/0 00000100:00100000:2.0:1784047607.258849:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1554 00000020:00080000:2.0:1784047607.258852:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784047607.258875:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c77669a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258884:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c77669a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258892:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c77669a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784047607.258901:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:1.0:1784047607.258946:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258954:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258960:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258967:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258973:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cfa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047607.258977:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.258994:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259004:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:1.0:1784047607.259007:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047607.259010:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259015:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c77668c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259023:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259028:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259033:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259038:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:1.0:1784047607.259040:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259046:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259053:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff99cd02171600) 00010000:00010000:1.0:1784047607.259055:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784047607.259058:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259073:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c776693 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259110:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cea00/0x4426598c0c77667e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae737 expref: 64 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259123:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c77669a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae737 expref: 63 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.259130:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:1.0:1784047607.259132:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784047607.259134:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce400, rc 0) 00000100:00100000:1.0:1784047607.259157:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+63:73700:x1870705689532032:12345-192.168.204.40@tcp:101:dd.0 Request processed in 571us (1340us total) trans 124554051671 rc 0/0 00000100:00100000:1.0:1784047607.259163:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1555 00000100:00100000:3.0:1784047607.260527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.260642:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532160 00000100:00100000:0.0:1784047607.260651:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532160 00000100:00100000:0.0:1784047607.260697:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5039 00000100:00100000:0.0:1784047607.260705:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+11:73698:x1870705689532160:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.260722:0:26190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.260740:0:26190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f3e8ddb/0x4426598c0c7766a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae73e expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.260768:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x786:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:0.0:1784047607.262486:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:0.0:1784047607.262495:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047607.262506:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f3e8ddb/0x4426598c0c7766a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae73e expref: 12 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.262527:0:26190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f3e8ddb/0x4426598c0c7766a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae73e expref: 12 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.262563:0:26190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033a600, rc 0) 00010000:00000080:0.0:1784047607.262574:0:26190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1f480 x1870705689532160/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.262664:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+12:73698:x1870705689532160:12345-192.168.204.40@tcp:101:dd.0 Request processed in 1959us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.262672:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5039 00000100:00100000:0.0:1784047607.267204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.267314:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532416 00000100:00100000:3.0:1784047607.267324:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532416 00000100:00100000:3.0:1784047607.267393:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 267 00000100:00100000:3.0:1784047607.267403:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+63:73697:x1870705689532416:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:3.0:1784047607.267974:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+64:73697:x1870705689532416:12345-192.168.204.40@tcp:35:dd.0 Request processed in 570us (777us total) trans 124554051672 rc 0/0 00000100:00100000:3.0:1784047607.267983:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 267 00000100:00100000:3.0:1784047607.275470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.277330:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.277426:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532800 00000100:00100000:2.0:1784047607.277437:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532800 00000100:00100000:2.0:1784047607.277508:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1556 00000100:00100000:2.0:1784047607.277520:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+64:73699:x1870705689532800:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:2.0:1784047607.277595:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047607.277669:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77664d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae729 expref: 64 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.277693:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:2.0:1784047607.277698:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047607.277895:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.277910:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.277920:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784047607.277967:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051673 00000004:00010000:2.0:1784047607.277989:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0017c46 reply state 00000000f35757df transno 124554051674 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.278014:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.278021:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:2.0:1784047607.278024:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047607.278026:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047607.278088:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532544 00000100:00100000:1.0:1784047607.278095:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532544 00000100:00100000:1.0:1784047607.278133:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5040 00000100:00100000:1.0:1784047607.278142:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+12:73696:x1870705689532544:12345-192.168.204.40@tcp:101:dd.0 00000100:00100000:2.0:1784047607.278145:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+66:73699:x1870705689532800:12345-192.168.204.40@tcp:36:dd.0 Request processed in 625us (819us total) trans 124554051674 rc 0/0 00010000:00010000:1.0:1784047607.278155:0:26181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784047607.278156:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1556 00000020:00080000:2.0:1784047607.278164:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784047607.278174:0:26181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c7766b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae745 expref: -99 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047607.278196:0:26181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x784:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:2.0:1784047607.280063:0:26181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:2.0:1784047607.280086:0:26181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047607.280098:0:26181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c7766b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae745 expref: 13 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.280118:0:26181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c7766b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae745 expref: 13 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.280133:0:26181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cea00, rc 0) 00010000:00000080:2.0:1784047607.280141:0:26181:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00f38050 x1870705689532544/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.280216:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+13:73696:x1870705689532544:12345-192.168.204.40@tcp:101:dd.0 Request processed in 2075us (4757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.280225:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5040 00000100:00100000:0.0:1784047607.283416:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.283496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.283563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.283877:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533056 00000100:00100000:3.0:1784047607.283887:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533056 00000100:00100000:3.0:1784047607.283934:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533312 00000100:00100000:3.0:1784047607.283937:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533312 00000100:00100000:3.0:1784047607.283961:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1557 00000100:00100000:3.0:1784047607.283969:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+67:73700:x1870705689533056:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.283996:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.284015:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7766bd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae74c expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284048:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600600/0x4426598c0c7766c4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284063:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600600/0x4426598c0c7766c4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284073:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600600/0x4426598c0c7766c4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284185:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7766bd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae74c expref: 69 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284202:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600600/0x4426598c0c7766c4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae74c expref: 68 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284222:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:3.0:1784047607.284225:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784047607.284228:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600600, rc 0) 00000100:00100000:3.0:1784047607.284287:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+68:73700:x1870705689533056:12345-192.168.204.40@tcp:101:dd.0 Request processed in 318us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.284293:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1557 00000100:00100000:3.0:1784047607.284312:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1558 00000100:00100000:3.0:1784047607.284318:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+67:73701:x1870705689533312:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.284326:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.284347:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7766cb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae753 expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284513:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284522:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284530:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284542:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284698:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284709:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284767:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601400/0x4426598c0c7766e0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284777:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601400/0x4426598c0c7766e0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284784:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601400/0x4426598c0c7766e0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047607.284794:0:66219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:3.0:1784047607.284872:0:66219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284880:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284885:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284892:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284898:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047607.284902:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284909:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284919:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:3.0:1784047607.284922:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047607.284932:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284939:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7766d2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284950:0:66219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284956:0:66219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284961:0:66219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284966:0:66219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047607.284968:0:66219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284974:0:66219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284982:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff99cd001e7100) 00010000:00010000:3.0:1784047607.284985:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047607.284988:0:66219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.284993:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7766d9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.285026:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7766cb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae753 expref: 70 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.285051:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601400/0x4426598c0c7766e0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae753 expref: 69 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.285059:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:3.0:1784047607.285062:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047607.285065:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601400, rc 0) 00000100:00100000:3.0:1784047607.285103:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+69:73701:x1870705689533312:12345-192.168.204.40@tcp:101:dd.0 Request processed in 784us (1539us total) trans 124554051675 rc 0/0 00000100:00100000:3.0:1784047607.285110:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1558 00000100:00100000:1.0:1784047607.286368:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532928 00000100:00100000:1.0:1784047607.286388:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532928 00002000:00010000:1.0:1784047607.286431:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.286436:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc9b94000 with x1870705689532928 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.286446:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc9b94000. 00000100:00100000:1.0:1784047607.286480:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 609 00000100:00100000:1.0:1784047607.286489:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+13:2402:x1870705689532928:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:1.0:1784047607.287118:0:24866:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784047607.287122:0:24866:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.287124:0:24866:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:1.0:1784047607.287126:0:24866:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.287127:0:24866:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784047607.287137:0:24866:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9b94000 x1870705689532928/t4294968782(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.289533:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+14:2402:x1870705689532928:12345-192.168.204.40@tcp:10:dd.0 Request processed in 3032us (6112us total) trans 4294968782 rc 0/0 00000100:00100000:1.0:1784047607.289673:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 609 00002000:00010000:1.0:1784047607.289679:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.289683:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc9b94000 with x1870705689532928 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.289695:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc9b94000. 00000100:00100000:0.0:1784047607.290003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.290829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.290867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.290933:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533568 00000100:00100000:3.0:1784047607.290942:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533568 00002000:00010000:3.0:1784047607.290989:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.290995:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfde0d180 with x1870705689533568 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.291003:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfde0d180. 00000100:00100000:3.0:1784047607.291026:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 610 00000100:00100000:3.0:1784047607.291036:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+14:2401:x1870705689533568:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:3.0:1784047607.291174:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784047607.291177:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.291179:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:3.0:1784047607.291182:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.291184:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784047607.291193:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0d180 x1870705689533568/t4294968783(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.291247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+15:2401:x1870705689533568:12345-192.168.204.40@tcp:10:dd.0 Request processed in 212us (420us total) trans 4294968783 rc 0/0 00000100:00100000:3.0:1784047607.291267:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 610 00002000:00010000:3.0:1784047607.291270:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.291273:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfde0d180 with x1870705689533568 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.291278:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfde0d180. 00000100:00100000:2.0:1784047607.292160:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533440 00000100:00100000:2.0:1784047607.292169:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533440 00000100:00100000:2.0:1784047607.292213:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5041 00000100:00100000:2.0:1784047607.292222:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0c846d7a-6357-4e9c-a620-e35737ede709+15:73699:x1870705689533440:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.292234:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.292252:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c7766ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae75a expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047607.292272:0:26189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x787:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:2.0:1784047607.292292:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:2.0:1784047607.292297:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047607.292305:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c7766ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae75a expref: 16 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.292356:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c7766ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae75a expref: 16 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.292370:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b200, rc 0) 00010000:00000080:2.0:1784047607.292376:0:26189:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfde0ca80 x1870705689533440/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.292524:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0c846d7a-6357-4e9c-a620-e35737ede709+16:73699:x1870705689533440:12345-192.168.204.40@tcp:101:dd.0 Request processed in 302us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.292531:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5041 00000100:00100000:2.0:1784047607.293504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.293810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.293940:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533824 00000100:00100000:1.0:1784047607.293949:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533824 00000100:00100000:1.0:1784047607.293991:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533952 00000100:00100000:1.0:1784047607.293994:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533952 00000100:00100000:1.0:1784047607.294014:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1559 00000100:00100000:1.0:1784047607.294023:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+70:73700:x1870705689533824:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1784047607.294074:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047607.294100:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce400/0x4426598c0c77669a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae737 expref: 70 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.294131:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:1.0:1784047607.294136:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047607.294279:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.294289:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.294296:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047607.294325:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051676 00000004:00010000:1.0:1784047607.294364:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006419c8ca reply state 0000000063eadc02 transno 124554051677 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.294462:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689534208 00000100:00100000:0.0:1784047607.294466:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689534208 00000100:00100000:0.0:1784047607.294488:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1560 00000100:00100000:0.0:1784047607.294494:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+72:73701:x1870705689533952:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.294506:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.294518:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033bc00/0x4426598c0c7766fc lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae761 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295018:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033be00/0x4426598c0c776703 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295043:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033be00/0x4426598c0c776703 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295053:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033be00/0x4426598c0c776703 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295144:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033bc00/0x4426598c0c7766fc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae761 expref: 74 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295163:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033be00/0x4426598c0c776703 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae761 expref: 73 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295171:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:0.0:1784047607.295174:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.295177:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033be00, rc 0) 00000100:00100000:0.0:1784047607.295231:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+73:73701:x1870705689533952:12345-192.168.204.40@tcp:101:dd.0 Request processed in 736us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.295239:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1560 00000100:00100000:0.0:1784047607.295262:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1561 00000100:00100000:0.0:1784047607.295269:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+72:73702:x1870705689534208:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.295277:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.295287:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77670a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae768 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295494:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295513:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295521:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295535:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295753:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295761:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295807:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77671f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295816:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77671f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295823:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77671f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.295831:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784047607.295896:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295905:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295911:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295924:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295930:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce033a200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.295934:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295941:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295951:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.295953:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.295957:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295964:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c776711 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295976:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295982:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295988:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.295994:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce033b400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.295996:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.296011:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.296020:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff99cce7530a00) 00010000:00010000:0.0:1784047607.296022:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.296025:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.296030:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c776718 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.296066:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77670a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae768 expref: 75 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.296079:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77671f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae768 expref: 74 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.296085:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:0.0:1784047607.296087:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.296089:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033aa00, rc 0) 00000100:00100000:0.0:1784047607.296131:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+74:73702:x1870705689534208:12345-192.168.204.40@tcp:101:dd.0 Request processed in 863us (2324us total) trans 124554051678 rc 0/0 00000100:00100000:0.0:1784047607.296139:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1561 00010000:00010000:1.0:1784047607.296326:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.296349:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:1.0:1784047607.296351:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047607.296355:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784047607.296491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.296510:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689534464 00000100:00100000:1.0:1784047607.296518:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689534464 00000100:00100000:0.0:1784047607.297969:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+75:73700:x1870705689533824:12345-192.168.204.40@tcp:36:dd.0 Request processed in 3930us (7084us total) trans 124554051677 rc 0/0 00000100:00100000:0.0:1784047607.297979:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1559 00000020:00080000:0.0:1784047607.297984:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784047607.298226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.298256:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689534592 00000100:00100000:1.0:1784047607.298258:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 268 00000100:00100000:3.0:1784047607.298262:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689534592 00000100:00100000:1.0:1784047607.298270:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+74:73698:x1870705689534464:12345-192.168.204.40@tcp:35:dd.0 00002000:00010000:3.0:1784047607.298284:0:24867:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.298289:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1ea00 with x1870705689534592 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.298299:0:24867:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1ea00. 00000100:00100000:3.0:1784047607.298321:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 611 00000100:00100000:3.0:1784047607.298329:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+16:2400:x1870705689534592:12345-192.168.204.40@tcp:10:dd.0 00000100:00100000:0.0:1784047607.298360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00002000:00010000:3.0:1784047607.298472:0:24867:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784047607.298476:0:24867:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.298479:0:24867:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:3.0:1784047607.298482:0:24867:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00000100:00100000:2.0:1784047607.298483:0:66222:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00002000:00010000:3.0:1784047607.298486:0:24867:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784047607.298495:0:66222:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00000080:3.0:1784047607.298497:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1ea00 x1870705689534592/t4294968784(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.298504:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+75:73698:x1870705689534464:12345-192.168.204.40@tcp:35:dd.0 Request processed in 238us (2013us total) trans 124554051679 rc 0/0 00000100:00100000:1.0:1784047607.298513:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 268 00000100:00100000:3.0:1784047607.298524:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+17:2400:x1870705689534592:12345-192.168.204.40@tcp:10:dd.0 Request processed in 198us (301us total) trans 4294968784 rc 0/0 00000100:00100000:3.0:1784047607.298530:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 611 00000100:00100000:1.0:1784047607.298533:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689534848 00002000:00010000:3.0:1784047607.298534:0:24867:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.298536:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1ea00 with x1870705689534592 ext(0->18446744073709551615) 00000100:00100000:1.0:1784047607.298536:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689534848 00002000:00010000:3.0:1784047607.298547:0:24867:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1ea00. 00000100:00100000:1.0:1784047607.298572:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 269 00000100:00100000:1.0:1784047607.298578:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+75:73696:x1870705689534848:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.298801:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+76:73696:x1870705689534848:12345-192.168.204.40@tcp:35:dd.0 Request processed in 221us (441us total) trans 124554051680 rc 0/0 00000100:00100000:1.0:1784047607.298808:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 269 00000100:00100000:2.0:1784047607.299364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.299453:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689535104 00000100:00100000:3.0:1784047607.299459:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689535104 00000100:00100000:3.0:1784047607.299498:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1562 00000100:00100000:3.0:1784047607.299505:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+76:73701:x1870705689535104:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.299535:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.299561:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601400/0x4426598c0c7766e0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae753 expref: 76 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.299577:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:3.0:1784047607.299582:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047607.299957:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.299972:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.299981:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047607.300023:0:67153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051681 00000004:00010000:3.0:1784047607.300048:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9af458d reply state 000000001b54fd64 transno 124554051682 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.300060:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.300067:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:3.0:1784047607.300070:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.300072:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047607.300160:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+78:73701:x1870705689535104:12345-192.168.204.40@tcp:36:dd.0 Request processed in 654us (796us total) trans 124554051682 rc 0/0 00000100:00100000:3.0:1784047607.300167:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1562 00000020:00080000:3.0:1784047607.300171:0:67153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784047607.305261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.305412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.306817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.306843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.306916:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.306942:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689535616 00000100:00100000:1.0:1784047607.306981:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689535744 00000100:00100000:1.0:1784047607.306991:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689535744 00000100:00100000:1.0:1784047607.307055:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5042 00000100:00100000:1.0:1784047607.307068:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+17:73701:x1870705689535744:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.307089:0:26183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.307111:0:26183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c776734 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae784 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047607.307137:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x789:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:1.0:1784047607.307164:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:1.0:1784047607.307169:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047607.307179:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c776734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae784 expref: 18 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.307195:0:26183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c776734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae784 expref: 18 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.307208:0:26183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce400, rc 0) 00010000:00000080:1.0:1784047607.307216:0:26183:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdcfaa00 x1870705689535744/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.307300:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+18:73701:x1870705689535744:12345-192.168.204.40@tcp:101:dd.0 Request processed in 235us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.307307:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5042 00000100:00100000:1.0:1784047607.307346:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536000 00000100:00100000:1.0:1784047607.307349:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536000 00000100:00100000:1.0:1784047607.307382:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 270 00000100:00100000:1.0:1784047607.307389:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+78:73699:x1870705689536000:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:2.0:1784047607.307500:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689535616 00000100:00100000:2.0:1784047607.307552:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5043 00000100:00100000:2.0:1784047607.307559:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+18:73700:x1870705689535616:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.307567:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.307585:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c77673b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae77d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047607.307600:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x788:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:2.0:1784047607.307633:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:2.0:1784047607.307637:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047607.307643:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c77673b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae77d expref: 19 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.307655:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c77673b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae77d expref: 19 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.307663:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24ac00, rc 0) 00010000:00000080:2.0:1784047607.307668:0:8432:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdcfb480 x1870705689535616/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.307695:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+19:73700:x1870705689535616:12345-192.168.204.40@tcp:101:dd.0 Request processed in 136us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.307701:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5043 00000100:00100000:1.0:1784047607.307945:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+79:73699:x1870705689536000:12345-192.168.204.40@tcp:35:dd.0 Request processed in 555us (1027us total) trans 124554051683 rc 0/0 00000100:00100000:1.0:1784047607.307952:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 270 00000100:00100000:3.0:1784047607.308466:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689535488 00000100:00100000:0.0:1784047607.308466:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689535232 00000100:00100000:3.0:1784047607.308473:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689535488 00000100:00100000:0.0:1784047607.308473:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689535232 00000100:00100000:0.0:1784047607.308559:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1563 00000100:00100000:0.0:1784047607.308568:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+80:73703:x1870705689535488:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.308580:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.308596:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c776742 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae776 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308732:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308746:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308756:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308770:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308778:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308784:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308830:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776757 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308838:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776757 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047607.308855:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1564 00010000:00010000:0.0:1784047607.308860:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776757 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047607.308864:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+81:73702:x1870705689535232:12345-192.168.204.40@tcp:101:dd.0 00000004:00200000:0.0:1784047607.308871:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00010000:00010000:3.0:1784047607.308872:0:66219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.308882:0:66219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c77675e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae76f expref: -99 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.308901:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77676c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.308909:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77676c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.308916:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77676c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308930:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308937:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308943:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308948:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308953:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.308958:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308965:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308978:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.308981:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047607.308986:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c77675e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae76f expref: 84 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308986:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.308993:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c776749 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309004:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.309005:0:66219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a200/0x4426598c0c77676c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae76f expref: 83 pid: 66219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.309012:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:3.0:1784047607.309015:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.309017:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.309021:0:66219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033a200, rc 0) 00010000:00010000:0.0:1784047607.309023:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309027:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.309030:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309036:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309043:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff99cce7530a00) 00010000:00010000:0.0:1784047607.309046:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.309048:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309053:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c776750 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047607.309058:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+83:73702:x1870705689535232:12345-192.168.204.40@tcp:101:dd.0 Request processed in 197us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.309065:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1564 00010000:00010000:0.0:1784047607.309084:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c776742 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae776 expref: 83 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309095:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776757 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae776 expref: 82 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.309102:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:0.0:1784047607.309105:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.309112:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27db400, rc 0) 00000100:00100000:0.0:1784047607.309140:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+82:73703:x1870705689535488:12345-192.168.204.40@tcp:101:dd.0 Request processed in 574us (3729us total) trans 124554051684 rc 0/0 00000100:00100000:0.0:1784047607.309147:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1563 00000100:00100000:1.0:1784047607.312223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.312308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.312404:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536256 00000100:00100000:3.0:1784047607.312414:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536256 00000100:00100000:3.0:1784047607.312470:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1565 00000100:00100000:3.0:1784047607.312482:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+82:73703:x1870705689536256:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.312503:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.312527:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033bc00/0x4426598c0c776773 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae78b expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.312577:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a800/0x4426598c0c77677a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.312593:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a800/0x4426598c0c77677a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.312625:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a800/0x4426598c0c77677a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.312742:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033bc00/0x4426598c0c776773 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae78b expref: 84 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.312763:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033a800/0x4426598c0c77677a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae78b expref: 83 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.312772:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:3.0:1784047607.312774:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784047607.312786:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033a800, rc 0) 00000100:00100000:3.0:1784047607.312855:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+83:73703:x1870705689536256:12345-192.168.204.40@tcp:101:dd.0 Request processed in 375us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.312862:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1565 00000100:00100000:0.0:1784047607.313518:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536128 00000100:00100000:0.0:1784047607.313526:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536128 00000100:00100000:3.0:1784047607.313984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.314227:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536896 00000100:00100000:2.0:1784047607.314232:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536896 00000100:00100000:2.0:1784047607.314284:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1566 00000100:00100000:2.0:1784047607.314294:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+83:73704:x1870705689536896:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.314317:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.314344:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c776781 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae792 expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314509:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314522:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314534:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314564:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314570:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314576:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314656:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776796 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314665:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776796 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314673:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776796 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.314682:0:68026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:2.0:1784047607.314765:0:68026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314773:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314788:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314795:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314802:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.314807:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314814:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314828:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.314831:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.314835:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314842:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776788 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314854:0:68026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314860:0:68026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314866:0:68026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314871:0:68026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.314880:0:68026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314885:0:68026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314893:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff99ccd2342500) 00010000:00010000:2.0:1784047607.314895:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.314897:0:68026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314902:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c77678f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314943:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c776781 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae792 expref: 86 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314956:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776796 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae792 expref: 85 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.314963:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:2.0:1784047607.314965:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.314968:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b600, rc 0) 00000100:00100000:2.0:1784047607.315024:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+85:73704:x1870705689536896:12345-192.168.204.40@tcp:101:dd.0 Request processed in 732us (1042us total) trans 124554051685 rc 0/0 00000100:00100000:2.0:1784047607.315031:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1566 00002000:00010000:0.0:1784047607.316911:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.316922:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef51ca80 with x1870705689536128 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.316934:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef51ca80. 00000100:00100000:0.0:1784047607.316975:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 612 00000100:00100000:0.0:1784047607.316987:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+19:2402:x1870705689536128:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:0.0:1784047607.317311:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.317315:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.317317:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:0.0:1784047607.317320:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.317322:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.317341:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51ca80 x1870705689536128/t4294968785(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.317483:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+20:2402:x1870705689536128:12345-192.168.204.40@tcp:10:dd.0 Request processed in 499us (5269us total) trans 4294968785 rc 0/0 00000100:00100000:0.0:1784047607.317492:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 612 00002000:00010000:0.0:1784047607.317551:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.317555:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef51ca80 with x1870705689536128 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.317561:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef51ca80. 00000100:00100000:3.0:1784047607.317976:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.318034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.318106:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536384 00000100:00100000:1.0:1784047607.318114:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536384 00002000:00010000:1.0:1784047607.318138:0:24868:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.318142:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1ce00 with x1870705689536384 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.318149:0:24868:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1ce00. 00000100:00100000:1.0:1784047607.318178:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 613 00000100:00100000:1.0:1784047607.318186:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+20:2401:x1870705689536384:12345-192.168.204.40@tcp:10:dd.0 00000100:00100000:0.0:1784047607.318239:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536640 00000100:00100000:0.0:1784047607.318244:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536640 00002000:00010000:1.0:1784047607.318280:0:24868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784047607.318284:0:24868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.318287:0:24868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00000100:00100000:0.0:1784047607.318290:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1567 00002000:00010000:1.0:1784047607.318291:0:24868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.318296:0:24868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784047607.318302:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+85:73702:x1870705689536640:12345-192.168.204.40@tcp:36:dd.0 00010000:00000080:1.0:1784047607.318306:0:24868:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdd1ce00 x1870705689536384/t4294968786(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1784047607.318359:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047607.318389:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77671f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae768 expref: 85 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.318410:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:0.0:1784047607.318417:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047607.318446:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+21:2401:x1870705689536384:12345-192.168.204.40@tcp:10:dd.0 Request processed in 187us (337us total) trans 4294968786 rc 0/0 00000100:00100000:1.0:1784047607.318454:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 613 00002000:00010000:1.0:1784047607.318458:0:24868:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.318461:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdd1ce00 with x1870705689536384 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.318466:0:24868:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdd1ce00. 00010000:00010000:0.0:1784047607.318961:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.318978:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.318989:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784047607.319590:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051686 00000004:00010000:0.0:1784047607.319652:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d26d4867 reply state 00000000a7492855 transno 124554051687 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.319669:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.319677:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:0.0:1784047607.319680:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047607.319684:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047607.319837:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+87:73702:x1870705689536640:12345-192.168.204.40@tcp:36:dd.0 Request processed in 1535us (1859us total) trans 124554051687 rc 0/0 00000100:00100000:1.0:1784047607.319845:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1567 00000020:00080000:1.0:1784047607.319850:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784047607.319936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.320897:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689537152 00000100:00100000:1.0:1784047607.320907:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689537152 00000100:00100000:1.0:1784047607.320967:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1568 00000100:00100000:1.0:1784047607.320977:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+87:73703:x1870705689537152:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1784047607.321021:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047607.321044:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c776757 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae776 expref: 87 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.321064:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:1.0:1784047607.321068:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047607.321209:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.321224:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.321232:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047607.321289:0:66219:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051688 00000004:00010000:1.0:1784047607.321315:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000900a0b8f reply state 0000000087b65375 transno 124554051689 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.321327:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.321346:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:1.0:1784047607.321348:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047607.321351:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047607.321480:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+89:73703:x1870705689537152:12345-192.168.204.40@tcp:36:dd.0 Request processed in 504us (1542us total) trans 124554051689 rc 0/0 00000100:00100000:1.0:1784047607.321488:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1568 00000020:00080000:1.0:1784047607.321493:0:66219:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.324788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.324868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.324985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.325004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.325050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.325069:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689537920 00000100:00100000:0.0:1784047607.325077:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689537920 00000100:00100000:0.0:1784047607.325280:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538176 00000100:00100000:0.0:1784047607.325283:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538176 00000100:00100000:0.0:1784047607.325297:0:95918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 271 00000100:00100000:0.0:1784047607.325303:0:95918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+90:73700:x1870705689537920:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.325363:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689537280 00000100:00100000:1.0:1784047607.325368:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689537280 00000100:00100000:2.0:1784047607.325477:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 272 00000100:00100000:2.0:1784047607.325489:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+90:73701:x1870705689538176:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:2.0:1784047607.325728:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+92:73701:x1870705689538176:12345-192.168.204.40@tcp:35:dd.0 Request processed in 237us (671us total) trans 124554051691 rc 0/0 00000100:00100000:0.0:1784047607.325729:0:95918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+92:73700:x1870705689537920:12345-192.168.204.40@tcp:35:dd.0 Request processed in 418us (737us total) trans 124554051690 rc 0/0 00000100:00100000:0.0:1784047607.325741:0:95918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 271 00000100:00100000:2.0:1784047607.325750:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 272 00000100:00100000:1.0:1784047607.325985:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689537536 00000100:00100000:1.0:1784047607.325990:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689537536 00000100:00100000:0.0:1784047607.326090:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1569 00000100:00100000:0.0:1784047607.326240:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+92:73704:x1870705689537280:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.326252:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.326272:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c7767b2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae799 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326307:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7767b9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326320:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7767b9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326348:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7767b9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326430:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da600/0x4426598c0c7767b2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae799 expref: 94 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326451:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da800/0x4426598c0c7767b9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae799 expref: 93 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326467:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:0.0:1784047607.326470:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.326474:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27da800, rc 0) 00000100:00100000:0.0:1784047607.326519:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+93:73704:x1870705689537280:12345-192.168.204.40@tcp:101:dd.0 Request processed in 421us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.326526:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1569 00000100:00100000:0.0:1784047607.326545:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1570 00000100:00100000:0.0:1784047607.326552:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+92:73705:x1870705689537536:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.326560:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.326570:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7767c0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7a0 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326708:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326718:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326725:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326741:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326749:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326755:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326807:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7767d5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326815:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7767d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.326822:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7767d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.326831:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00000100:00100000:1.0:1784047607.327963:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689537664 00000100:00100000:1.0:1784047607.327974:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689537664 00000100:00100000:1.0:1784047607.328032:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5044 00000100:00100000:1.0:1784047607.328042:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+21:73702:x1870705689537664:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.328056:0:26182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.328075:0:26182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c7767e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7a7 expref: -99 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047607.328372:0:26182:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78a:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:1.0:1784047607.328398:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:1.0:1784047607.328414:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047607.328424:0:26182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c7767e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7a7 expref: 22 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.328441:0:26182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c7767e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7a7 expref: 22 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.328454:0:26182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9cf200, rc 0) 00010000:00000080:1.0:1784047607.328462:0:26182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00416680 x1870705689537664/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.328546:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0c846d7a-6357-4e9c-a620-e35737ede709+22:73702:x1870705689537664:12345-192.168.204.40@tcp:101:dd.0 Request processed in 505us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.328554:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5044 00010000:00010000:0.0:1784047607.328758:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328769:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328777:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328784:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328790:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27db400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.328863:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328873:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328888:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.328892:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.328903:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328911:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27db400/0x4426598c0c7767c7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328930:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328936:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328942:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328948:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27dbe00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.328951:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328957:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328965:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff99cce7530a00) 00010000:00010000:0.0:1784047607.328968:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.328970:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.328977:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dbe00/0x4426598c0c7767ce lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.329030:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da400/0x4426598c0c7767c0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7a0 expref: 95 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.329064:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7767d5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7a0 expref: 94 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.329072:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047607.329074:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.329076:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27dba00, rc 0) 00000100:00100000:0.0:1784047607.329103:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+94:73705:x1870705689537536:12345-192.168.204.40@tcp:101:dd.0 Request processed in 2552us (4236us total) trans 124554051692 rc 0/0 00000100:00100000:0.0:1784047607.329110:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1570 00000100:00100000:3.0:1784047607.330348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.330410:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538304 00000100:00100000:1.0:1784047607.330419:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538304 00000100:00100000:1.0:1784047607.330462:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5045 00000100:00100000:1.0:1784047607.330471:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+22:73703:x1870705689538304:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.330487:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.330517:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c7767ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7ae expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047607.330541:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78b:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:1.0:1784047607.330560:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:1.0:1784047607.330564:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047607.330572:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c7767ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ae expref: 23 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.330621:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c7767ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ae expref: 23 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.330635:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce000, rc 0) 00010000:00000080:1.0:1784047607.330642:0:8433:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc6d42680 x1870705689538304/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.330698:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+23:73703:x1870705689538304:12345-192.168.204.40@tcp:101:dd.0 Request processed in 227us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.330704:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5045 00000100:00100000:0.0:1784047607.333012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.333064:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538560 00000100:00100000:1.0:1784047607.333075:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538560 00000100:00100000:1.0:1784047607.333153:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1571 00000100:00100000:1.0:1784047607.333165:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+94:73704:x1870705689538560:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1784047607.333234:0:66219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047607.333261:0:66219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776796 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae792 expref: 94 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.333278:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:1.0:1784047607.333283:0:66219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784047607.333471:0:66219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.333485:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.333510:0:66219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784047607.333569:0:66219:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051693 00000004:00010000:1.0:1784047607.333594:0:66219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000265a40a8 reply state 00000000328238f3 transno 124554051694 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.333630:0:66219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.333638:0:66219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:1.0:1784047607.333640:0:66219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784047607.333643:0:66219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784047607.333733:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+96:73704:x1870705689538560:12345-192.168.204.40@tcp:36:dd.0 Request processed in 570us (730us total) trans 124554051694 rc 0/0 00000100:00100000:1.0:1784047607.333740:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1571 00000020:00080000:1.0:1784047607.333745:0:66219:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.334906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.335247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.335825:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538688 00000100:00100000:2.0:1784047607.335837:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538688 00002000:00010000:2.0:1784047607.335877:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.335882:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc79f1880 with x1870705689538688 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.335893:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc79f1880. 00000100:00100000:3.0:1784047607.335929:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538944 00000100:00100000:3.0:1784047607.335934:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538944 00002000:00010000:3.0:1784047607.335952:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.335956:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc79f0a80 with x1870705689538944 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.335961:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc79f0a80. 00000100:00100000:3.0:1784047607.335994:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 614 00000100:00100000:3.0:1784047607.336003:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+24:2399:x1870705689538688:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:3.0:1784047607.336154:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784047607.336158:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.336160:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:3.0:1784047607.336163:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.336165:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784047607.336175:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc79f1880 x1870705689538688/t4294968787(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.336247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+25:2399:x1870705689538688:12345-192.168.204.40@tcp:10:dd.0 Request processed in 245us (1346us total) trans 4294968787 rc 0/0 00000100:00100000:3.0:1784047607.336255:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 614 00002000:00010000:3.0:1784047607.336273:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.336277:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc79f1880 with x1870705689538688 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.336281:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc79f1880. 00000100:00100000:3.0:1784047607.336300:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 615 00000100:00100000:3.0:1784047607.336307:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+24:2402:x1870705689538944:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:3.0:1784047607.336383:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784047607.336386:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.336388:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:3.0:1784047607.336390:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:3.0:1784047607.336392:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784047607.336399:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc79f0a80 x1870705689538944/t4294968788(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.336425:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+25:2402:x1870705689538944:12345-192.168.204.40@tcp:10:dd.0 Request processed in 118us (1179us total) trans 4294968788 rc 0/0 00000100:00100000:3.0:1784047607.336432:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 615 00002000:00010000:3.0:1784047607.336435:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00002000:00100000:3.0:1784047607.336438:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc79f0a80 with x1870705689538944 ext(0->18446744073709551615) 00002000:00010000:3.0:1784047607.336443:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc79f0a80. 00000100:00100000:3.0:1784047607.337278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.337318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.337398:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538816 00000100:00100000:0.0:1784047607.337404:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538816 00000100:00100000:0.0:1784047607.337446:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689539200 00000100:00100000:0.0:1784047607.337449:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689539200 00000100:00100000:0.0:1784047607.337468:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1572 00000100:00100000:0.0:1784047607.337474:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+97:73705:x1870705689538816:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.337494:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.337514:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c7767f8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7b5 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337562:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2600/0x4426598c0c7767ff lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337577:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2600/0x4426598c0c7767ff lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337600:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2600/0x4426598c0c7767ff lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337733:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c7767f8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7b5 expref: 99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337754:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2600/0x4426598c0c7767ff lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7b5 expref: 98 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337762:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047607.337765:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.337769:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c2600, rc 0) 00000100:00100000:0.0:1784047607.337812:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+98:73705:x1870705689538816:12345-192.168.204.40@tcp:101:dd.0 Request processed in 336us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.337818:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1572 00000100:00100000:0.0:1784047607.337835:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1573 00000100:00100000:0.0:1784047607.337841:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+97:73706:x1870705689539200:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.337849:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.337858:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3200/0x4426598c0c776806 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7bc expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337952:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337960:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337979:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.337995:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338002:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338009:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338051:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77681b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338060:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77681b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338067:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77681b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.338076:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:0.0:1784047607.338145:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338153:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338159:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338165:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338176:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c2e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.338180:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338187:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338198:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.338200:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.338203:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338208:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c77680d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338218:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338223:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338228:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338232:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c3c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.338235:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338241:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338257:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff99cce7530f00) 00010000:00010000:0.0:1784047607.338259:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.338262:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338267:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c776814 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338300:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3200/0x4426598c0c776806 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7bc expref: 100 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338312:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77681b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7bc expref: 99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.338318:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:0.0:1784047607.338321:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.338323:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c2a00, rc 0) 00000100:00100000:0.0:1784047607.338372:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+99:73706:x1870705689539200:12345-192.168.204.40@tcp:101:dd.0 Request processed in 530us (1052us total) trans 124554051695 rc 0/0 00000100:00100000:0.0:1784047607.338379:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1573 00000100:00100000:3.0:1784047607.340878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.341031:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689539328 00000100:00100000:0.0:1784047607.341041:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689539328 00000100:00100000:0.0:1784047607.341096:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5046 00000100:00100000:0.0:1784047607.341106:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+25:73704:x1870705689539328:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.341123:0:26193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.341143:0:26193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edda9084/0x4426598c0c776829 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7c3 expref: -99 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.341186:0:26193:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78c:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:0.0:1784047607.341211:0:26193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:0.0:1784047607.341216:0:26193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047607.341225:0:26193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edda9084/0x4426598c0c776829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7c3 expref: 26 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.341240:0:26193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edda9084/0x4426598c0c776829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7c3 expref: 26 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.341253:0:26193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c3a00, rc 0) 00010000:00000080:0.0:1784047607.341260:0:26193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c22a00 x1870705689539328/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.341311:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+26:73704:x1870705689539328:12345-192.168.204.40@tcp:101:dd.0 Request processed in 207us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.341318:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5046 00000100:00100000:2.0:1784047607.345885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.345914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.346981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.347016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.347162:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689539968 00000100:00100000:0.0:1784047607.347171:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689539968 00000100:00100000:0.0:1784047607.347228:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689540224 00000100:00100000:0.0:1784047607.347232:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689540224 00000100:00100000:0.0:1784047607.347258:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1574 00000100:00100000:0.0:1784047607.347268:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+100:73706:x1870705689539968:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.347291:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.347314:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c776830 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7ca expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347381:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2000/0x4426598c0c776837 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347396:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2000/0x4426598c0c776837 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347409:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2000/0x4426598c0c776837 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347517:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c776830 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ca expref: 102 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347535:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2000/0x4426598c0c776837 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ca expref: 101 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347543:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:0.0:1784047607.347545:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.347548:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c2000, rc 0) 00000100:00100000:0.0:1784047607.347629:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+101:73706:x1870705689539968:12345-192.168.204.40@tcp:101:dd.0 Request processed in 337us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.347638:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1574 00000100:00100000:0.0:1784047607.347657:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1575 00000100:00100000:0.0:1784047607.347663:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+100:73707:x1870705689540224:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.347672:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.347681:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2400/0x4426598c0c77683e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7d1 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347791:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347813:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347822:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347836:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347844:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347851:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347891:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776853 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347898:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776853 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347905:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776853 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.347914:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:0.0:1784047607.347987:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.347994:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348005:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348011:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348016:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c3000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.348020:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348027:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348037:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.348039:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.348043:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348049:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c776845 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348060:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348066:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348072:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348077:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c2800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.348090:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348098:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348106:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff99cce7530b00) 00010000:00010000:0.0:1784047607.348109:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.348111:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348116:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77684c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348152:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2400/0x4426598c0c77683e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7d1 expref: 103 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348165:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776853 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7d1 expref: 102 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.348172:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:0.0:1784047607.348175:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.348177:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c3800, rc 0) 00000100:00100000:0.0:1784047607.348209:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+102:73707:x1870705689540224:12345-192.168.204.40@tcp:101:dd.0 Request processed in 546us (1192us total) trans 124554051696 rc 0/0 00000100:00100000:0.0:1784047607.348216:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1575 00000100:00100000:1.0:1784047607.348906:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689539584 00000100:00100000:1.0:1784047607.348914:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689539584 00000100:00100000:1.0:1784047607.348956:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689539840 00000100:00100000:1.0:1784047607.348960:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689539840 00000100:00100000:1.0:1784047607.348979:0:95918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 273 00000100:00100000:1.0:1784047607.348987:0:95918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+103:73702:x1870705689539584:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.349180:0:95918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+104:73702:x1870705689539584:12345-192.168.204.40@tcp:35:dd.0 Request processed in 193us (3304us total) trans 124554051697 rc 0/0 00000100:00100000:1.0:1784047607.349187:0:95918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 273 00000100:00100000:1.0:1784047607.349201:0:95918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 274 00000100:00100000:1.0:1784047607.349207:0:95918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+103:73703:x1870705689539840:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.349309:0:95918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+104:73703:x1870705689539840:12345-192.168.204.40@tcp:35:dd.0 Request processed in 101us (3393us total) trans 124554051698 rc 0/0 00000100:00100000:1.0:1784047607.349550:0:95918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 274 00000100:00100000:2.0:1784047607.350706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.350762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.350789:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689540608 00000100:00100000:2.0:1784047607.350797:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689540608 00002000:00010000:2.0:1784047607.350839:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.350844:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdcfb100 with x1870705689540608 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.350855:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdcfb100. 00000100:00100000:2.0:1784047607.350879:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 616 00000100:00100000:2.0:1784047607.350887:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+26:2400:x1870705689540608:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:2.0:1784047607.351021:0:24865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784047607.351025:0:24865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:2.0:1784047607.351027:0:24865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:2.0:1784047607.351029:0:24865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:2.0:1784047607.351031:0:24865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784047607.351041:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdcfb100 x1870705689540608/t4294968789(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.351098:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+27:2400:x1870705689540608:12345-192.168.204.40@tcp:10:dd.0 Request processed in 212us (334us total) trans 4294968789 rc 0/0 00000100:00100000:2.0:1784047607.351105:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 616 00002000:00010000:2.0:1784047607.351108:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.351111:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfdcfb100 with x1870705689540608 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.351115:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfdcfb100. 00000100:00100000:0.0:1784047607.351255:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689540480 00000100:00100000:0.0:1784047607.351260:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689540480 00000100:00100000:0.0:1784047607.351305:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1576 00000100:00100000:0.0:1784047607.351313:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+104:73705:x1870705689540480:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:0.0:1784047607.351369:0:68026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047607.351397:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27dba00/0x4426598c0c7767d5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7a0 expref: 104 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.351416:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047607.351421:0:68026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047607.351554:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.351567:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.351577:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784047607.351636:0:68026:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051699 00000004:00010000:0.0:1784047607.351660:0:68026:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae57ac16 reply state 00000000f9d9527b transno 124554051700 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.351672:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.351679:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047607.351682:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047607.351684:0:68026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047607.352382:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+106:73705:x1870705689540480:12345-192.168.204.40@tcp:36:dd.0 Request processed in 1066us (1676us total) trans 124554051700 rc 0/0 00000100:00100000:0.0:1784047607.352391:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1576 00000020:00080000:0.0:1784047607.352396:0:68026:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784047607.355815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.355915:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689540736 00000100:00100000:3.0:1784047607.355926:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689540736 00000100:00100000:3.0:1784047607.355991:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5047 00000100:00100000:3.0:1784047607.356003:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+27:73705:x1870705689540736:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.356052:0:26186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.356084:0:26186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abc29af/0x4426598c0c776868 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7d8 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047607.356120:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78d:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:3.0:1784047607.356142:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:3.0:1784047607.356146:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047607.356154:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abc29af/0x4426598c0c776868 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7d8 expref: 28 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.356180:0:26186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abc29af/0x4426598c0c776868 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7d8 expref: 28 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.356194:0:26186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce033bc00, rc 0) 00010000:00000080:3.0:1784047607.356202:0:26186:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9be5500 x1870705689540736/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.356275:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+28:73705:x1870705689540736:12345-192.168.204.40@tcp:101:dd.0 Request processed in 274us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.356291:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5047 00000100:00100000:1.0:1784047607.360173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.360265:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689540992 00000100:00100000:0.0:1784047607.360288:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689540992 00000100:00100000:0.0:1784047607.360364:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 275 00000100:00100000:0.0:1784047607.360375:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+106:73704:x1870705689540992:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:0.0:1784047607.360731:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+107:73704:x1870705689540992:12345-192.168.204.40@tcp:35:dd.0 Request processed in 356us (566us total) trans 124554051701 rc 0/0 00000100:00100000:0.0:1784047607.360740:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 275 00000100:00100000:0.0:1784047607.363281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.363338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.363375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.363518:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689541248 00000100:00100000:1.0:1784047607.363528:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689541248 00000100:00100000:3.0:1784047607.363530:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689541376 00000100:00100000:3.0:1784047607.363537:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689541376 00002000:00010000:1.0:1784047607.363568:0:24868:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.363574:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc79f0380 with x1870705689541248 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.363586:0:24868:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc79f0380. 00000100:00100000:3.0:1784047607.363588:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689541504 00000100:00100000:3.0:1784047607.363593:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689541504 00000100:00100000:1.0:1784047607.363646:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 617 00000100:00100000:3.0:1784047607.363652:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1577 00000100:00100000:1.0:1784047607.363659:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+28:2399:x1870705689541248:12345-192.168.204.40@tcp:10:dd.0 00000100:00100000:3.0:1784047607.363666:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+108:73706:x1870705689541376:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.363712:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.363751:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77681b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7bc expref: 108 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.363771:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:3.0:1784047607.363775:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047607.363900:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.363913:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.363924:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047607.363960:0:67153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051702 00000004:00010000:3.0:1784047607.363979:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000946214a1 reply state 000000001e0ebe98 transno 124554051703 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.363992:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.363998:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:3.0:1784047607.364001:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.364003:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00010000:1.0:1784047607.364042:0:24868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784047607.364047:0:24868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.364048:0:24868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:1.0:1784047607.364050:0:24868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:1.0:1784047607.364052:0:24868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784047607.364061:0:24868:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc79f0380 x1870705689541248/t4294968790(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.364111:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+110:73706:x1870705689541376:12345-192.168.204.40@tcp:36:dd.0 Request processed in 450us (779us total) trans 124554051703 rc 0/0 00000100:00100000:3.0:1784047607.364120:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1577 00000020:00080000:3.0:1784047607.364126:0:67153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.364144:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1578 00000100:00100000:1.0:1784047607.364220:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+29:2399:x1870705689541248:12345-192.168.204.40@tcp:10:dd.0 Request processed in 565us (947us total) trans 4294968790 rc 0/0 00000100:00100000:1.0:1784047607.364228:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 617 00002000:00010000:1.0:1784047607.364231:0:24868:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.364234:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc79f0380 with x1870705689541248 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.364239:0:24868:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc79f0380. 00000100:00100000:0.0:1784047607.364288:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+109:73707:x1870705689541504:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.364299:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.364312:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2400/0x4426598c0c776876 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7df expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.364348:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77687d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.364358:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77687d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.364366:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77687d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.364514:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2400/0x4426598c0c776876 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7df expref: 111 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.364532:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2800/0x4426598c0c77687d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7df expref: 110 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.364546:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:0.0:1784047607.364549:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.364551:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c2800, rc 0) 00000100:00100000:0.0:1784047607.364677:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+110:73707:x1870705689541504:12345-192.168.204.40@tcp:101:dd.0 Request processed in 523us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.364684:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1578 00000100:00100000:0.0:1784047607.366924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.367016:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689541760 00000100:00100000:2.0:1784047607.367026:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689541760 00000100:00100000:2.0:1784047607.367121:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1579 00000100:00100000:2.0:1784047607.367132:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+110:73708:x1870705689541760:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.367154:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.367174:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776884 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7e6 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367367:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367394:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367407:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367425:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367432:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367448:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367514:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776899 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367522:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776899 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367528:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776899 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.367538:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00010000:00010000:2.0:1784047607.367668:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367677:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367685:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367692:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367698:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24bc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.367702:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367709:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367730:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.367733:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.367737:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367744:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77688b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367757:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367763:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367768:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367773:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.367776:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367781:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367788:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff99ccd2342500) 00010000:00010000:2.0:1784047607.367791:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.367794:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367799:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b000/0x4426598c0c776892 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367870:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a800/0x4426598c0c776884 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7e6 expref: 113 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367886:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776899 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7e6 expref: 112 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.367894:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:2.0:1784047607.367896:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.367898:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b600, rc 0) 00000100:00100000:2.0:1784047607.367963:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+112:73708:x1870705689541760:12345-192.168.204.40@tcp:101:dd.0 Request processed in 833us (1048us total) trans 124554051704 rc 0/0 00000100:00100000:2.0:1784047607.367971:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1579 00000100:00100000:2.0:1784047607.371673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.371745:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542016 00000100:00100000:3.0:1784047607.371758:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542016 00000100:00100000:3.0:1784047607.371826:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1580 00000100:00100000:3.0:1784047607.371838:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+112:73707:x1870705689542016:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.371925:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.371953:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776853 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7d1 expref: 112 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.371978:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:3.0:1784047607.371983:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784047607.372132:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1784047607.372167:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.372188:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542272 00010000:00010000:3.0:1784047607.372193:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.372195:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542272 00010000:00010000:3.0:1784047607.372208:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.372238:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 276 00000100:00100000:0.0:1784047607.372248:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+113:73705:x1870705689542272:12345-192.168.204.40@tcp:35:dd.0 00000001:00080000:3.0:1784047607.372258:0:67153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051705 00000004:00010000:3.0:1784047607.372284:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b074d4d reply state 000000005132d1c3 transno 124554051706 ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.372297:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.372304:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:3.0:1784047607.372307:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.372310:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047607.372433:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+115:73707:x1870705689542016:12345-192.168.204.40@tcp:36:dd.0 Request processed in 596us (770us total) trans 124554051706 rc 0/0 00000100:00100000:3.0:1784047607.372442:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1580 00000020:00080000:3.0:1784047607.372448:0:67153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.372881:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+115:73705:x1870705689542272:12345-192.168.204.40@tcp:35:dd.0 Request processed in 633us (748us total) trans 124554051707 rc 0/0 00000100:00100000:0.0:1784047607.372889:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 276 00000100:00100000:2.0:1784047607.383970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.384067:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542400 00000100:00100000:3.0:1784047607.384091:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542400 00000100:00100000:3.0:1784047607.384169:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5048 00000100:00100000:3.0:1784047607.384180:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+29:73706:x1870705689542400:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.384199:0:26196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.384222:0:26196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034bb8fd7/0x4426598c0c7768ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7ed expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047607.384247:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78e:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:3.0:1784047607.384271:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:3.0:1784047607.384277:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784047607.384286:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034bb8fd7/0x4426598c0c7768ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ed expref: 30 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.384304:0:26196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034bb8fd7/0x4426598c0c7768ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ed expref: 30 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.384317:0:26196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601400, rc 0) 00010000:00000080:3.0:1784047607.384342:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062c700 x1870705689542400/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.384415:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+30:73706:x1870705689542400:12345-192.168.204.40@tcp:101:dd.0 Request processed in 237us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.384422:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5048 00000100:00100000:3.0:1784047607.388939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.389661:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542528 00000100:00100000:0.0:1784047607.389671:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542528 00000100:00100000:0.0:1784047607.389737:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5049 00000100:00100000:0.0:1784047607.389748:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+30:73707:x1870705689542528:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.389768:0:26190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.389789:0:26190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025fa1d3b/0x4426598c0c7768b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7f4 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.389816:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78f:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:0.0:1784047607.389841:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:0.0:1784047607.389861:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047607.389870:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025fa1d3b/0x4426598c0c7768b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7f4 expref: 31 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.389888:0:26190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025fa1d3b/0x4426598c0c7768b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7f4 expref: 31 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.389902:0:26190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c2400, rc 0) 00010000:00000080:0.0:1784047607.389910:0:26190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c22680 x1870705689542528/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.389984:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+31:73707:x1870705689542528:12345-192.168.204.40@tcp:101:dd.0 Request processed in 238us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.389992:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5049 00000100:00100000:2.0:1784047607.390671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.391550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.392391:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542656 00000100:00100000:0.0:1784047607.392403:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542656 00002000:00010000:0.0:1784047607.392439:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.392445:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc93bea00 with x1870705689542656 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.392457:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc93bea00. 00000100:00100000:0.0:1784047607.392500:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 618 00000100:00100000:0.0:1784047607.392509:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+31:2402:x1870705689542656:12345-192.168.204.40@tcp:10:dd.0 00000100:00100000:1.0:1784047607.392752:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542784 00000100:00100000:1.0:1784047607.392757:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542784 00000100:00100000:1.0:1784047607.392793:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1581 00000100:00100000:1.0:1784047607.392828:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+115:73708:x1870705689542784:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.392848:0:68026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.392868:0:68026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7768bc lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae7fb expref: -99 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.392900:0:68026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c7768c3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.392914:0:68026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c7768c3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.392925:0:68026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c7768c3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.392981:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.392985:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.392987:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:0.0:1784047607.392989:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.392991:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.393000:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc93bea00 x1870705689542656/t4294968791(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1784047607.393026:0:68026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cfa00/0x4426598c0c7768bc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7fb expref: 117 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.393042:0:68026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce600/0x4426598c0c7768c3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7fb expref: 116 pid: 68026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.393049:0:68026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:1.0:1784047607.393052:0:68026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784047607.393055:0:68026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef9ce600, rc 0) 00000100:00100000:0.0:1784047607.393068:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+32:2402:x1870705689542656:12345-192.168.204.40@tcp:10:dd.0 Request processed in 560us (2399us total) trans 4294968791 rc 0/0 00000100:00100000:1.0:1784047607.393077:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+116:73708:x1870705689542784:12345-192.168.204.40@tcp:101:dd.0 Request processed in 252us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.393077:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 618 00002000:00010000:0.0:1784047607.393081:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00000100:00100000:1.0:1784047607.393083:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1581 00002000:00100000:0.0:1784047607.393084:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc93bea00 with x1870705689542656 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.393089:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc93bea00. 00000100:00100000:2.0:1784047607.393426:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.393494:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689543040 00000100:00100000:0.0:1784047607.393499:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689543040 00000100:00100000:0.0:1784047607.393539:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1582 00000100:00100000:0.0:1784047607.393844:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+116:73710:x1870705689543040:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.393857:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.393872:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c7768ca lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae802 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.394874:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.394890:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.394901:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.394916:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395000:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395024:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395093:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c7768df lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395103:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c7768df lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395110:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c7768df lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.395119:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1784047607.395200:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395208:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395214:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395221:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395227:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c2c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.395231:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395238:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395260:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.395263:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.395267:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395273:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c7768d1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395287:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395292:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395297:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395302:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c3c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.395305:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395310:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395316:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff99cce7530100) 00010000:00010000:0.0:1784047607.395318:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.395320:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395326:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768d8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395409:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c7768ca lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae802 expref: 119 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395426:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c7768df lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae802 expref: 118 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.395434:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:0.0:1784047607.395436:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.395438:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c2e00, rc 0) 00000100:00100000:0.0:1784047607.395526:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc93bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+118:73710:x1870705689543040:12345-192.168.204.40@tcp:101:dd.0 Request processed in 1978us (2099us total) trans 124554051708 rc 0/0 00000100:00100000:0.0:1784047607.395535:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1582 00000100:00100000:1.0:1784047607.400559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.400639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.400740:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689543424 00000100:00100000:0.0:1784047607.400750:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689543424 00000100:00100000:0.0:1784047607.400829:0:95918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 277 00000100:00100000:0.0:1784047607.400841:0:95918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+118:73706:x1870705689543424:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:0.0:1784047607.401158:0:95918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+119:73706:x1870705689543424:12345-192.168.204.40@tcp:35:dd.0 Request processed in 318us (607us total) trans 124554051709 rc 0/0 00000100:00100000:0.0:1784047607.401167:0:95918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 277 00000100:00100000:1.0:1784047607.401317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.401837:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689543168 00000100:00100000:0.0:1784047607.401843:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689543168 00002000:00010000:0.0:1784047607.401872:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.401877:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef51df80 with x1870705689543168 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.401890:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef51df80. 00000100:00100000:0.0:1784047607.401918:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 619 00000100:00100000:0.0:1784047607.401933:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+32:2402:x1870705689543168:12345-192.168.204.40@tcp:10:dd.0 00000100:00100000:3.0:1784047607.402146:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689543680 00000100:00100000:3.0:1784047607.402151:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689543680 00000100:00100000:3.0:1784047607.402189:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1583 00000100:00100000:3.0:1784047607.402196:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+119:73708:x1870705689543680:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.402257:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.402290:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776899 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7e6 expref: 119 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.402427:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:3.0:1784047607.402433:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047607.402579:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.402595:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.402626:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047607.402676:0:67153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051710 00000004:00010000:3.0:1784047607.402701:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d55a7e71 reply state 000000008c3a1bc0 transno 124554051711 ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.402828:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.402831:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.402834:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:0.0:1784047607.402835:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.402837:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.402846:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51df80 x1870705689543168/t4294968792(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.402945:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+33:2402:x1870705689543168:12345-192.168.204.40@tcp:10:dd.0 Request processed in 1013us (1628us total) trans 4294968792 rc 0/0 00010000:00010000:3.0:1784047607.402948:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.402953:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 619 00010000:00010000:3.0:1784047607.402954:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:3.0:1784047607.402956:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1784047607.402957:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00000100:00100000:3.0:1784047607.402959:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00100000:0.0:1784047607.402960:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef51df80 with x1870705689543168 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.402966:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef51df80. 00000100:00100000:3.0:1784047607.403013:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+121:73708:x1870705689543680:12345-192.168.204.40@tcp:36:dd.0 Request processed in 816us (2406us total) trans 124554051711 rc 0/0 00000100:00100000:3.0:1784047607.403019:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1583 00000020:00080000:3.0:1784047607.403030:0:67153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784047607.408815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.408918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.409011:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689543808 00000100:00100000:0.0:1784047607.409022:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689543808 00000100:00100000:0.0:1784047607.409079:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689544064 00000100:00100000:0.0:1784047607.409083:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689544064 00000100:00100000:0.0:1784047607.409114:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1584 00000100:00100000:0.0:1784047607.409124:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+122:73710:x1870705689543808:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.409149:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.409172:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c7768f4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae809 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409206:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768fb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409233:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409246:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409378:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3000/0x4426598c0c7768f4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae809 expref: 124 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409398:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3c00/0x4426598c0c7768fb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae809 expref: 123 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409405:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:0.0:1784047607.409408:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.409412:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c3c00, rc 0) 00000100:00100000:0.0:1784047607.409466:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+123:73710:x1870705689543808:12345-192.168.204.40@tcp:101:dd.0 Request processed in 343us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.409473:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1584 00000100:00100000:0.0:1784047607.409492:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1585 00000100:00100000:0.0:1784047607.409499:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+122:73709:x1870705689544064:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.409507:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.409517:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c776902 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae810 expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409670:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409688:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409696:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409712:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409719:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409726:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409786:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776917 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409794:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776917 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409801:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776917 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784047607.409811:0:66220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00010000:00010000:0.0:1784047607.409885:0:66220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409892:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409898:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409912:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409918:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c3e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.409921:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409929:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409939:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:0.0:1784047607.409941:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.409944:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409950:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3e00/0x4426598c0c776909 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409960:0:66220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409966:0:66220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409971:0:66220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409975:0:66220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c2200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047607.409978:0:66220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.409991:0:66220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.410006:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff99cce7530100) 00010000:00010000:0.0:1784047607.410008:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047607.410011:0:66220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.410016:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2200/0x4426598c0c776910 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.410050:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2c00/0x4426598c0c776902 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae810 expref: 125 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.410063:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776917 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae810 expref: 124 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.410069:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:0.0:1784047607.410071:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784047607.410073:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c3800, rc 0) 00000100:00100000:0.0:1784047607.410106:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+124:73709:x1870705689544064:12345-192.168.204.40@tcp:101:dd.0 Request processed in 608us (1189us total) trans 124554051712 rc 0/0 00000100:00100000:0.0:1784047607.410113:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1585 00000100:00100000:1.0:1784047607.412271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.412383:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689544192 00000100:00100000:2.0:1784047607.412395:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689544192 00000100:00100000:2.0:1784047607.412455:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5050 00000100:00100000:2.0:1784047607.412466:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+33:73708:x1870705689544192:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.412483:0:26181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.412505:0:26181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000259199a2/0x4426598c0c776925 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae817 expref: -99 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047607.412531:0:26181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x790:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:2.0:1784047607.412818:0:26181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:2.0:1784047607.412825:0:26181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047607.412836:0:26181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259199a2/0x4426598c0c776925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae817 expref: 34 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.412854:0:26181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000259199a2/0x4426598c0c776925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae817 expref: 34 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.412868:0:26181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24a800, rc 0) 00010000:00000080:2.0:1784047607.412876:0:26181:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51c700 x1870705689544192/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.413428:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+34:73708:x1870705689544192:12345-192.168.204.40@tcp:101:dd.0 Request processed in 961us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.413436:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5050 00000100:00100000:0.0:1784047607.416025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.416171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.416470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.416508:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689544704 00000100:00100000:0.0:1784047607.416517:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689544704 00000100:00100000:0.0:1784047607.416601:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689544832 00000100:00100000:0.0:1784047607.416628:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689544832 00000100:00100000:0.0:1784047607.416655:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1586 00000100:00100000:0.0:1784047607.416664:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+125:73710:x1870705689544704:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:0.0:1784047607.416758:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047607.416788:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2e00/0x4426598c0c7768df lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae802 expref: 125 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.416810:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:0.0:1784047607.416815:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047607.417018:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417033:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417042:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784047607.417086:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051713 00000004:00010000:0.0:1784047607.417107:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000453202ba reply state 00000000a389f9b6 transno 124554051714 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417120:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417126:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:0.0:1784047607.417129:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784047607.417132:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784047607.417213:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+127:73710:x1870705689544704:12345-192.168.204.40@tcp:36:dd.0 Request processed in 549us (1042us total) trans 124554051714 rc 0/0 00000100:00100000:0.0:1784047607.417231:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1586 00000020:00080000:0.0:1784047607.417236:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.417256:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1587 00000100:00100000:0.0:1784047607.417263:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+126:73709:x1870705689544832:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.417273:0:66220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.417283:0:66220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3200/0x4426598c0c776933 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae81e expref: -99 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417305:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3400/0x4426598c0c77693a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417314:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3400/0x4426598c0c77693a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417337:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3400/0x4426598c0c77693a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417412:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3200/0x4426598c0c776933 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae81e expref: 128 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417429:0:66220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3400/0x4426598c0c77693a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae81e expref: 127 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.417437:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:0.0:1784047607.417440:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784047607.417443:0:66220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccef5c3400, rc 0) 00000100:00100000:0.0:1784047607.417479:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+127:73709:x1870705689544832:12345-192.168.204.40@tcp:101:dd.0 Request processed in 216us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.417495:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1587 00000100:00100000:1.0:1784047607.418223:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689544448 00000100:00100000:1.0:1784047607.418231:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689544448 00000100:00100000:1.0:1784047607.418300:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 278 00000100:00100000:1.0:1784047607.418308:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+127:73707:x1870705689544448:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.418525:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+128:73707:x1870705689544448:12345-192.168.204.40@tcp:35:dd.0 Request processed in 217us (2508us total) trans 124554051715 rc 0/0 00000100:00100000:1.0:1784047607.418533:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 278 00000100:00100000:0.0:1784047607.420110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.420444:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545088 00000100:00100000:3.0:1784047607.420457:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545088 00000100:00100000:3.0:1784047607.420795:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1588 00000100:00100000:3.0:1784047607.420807:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+128:73711:x1870705689545088:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.420827:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.420848:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c776941 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae825 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.420994:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421009:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421021:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421038:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421045:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421051:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421117:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c776956 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421126:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c776956 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421154:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c776956 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784047607.421164:0:66221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:3.0:1784047607.421245:0:66221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421253:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421259:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421265:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421271:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047607.421275:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421283:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421296:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:3.0:1784047607.421299:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047607.421304:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421310:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c776948 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421322:0:66221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421347:0:66221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421352:0:66221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421357:0:66221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:3.0:1784047607.421360:0:66221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421365:0:66221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421373:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff99cd001e7b00) 00010000:00010000:3.0:1784047607.421375:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784047607.421378:0:66221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421383:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c77694f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421429:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c776941 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae825 expref: 131 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421441:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c776956 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae825 expref: 130 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.421448:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047607.421450:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784047607.421458:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00600400, rc 0) 00000100:00100000:3.0:1784047607.421530:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+130:73711:x1870705689545088:12345-192.168.204.40@tcp:101:dd.0 Request processed in 726us (1428us total) trans 124554051716 rc 0/0 00000100:00100000:3.0:1784047607.421538:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1588 00000100:00100000:2.0:1784047607.438653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.438701:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545216 00000100:00100000:2.0:1784047607.438710:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545216 00002000:00010000:2.0:1784047607.438754:0:24867:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.438760:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0030df80 with x1870705689545216 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.438773:0:24867:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0030df80. 00000100:00100000:2.0:1784047607.438801:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 620 00000100:00100000:2.0:1784047607.438811:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+34:2400:x1870705689545216:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:2.0:1784047607.439000:0:24867:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784047607.439005:0:24867:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:2.0:1784047607.439007:0:24867:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:2.0:1784047607.439023:0:24867:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:2.0:1784047607.439026:0:24867:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784047607.439036:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0030df80 x1870705689545216/t4294968793(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.439094:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+35:2400:x1870705689545216:12345-192.168.204.40@tcp:10:dd.0 Request processed in 285us (453us total) trans 4294968793 rc 0/0 00000100:00100000:2.0:1784047607.439103:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 620 00002000:00010000:2.0:1784047607.439107:0:24867:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:2.0:1784047607.439110:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0030df80 with x1870705689545216 ext(0->18446744073709551615) 00002000:00010000:2.0:1784047607.439114:0:24867:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0030df80. 00000100:00100000:2.0:1784047607.439167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.439263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.439302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.439322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.439361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.439383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.439403:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546112 00000100:00100000:2.0:1784047607.439408:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546112 00002000:00100000:2.0:1784047607.439432:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff99cd0030d500 x1870705689546112/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.439440:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0030d500 with x1870705689546112 ext(0->1023) 00002000:00010000:2.0:1784047607.439445:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0030d500 00000100:00100000:2.0:1784047607.439461:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 621 00000100:00100000:2.0:1784047607.439469:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+35:2399:x1870705689546112:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:2.0:1784047607.439901:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0030d500 x1870705689546112/t4294968794(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.439948:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+37:2399:x1870705689546112:12345-192.168.204.40@tcp:4:dd.0 Request processed in 480us (780us total) trans 4294968794 rc 0/0 00000100:00100000:2.0:1784047607.439956:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 621 00002000:00100000:2.0:1784047607.439961:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff99cd0030d500 x1870705689546112/t4294968794(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.439969:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0030d500 with x1870705689546112 ext(0->1023) 00002000:00010000:2.0:1784047607.439972:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0030d500 00000100:00100000:2.0:1784047607.440063:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545600 00000100:00100000:2.0:1784047607.440068:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545600 00000100:00100000:2.0:1784047607.440094:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545728 00000100:00100000:2.0:1784047607.440096:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545728 00000100:00100000:2.0:1784047607.440111:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545984 00000100:00100000:2.0:1784047607.440113:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545984 00000100:00100000:2.0:1784047607.440127:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1589 00000100:00100000:2.0:1784047607.440133:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+132:73709:x1870705689545600:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:2.0:1784047607.440179:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047607.440205:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3800/0x4426598c0c776917 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae810 expref: 132 pid: 66220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440226:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:2.0:1784047607.440231:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047607.440378:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440393:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440414:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784047607.440455:0:67153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051717 00000004:00010000:2.0:1784047607.440478:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2c15ee6 reply state 0000000052b530ed transno 124554051718 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440491:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440497:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:2.0:1784047607.440499:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047607.440501:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784047607.440562:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+134:73709:x1870705689545600:12345-192.168.204.40@tcp:36:dd.0 Request processed in 428us (1258us total) trans 124554051718 rc 0/0 00000100:00100000:2.0:1784047607.440569:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1589 00000020:00080000:2.0:1784047607.440572:0:67153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784047607.440586:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1590 00000100:00100000:2.0:1784047607.440594:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+133:73711:x1870705689545728:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.440627:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.440639:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77696b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae833 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440662:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776972 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440670:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776972 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440687:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776972 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440762:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c77696b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae833 expref: 135 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440777:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46800/0x4426598c0c776972 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae833 expref: 134 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440785:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:2.0:1784047607.440787:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784047607.440790:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf6c46800, rc 0) 00000100:00100000:2.0:1784047607.440810:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+134:73711:x1870705689545728:12345-192.168.204.40@tcp:101:dd.0 Request processed in 218us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.440816:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1590 00000100:00100000:2.0:1784047607.440830:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1591 00000100:00100000:2.0:1784047607.440837:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+133:73712:x1870705689545984:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.440845:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.440853:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c776979 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae83a expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440942:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440951:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440969:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440983:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440990:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.440996:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441031:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77698e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441038:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77698e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441044:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77698e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.441051:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:2.0:1784047607.441089:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441096:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441103:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441109:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441123:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.441127:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441135:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441144:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.441147:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.441151:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441158:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46200/0x4426598c0c776980 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441168:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441174:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441181:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.441184:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545344 00010000:00010000:2.0:1784047607.441187:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c46c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.441191:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.441192:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545344 00010000:00010000:2.0:1784047607.441201:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441218:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff99ccd2342e00) 00010000:00010000:2.0:1784047607.441221:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.441224:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.441227:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546240 00000100:00100000:1.0:1784047607.441232:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546240 00010000:00010000:2.0:1784047607.441233:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c46c00/0x4426598c0c776987 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.441261:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5051 00010000:00010000:2.0:1784047607.441269:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf6c47e00/0x4426598c0c776979 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae83a expref: 136 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.441274:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+38:73710:x1870705689545344:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.441287:0:26183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.441289:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77698e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae83a expref: 135 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.441296:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:2.0:1784047607.441299:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.441302:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd200, rc 0) 00010000:00010000:1.0:1784047607.441303:0:26183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c77699c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae82c expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047607.441323:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x792:0x0] initial LVB size: 0, mtime: 0x6a5667ed, atime: 0x6a5667ed, ctime: 0x6a5667ed, blocks: 0x0 00000100:00100000:2.0:1784047607.441324:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+135:73712:x1870705689545984:12345-192.168.204.40@tcp:101:dd.0 Request processed in 487us (1940us total) trans 124554051719 rc 0/0 00010000:00010000:1.0:1784047607.441353:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:1.0:1784047607.441358:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047607.441366:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c77699c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae82c expref: 39 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.441380:0:26183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c77699c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae82c expref: 39 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.441399:0:26183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88800, rc 0) 00010000:00000080:1.0:1784047607.441405:0:26183:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0030c700 x1870705689545344/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.441430:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+39:73710:x1870705689545344:12345-192.168.204.40@tcp:101:dd.0 Request processed in 162us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.441436:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5051 00000100:00100000:1.0:1784047607.441463:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5052 00000100:00100000:1.0:1784047607.441469:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+38:2400:x1870705689546240:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:1.0:1784047607.441749:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968794 is committed 00010000:00000080:1.0:1784047607.441871:0:26183:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce7ed7800 x1870705689546240/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.441899:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+21:2400:x1870705689546240:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 430us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.441906:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5052 00000100:00100000:2.0:1784047607.442191:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1591 00000100:00100000:2.0:1784047607.447029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.447079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.447147:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546496 00000100:00100000:0.0:1784047607.447158:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546496 00000100:00100000:0.0:1784047607.447218:0:95918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 279 00000100:00100000:0.0:1784047607.447229:0:95918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+135:73708:x1870705689546496:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:0.0:1784047607.447560:0:95918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+136:73708:x1870705689546496:12345-192.168.204.40@tcp:35:dd.0 Request processed in 331us (539us total) trans 124554051720 rc 0/0 00000100:00100000:0.0:1784047607.447568:0:95918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 279 00000100:00100000:3.0:1784047607.447716:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546752 00000100:00100000:3.0:1784047607.447721:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546752 00000100:00100000:3.0:1784047607.447761:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1592 00000100:00100000:3.0:1784047607.447769:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+136:73711:x1870705689546752:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:3.0:1784047607.447799:0:67153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784047607.447825:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c776956 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae825 expref: 136 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.447842:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047607.447847:0:67153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784047607.447935:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.447950:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.447959:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784047607.448001:0:67153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051721 00000004:00010000:3.0:1784047607.448026:0:67153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049f08dbb reply state 00000000b6fc71fe transno 124554051722 ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.448038:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.448064:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:3.0:1784047607.448067:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.448070:0:67153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784047607.448124:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+138:73711:x1870705689546752:12345-192.168.204.40@tcp:36:dd.0 Request processed in 355us (1044us total) trans 124554051722 rc 0/0 00000100:00100000:3.0:1784047607.448132:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1592 00000020:00080000:3.0:1784047607.448136:0:67153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784047607.450302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.450383:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547008 00000100:00100000:2.0:1784047607.450394:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547008 00000100:00100000:2.0:1784047607.450450:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5053 00000100:00100000:2.0:1784047607.450463:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+21:2400:x1870705689547008:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:2.0:1784047607.450518:0:26192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51f800 x1870705689547008/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.450650:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+21:2400:x1870705689547008:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 189us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.450658:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5053 00000100:00100000:1.0:1784047607.452937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.453327:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546880 00000100:00100000:3.0:1784047607.453351:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546880 00002000:00100000:3.0:1784047607.453401:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff99ccef51e680 x1870705689546880/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047607.453413:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef51e680 with x1870705689546880 ext(0->1023) 00002000:00010000:3.0:1784047607.453419:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef51e680 00000100:00100000:3.0:1784047607.453507:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 622 00000100:00100000:3.0:1784047607.453518:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+21:2399:x1870705689546880:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:3.0:1784047607.454010:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51e680 x1870705689546880/t4294968795(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.454087:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+23:2399:x1870705689546880:12345-192.168.204.40@tcp:4:dd.0 Request processed in 570us (1158us total) trans 4294968795 rc 0/0 00000100:00100000:3.0:1784047607.454096:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 622 00002000:00100000:3.0:1784047607.454103:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff99ccef51e680 x1870705689546880/t4294968795(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047607.454111:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef51e680 with x1870705689546880 ext(0->1023) 00002000:00010000:3.0:1784047607.454115:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef51e680 00000100:00100000:0.0:1784047607.460916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.460959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.461068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.461411:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547392 00000100:00100000:2.0:1784047607.461423:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547392 00000100:00100000:2.0:1784047607.461482:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547136 00000100:00100000:2.0:1784047607.461485:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547136 00000100:00100000:2.0:1784047607.461517:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1593 00000100:00100000:2.0:1784047607.461528:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+139:73713:x1870705689547392:12345-192.168.204.40@tcp:101:dd.0 00000100:00100000:3.0:1784047607.461752:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1594 00000100:00100000:3.0:1784047607.461763:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+139:73712:x1870705689547136:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.461776:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784047607.461799:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769aa lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae841 expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.461836:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7769b1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.461849:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7769b1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.461861:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7769b1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.461921:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547520 00000100:00100000:1.0:1784047607.461927:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547520 00000100:00100000:1.0:1784047607.461963:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5054 00000100:00100000:1.0:1784047607.461973:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+23:73709:x1870705689547520:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1784047607.461979:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769aa lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae841 expref: 141 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.461985:0:26185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.462002:0:26185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7769b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae84f expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.462004:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601600/0x4426598c0c7769b1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae841 expref: 140 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.462020:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:3.0:1784047607.462024:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784047607.462028:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd00601600, rc 0) 00002000:00010000:1.0:1784047607.462050:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x791:0x0] initial LVB size: 0, mtime: 0x6a5667ec, atime: 0x6a5667ec, ctime: 0x6a5667ec, blocks: 0x0 00010000:00010000:1.0:1784047607.462069:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:1.0:1784047607.462074:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047607.462083:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7769b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae84f expref: 24 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047607.462088:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+140:73712:x1870705689547136:12345-192.168.204.40@tcp:101:dd.0 Request processed in 325us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.462103:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1594 00010000:00010000:1.0:1784047607.462110:0:26185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7769b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae84f expref: 24 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.462121:0:26185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89400, rc 0) 00010000:00000080:1.0:1784047607.462129:0:26185:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbcec16a00 x1870705689547520/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.462169:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0c846d7a-6357-4e9c-a620-e35737ede709+24:73709:x1870705689547520:12345-192.168.204.40@tcp:101:dd.0 Request processed in 198us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.462175:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5054 00000100:00100000:1.0:1784047607.462228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.462256:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547904 00000100:00100000:1.0:1784047607.462260:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547904 00002000:00100000:1.0:1784047607.462282:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff99ccc44f1c00 x1870705689547904/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.462291:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccc44f1c00 with x1870705689547904 ext(0->1023) 00002000:00010000:1.0:1784047607.462296:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccc44f1c00 00000100:00100000:1.0:1784047607.462315:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 623 00000100:00100000:1.0:1784047607.462322:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+24:2402:x1870705689547904:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:2.0:1784047607.462487:0:67153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.462502:0:67153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7769bf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae848 expref: -99 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462736:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462747:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462757:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462772:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462779:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462787:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462862:0:67153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7769d4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462872:0:67153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7769d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.462881:0:67153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7769d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784047607.462891:0:67153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00000080:1.0:1784047607.462923:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccc44f1c00 x1870705689547904/t4294968796(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784047607.462954:0:67153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.462960:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+26:2402:x1870705689547904:12345-192.168.204.40@tcp:4:dd.0 Request processed in 636us (729us total) trans 4294968796 rc 0/0 00010000:00010000:2.0:1784047607.462969:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784047607.462974:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 623 00010000:00010000:2.0:1784047607.462982:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1784047607.462986:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff99ccc44f1c00 x1870705689547904/t4294968796(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784047607.462995:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1784047607.463000:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccc44f1c00 with x1870705689547904 ext(0->1023) 00002000:00010000:1.0:1784047607.463007:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccc44f1c00 00010000:00010000:2.0:1784047607.463008:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbcc00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.463015:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463024:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463037:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff99ccc34a7900) 00010000:00010000:2.0:1784047607.463040:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.463051:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463059:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbcc00/0x4426598c0c7769c6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463072:0:67153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463078:0:67153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463085:0:67153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463091:0:67153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:2.0:1784047607.463094:0:67153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463099:0:67153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463107:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff99ccd2342e00) 00010000:00010000:2.0:1784047607.463109:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784047607.463112:0:67153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463118:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769cd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463158:0:67153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc400/0x4426598c0c7769bf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae848 expref: 142 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463184:0:67153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7769d4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae848 expref: 141 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.463192:0:67153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:2.0:1784047607.463195:0:67153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784047607.463198:0:67153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbc200, rc 0) 00000100:00100000:2.0:1784047607.463223:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+141:73713:x1870705689547392:12345-192.168.204.40@tcp:101:dd.0 Request processed in 1698us (2317us total) trans 124554051723 rc 0/0 00000100:00100000:2.0:1784047607.463230:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1593 00000100:00100000:3.0:1784047607.467709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.467754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.467788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.467874:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547648 00000100:00100000:2.0:1784047607.467882:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547648 00000100:00100000:2.0:1784047607.467937:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548032 00000100:00100000:2.0:1784047607.467941:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548032 00000100:00100000:2.0:1784047607.467965:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5055 00000100:00100000:2.0:1784047607.467973:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+27:73711:x1870705689547648:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1784047607.467992:0:26193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784047607.468015:0:26193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c7769e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae856 expref: -99 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784047607.468039:0:26193:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x793:0x0] initial LVB size: 0, mtime: 0x6a5667ed, atime: 0x6a5667ed, ctime: 0x6a5667ed, blocks: 0x0 00010000:00010000:2.0:1784047607.468061:0:26193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:2.0:1784047607.468066:0:26193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784047607.468074:0:26193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c7769e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae856 expref: 28 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.468105:0:26193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c7769e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae856 expref: 28 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.468118:0:26193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd400, rc 0) 00010000:00000080:2.0:1784047607.468127:0:26193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9c23480 x1870705689547648/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.468184:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+28:73711:x1870705689547648:12345-192.168.204.40@tcp:101:dd.0 Request processed in 211us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.468191:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5055 00000100:00100000:2.0:1784047607.468209:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5056 00000100:00100000:2.0:1784047607.468216:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+27:2402:x1870705689548032:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:2.0:1784047607.468534:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968796 is committed 00010000:00000080:1.0:1784047607.468725:0:26193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf2ea8380 x1870705689548032/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.468761:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+23:2402:x1870705689548032:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 546us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.468770:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5056 00000100:00100000:0.0:1784047607.469135:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547776 00000100:00100000:0.0:1784047607.469142:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547776 00002000:00010000:0.0:1784047607.469166:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.469170:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf2ea9500 with x1870705689547776 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.469179:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf2ea9500. 00000100:00100000:0.0:1784047607.469205:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 624 00000100:00100000:0.0:1784047607.469212:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+23:2399:x1870705689547776:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:0.0:1784047607.469380:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.469383:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb mtime from disk: 1784047597 -> 1784047606 00002000:00010000:0.0:1784047607.469386:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb atime from disk: 1784047597 -> 1784047597 00002000:00010000:0.0:1784047607.469389:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb ctime from disk: 1784047597 -> 1784047606 00002000:00010000:0.0:1784047607.469391:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.469398:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf2ea9500 x1870705689547776/t4294968797(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.469452:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+24:2399:x1870705689547776:12345-192.168.204.40@tcp:10:dd.0 Request processed in 240us (1696us total) trans 4294968797 rc 0/0 00000100:00100000:0.0:1784047607.469460:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 624 00002000:00010000:0.0:1784047607.469463:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.469467:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf2ea9500 with x1870705689547776 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.469472:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf2ea9500. 00000100:00100000:0.0:1784047607.473477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.473523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.473567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.473600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.473637:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548288 00000100:00100000:3.0:1784047607.473649:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548288 00000100:00100000:0.0:1784047607.473652:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548416 00000100:00100000:0.0:1784047607.473658:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548416 00002000:00010000:0.0:1784047607.473697:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.473702:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbcec17480 with x1870705689548416 ext(0->18446744073709551615) 00000100:00100000:3.0:1784047607.473704:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548544 00000100:00100000:3.0:1784047607.473709:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548544 00002000:00010000:0.0:1784047607.473719:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbcec17480. 00000100:00100000:3.0:1784047607.473735:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1595 00000100:00100000:0.0:1784047607.473740:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548672 00000100:00100000:0.0:1784047607.473747:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548672 00000100:00100000:3.0:1784047607.473749:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+142:73712:x1870705689548288:12345-192.168.204.40@tcp:36:dd.0 00002000:00010000:0.0:1784047607.473764:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.473769:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca63800 with x1870705689548672 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.473774:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca63800. 00000100:00100000:0.0:1784047607.473794:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 625 00010000:00010000:3.0:1784047607.473810:0:66221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784047607.473813:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689548416:12345-192.168.204.40@tcp:10:dd.0 00010000:00010000:3.0:1784047607.473841:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbd200/0x4426598c0c77698e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae83a expref: 142 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.473861:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:3.0:1784047607.473866:0:66221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1784047607.473965:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.473969:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb mtime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.473971:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb atime from disk: 1784047596 -> 1784047596 00002000:00010000:0.0:1784047607.473990:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb ctime from disk: 1784047596 -> 1784047606 00002000:00010000:0.0:1784047607.473993:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.474004:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbcec17480 x1870705689548416/t4294968798(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1784047607.474010:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474026:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474037:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.474063:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689548416:12345-192.168.204.40@tcp:10:dd.0 Request processed in 262us (540us total) trans 4294968798 rc 0/0 00000100:00100000:0.0:1784047607.474071:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 625 00002000:00010000:0.0:1784047607.474075:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.474078:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbcec17480 with x1870705689548416 ext(0->18446744073709551615) 00000001:00080000:3.0:1784047607.474079:0:66221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051724 00002000:00010000:0.0:1784047607.474085:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbcec17480. 00000100:00100000:0.0:1784047607.474106:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 626 00000004:00010000:3.0:1784047607.474107:0:66221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef39b4de reply state 00000000646cf2f3 transno 124554051725 ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047607.474117:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689548672:12345-192.168.204.40@tcp:10:dd.0 00010000:00010000:3.0:1784047607.474124:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474133:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:3.0:1784047607.474143:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784047607.474147:0:66221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1784047607.474187:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.474190:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb mtime from disk: 1784047597 -> 1784047606 00002000:00010000:0.0:1784047607.474192:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb atime from disk: 1784047597 -> 1784047597 00002000:00010000:0.0:1784047607.474195:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb ctime from disk: 1784047597 -> 1784047606 00002000:00010000:0.0:1784047607.474197:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.474204:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca63800 x1870705689548672/t4294968799(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.474214:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+144:73712:x1870705689548288:12345-192.168.204.40@tcp:36:dd.0 Request processed in 467us (745us total) trans 124554051725 rc 0/0 00000100:00100000:3.0:1784047607.474222:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1595 00000020:00080000:3.0:1784047607.474226:0:66221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.474236:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689548672:12345-192.168.204.40@tcp:10:dd.0 Request processed in 122us (634us total) trans 4294968799 rc 0/0 00000100:00100000:0.0:1784047607.474243:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 626 00000100:00100000:3.0:1784047607.474247:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1596 00000100:00100000:3.0:1784047607.474255:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+143:73713:x1870705689548544:12345-192.168.204.40@tcp:101:dd.0 00002000:00010000:0.0:1784047607.474264:0:24851:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00010000:00010000:3.0:1784047607.474266:0:66221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1784047607.474268:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca63800 with x1870705689548672 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.474275:0:24851:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca63800. 00010000:00010000:3.0:1784047607.474280:0:66221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7769f0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae85d expref: -99 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474310:0:66221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7769f7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474320:0:66221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7769f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474338:0:66221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7769f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474422:0:66221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601a00/0x4426598c0c7769f0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae85d expref: 145 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474440:0:66221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24bc00/0x4426598c0c7769f7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae85d expref: 144 pid: 66221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047607.474448:0:66221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:3.0:1784047607.474450:0:66221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784047607.474459:0:66221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24bc00, rc 0) 00000100:00100000:3.0:1784047607.474504:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+144:73713:x1870705689548544:12345-192.168.204.40@tcp:101:dd.0 Request processed in 250us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.474511:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1596 00000100:00100000:0.0:1784047607.477425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.477531:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548928 00000100:00100000:1.0:1784047607.477542:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548928 00000100:00100000:1.0:1784047607.477651:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 280 00000100:00100000:1.0:1784047607.477663:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+144:73710:x1870705689548928:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.477992:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c846d7a-6357-4e9c-a620-e35737ede709+145:73710:x1870705689548928:12345-192.168.204.40@tcp:35:dd.0 Request processed in 331us (578us total) trans 124554051726 rc 0/0 00000100:00100000:1.0:1784047607.478001:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 280 00000100:00100000:0.0:1784047607.483129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.483243:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689549696 00000100:00100000:2.0:1784047607.483265:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689549696 00000100:00100000:2.0:1784047607.483340:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1597 00000100:00100000:2.0:1784047607.483352:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+145:73713:x1870705689549696:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:2.0:1784047607.483415:0:66220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784047607.483450:0:66220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbc200/0x4426598c0c7769d4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae848 expref: 145 pid: 67153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.483470:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:2.0:1784047607.483475:0:66220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784047607.483720:0:66220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.483746:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.483756:0:66220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784047607.483799:0:66220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051727 00000004:00010000:2.0:1784047607.483835:0:66220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c369d7f9 reply state 000000005ef09030 transno 124554051728 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.483849:0:66220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047607.483855:0:66220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:2.0:1784047607.483857:0:66220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784047607.483860:0:66220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784047607.484122:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+147:73713:x1870705689549696:12345-192.168.204.40@tcp:36:dd.0 Request processed in 770us (1003us total) trans 124554051728 rc 0/0 00000100:00100000:2.0:1784047607.484130:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1597 00000020:00080000:2.0:1784047607.484135:0:66220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784047607.488823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.492388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.492444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.492479:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689549440 00000100:00100000:2.0:1784047607.492489:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689549440 00000100:00100000:2.0:1784047607.492568:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 281 00000100:00100000:2.0:1784047607.492583:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+147:73709:x1870705689549440:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:3.0:1784047607.493660:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689549184 00000100:00100000:3.0:1784047607.493670:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689549184 00000100:00100000:3.0:1784047607.493729:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5057 00000100:00100000:3.0:1784047607.493738:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+26:2402:x1870705689549184:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:3.0:1784047607.493789:0:26186:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9edea00 x1870705689549184/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.493856:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0c846d7a-6357-4e9c-a620-e35737ede709+26:2402:x1870705689549184:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 119us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.493864:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5057 00000100:00100000:3.0:1784047607.493898:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689549056 00000100:00100000:3.0:1784047607.493903:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689549056 00002000:00100000:3.0:1784047607.493924:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff99cceca61c00 x1870705689549056/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047607.493934:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca61c00 with x1870705689549056 ext(0->1023) 00002000:00010000:3.0:1784047607.493940:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca61c00 00000100:00100000:3.0:1784047607.493968:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 627 00000100:00100000:3.0:1784047607.493976:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+26:2402:x1870705689549056:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:3.0:1784047607.494375:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca61c00 x1870705689549056/t4294968800(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.494407:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+28:2402:x1870705689549056:12345-192.168.204.40@tcp:4:dd.0 Request processed in 433us (5606us total) trans 4294968800 rc 0/0 00000100:00100000:3.0:1784047607.494425:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 627 00002000:00100000:3.0:1784047607.494432:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff99cceca61c00 x1870705689549056/t4294968800(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784047607.494448:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca61c00 with x1870705689549056 ext(0->1023) 00002000:00010000:3.0:1784047607.494452:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca61c00 00000100:00100000:2.0:1784047607.494839:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+148:73709:x1870705689549440:12345-192.168.204.40@tcp:35:dd.0 Request processed in 2258us (2391us total) trans 124554051729 rc 0/0 00000100:00100000:0.0:1784047607.494858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.494868:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 281 00000100:00100000:0.0:1784047607.494904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.495699:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550080 00000100:00100000:1.0:1784047607.495709:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550080 00000100:00100000:1.0:1784047607.495753:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5058 00000100:00100000:1.0:1784047607.495771:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+28:73712:x1870705689550080:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1784047607.495785:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784047607.495806:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c776a05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae864 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784047607.495828:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x794:0x0] initial LVB size: 0, mtime: 0x6a5667ed, atime: 0x6a5667ed, ctime: 0x6a5667ed, blocks: 0x0 00010000:00010000:1.0:1784047607.495846:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:1.0:1784047607.495851:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784047607.495859:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c776a05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae864 expref: 29 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.495876:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c776a05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae864 expref: 29 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047607.495889:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b88e00, rc 0) 00010000:00000080:1.0:1784047607.495895:0:8431:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca63b80 x1870705689550080/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.495940:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+29:73712:x1870705689550080:12345-192.168.204.40@tcp:101:dd.0 Request processed in 170us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.495946:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5058 00000100:00100000:2.0:1784047607.496807:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689549952 00000100:00100000:2.0:1784047607.496816:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689549952 00000100:00100000:2.0:1784047607.496853:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 282 00000100:00100000:2.0:1784047607.496862:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+148:73711:x1870705689549952:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:2.0:1784047607.497189:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+149:73711:x1870705689549952:12345-192.168.204.40@tcp:35:dd.0 Request processed in 327us (2284us total) trans 124554051730 rc 0/0 00000100:00100000:2.0:1784047607.497198:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 282 00000100:00100000:2.0:1784047607.505229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.505281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.505319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.506209:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550208 00000100:00100000:1.0:1784047607.506222:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550208 00000100:00100000:0.0:1784047607.506787:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550336 00000100:00100000:0.0:1784047607.506794:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550336 00000100:00100000:0.0:1784047607.506891:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5059 00000100:00100000:0.0:1784047607.506905:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+30:73713:x1870705689550336:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:0.0:1784047607.506925:0:8824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784047607.506949:0:8824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083aba387/0x4426598c0c776a0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae86b expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784047607.506976:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x795:0x0] initial LVB size: 0, mtime: 0x6a5667ed, atime: 0x6a5667ed, ctime: 0x6a5667ed, blocks: 0x0 00010000:00010000:0.0:1784047607.507000:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=3705s v=(0 0) 00010000:00010000:0.0:1784047607.507005:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784047607.507015:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083aba387/0x4426598c0c776a0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae86b expref: 31 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.507032:0:8824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083aba387/0x4426598c0c776a0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae86b expref: 31 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047607.507044:0:8824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc27dbe00, rc 0) 00010000:00000080:0.0:1784047607.507052:0:8824:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef51dc00 x1870705689550336/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 328/400 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.507136:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c846d7a-6357-4e9c-a620-e35737ede709+31:73713:x1870705689550336:12345-192.168.204.40@tcp:101:dd.0 Request processed in 235us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.507156:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5059 00002000:00010000:1.0:1784047607.507210:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.507216:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc9edf480 with x1870705689550208 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.507225:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc9edf480. 00000100:00100000:1.0:1784047607.507324:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550464 00000100:00100000:1.0:1784047607.507347:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550464 00002000:00100000:1.0:1784047607.507371:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff99cd0062ed80 x1870705689550464/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.507380:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0062ed80 with x1870705689550464 ext(0->1023) 00002000:00010000:1.0:1784047607.507385:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0062ed80 00000100:00100000:1.0:1784047607.507407:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 628 00000100:00100000:1.0:1784047607.507415:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+31:2402:x1870705689550208:12345-192.168.204.40@tcp:10:dd.0 00000100:00100000:2.0:1784047607.507787:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 629 00000100:00100000:2.0:1784047607.507797:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+32:2400:x1870705689550464:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:2.0:1784047607.508175:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0062ed80 x1870705689550464/t4294968802(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:1.0:1784047607.508199:0:24866:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784047607.508203:0:24866:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb mtime from disk: 1784047597 -> 1784047606 00002000:00010000:1.0:1784047607.508205:0:24866:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb atime from disk: 1784047597 -> 1784047597 00002000:00010000:1.0:1784047607.508208:0:24866:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb ctime from disk: 1784047597 -> 1784047606 00002000:00010000:1.0:1784047607.508210:0:24866:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784047607.508216:0:24866:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc9edf480 x1870705689550208/t4294968801(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.508221:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+34:2400:x1870705689550464:12345-192.168.204.40@tcp:4:dd.0 Request processed in 427us (2939us total) trans 4294968802 rc 0/0 00000100:00100000:2.0:1784047607.508228:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 629 00002000:00100000:2.0:1784047607.508235:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff99cd0062ed80 x1870705689550464/t4294968802(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.508239:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+34:2402:x1870705689550208:12345-192.168.204.40@tcp:10:dd.0 Request processed in 825us (3022us total) trans 4294968801 rc 0/0 00002000:00100000:2.0:1784047607.508243:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0062ed80 with x1870705689550464 ext(0->1023) 00002000:00010000:2.0:1784047607.508248:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0062ed80 00000100:00100000:1.0:1784047607.508481:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 628 00002000:00010000:1.0:1784047607.508486:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.508489:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc9edf480 with x1870705689550208 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.508495:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc9edf480. 00000100:00100000:2.0:1784047607.509346:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.509467:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550592 00000100:00100000:1.0:1784047607.509476:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550592 00000100:00100000:1.0:1784047607.509523:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5060 00000100:00100000:1.0:1784047607.509531:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+33:2400:x1870705689550592:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:3.0:1784047607.509947:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968802 is committed 00010000:00000080:1.0:1784047607.510359:0:26181:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccfdcf9880 x1870705689550592/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.510481:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+25:2400:x1870705689550592:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 949us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.510489:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5060 00000100:00100000:0.0:1784047607.514073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.514362:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550720 00000100:00100000:1.0:1784047607.514374:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550720 00002000:00010000:1.0:1784047607.514481:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:1.0:1784047607.514487:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca61500 with x1870705689550720 ext(0->18446744073709551615) 00002000:00010000:1.0:1784047607.514499:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca61500. 00000100:00100000:1.0:1784047607.514585:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 630 00000100:00100000:1.0:1784047607.514596:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+25:2402:x1870705689550720:12345-192.168.204.40@tcp:10:dd.0 00002000:00010000:0.0:1784047607.515157:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784047607.515162:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb mtime from disk: 1784047597 -> 1784047606 00002000:00010000:0.0:1784047607.515164:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb atime from disk: 1784047597 -> 1784047597 00002000:00010000:0.0:1784047607.515167:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb ctime from disk: 1784047597 -> 1784047606 00002000:00010000:0.0:1784047607.515169:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784047607.515180:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca61500 x1870705689550720/t4294968803(0) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.515251:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+26:2402:x1870705689550720:12345-192.168.204.40@tcp:10:dd.0 Request processed in 656us (1188us total) trans 4294968803 rc 0/0 00000100:00100000:0.0:1784047607.515260:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 630 00002000:00010000:0.0:1784047607.515264:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:0.0:1784047607.515267:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca61500 with x1870705689550720 ext(0->18446744073709551615) 00002000:00010000:0.0:1784047607.515272:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca61500. 00000100:00100000:0.0:1784047607.515321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.516072:0:66222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550976 00000100:00100000:3.0:1784047607.516170:0:66222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550976 00000100:00100000:3.0:1784047607.516224:0:66222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 283 00000100:00100000:3.0:1784047607.516234:0:66222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+149:73712:x1870705689550976:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:3.0:1784047607.516576:0:66222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c846d7a-6357-4e9c-a620-e35737ede709+150:73712:x1870705689550976:12345-192.168.204.40@tcp:35:dd.0 Request processed in 341us (1252us total) trans 124554051731 rc 0/0 00000100:00100000:3.0:1784047607.516584:0:66222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 283 00000100:00100000:2.0:1784047607.520530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.520587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.520669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.520783:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551488 00000100:00100000:1.0:1784047607.520795:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551488 00000100:00100000:1.0:1784047607.520860:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5061 00000100:00100000:1.0:1784047607.520873:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689551488:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:1.0:1784047607.520947:0:26183:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbcaa15f80 x1870705689551488/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.520970:0:95918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551232 00000100:00100000:3.0:1784047607.520977:0:95918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551232 00000100:00100000:1.0:1784047607.521010:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689551488:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 138us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.521018:0:95918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 284 00000100:00100000:1.0:1784047607.521022:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5061 00000100:00100000:3.0:1784047607.521032:0:95918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+150:73713:x1870705689551232:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1784047607.521052:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551360 00000100:00100000:1.0:1784047607.521057:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551360 00002000:00100000:1.0:1784047607.521081:0:24868:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff99cbc5a25500 x1870705689551360/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.521090:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc5a25500 with x1870705689551360 ext(0->1023) 00002000:00010000:1.0:1784047607.521110:0:24868:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc5a25500 00000100:00100000:1.0:1784047607.521134:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 631 00000100:00100000:1.0:1784047607.521142:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689551360:12345-192.168.204.40@tcp:4:dd.0 00000100:00100000:3.0:1784047607.521301:0:95918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0c846d7a-6357-4e9c-a620-e35737ede709+151:73713:x1870705689551232:12345-192.168.204.40@tcp:35:dd.0 Request processed in 271us (780us total) trans 124554051732 rc 0/0 00000100:00100000:3.0:1784047607.521310:0:95918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 284 00010000:00000080:1.0:1784047607.521529:0:24868:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbc5a25500 x1870705689551360/t4294968804(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.521556:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+28:2401:x1870705689551360:12345-192.168.204.40@tcp:4:dd.0 Request processed in 416us (968us total) trans 4294968804 rc 0/0 00000100:00100000:1.0:1784047607.521563:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 631 00002000:00100000:1.0:1784047607.521569:0:24868:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff99cbc5a25500 x1870705689551360/t4294968804(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.521576:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbc5a25500 with x1870705689551360 ext(0->1023) 00002000:00010000:1.0:1784047607.521579:0:24868:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbc5a25500 00000100:00100000:0.0:1784047607.530158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.530203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.530292:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551744 00000100:00100000:1.0:1784047607.530303:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551744 00000100:00100000:3.0:1784047607.530305:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551616 00000100:00100000:3.0:1784047607.530312:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551616 00002000:00100000:3.0:1784047607.530369:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff99cceca61180 x1870705689551616/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.530382:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5062 00000100:00100000:1.0:1784047607.530396:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+29:2400:x1870705689551744:12345-192.168.204.40@tcp:16:kworker.0 00002000:00100000:3.0:1784047607.530416:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca61180 with x1870705689551616 ext(0->1023) 00002000:00010000:3.0:1784047607.530423:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca61180 00000100:00100000:3.0:1784047607.530441:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 632 00010000:00000080:1.0:1784047607.530451:0:26184:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca63100 x1870705689551744/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.530452:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+29:2400:x1870705689551616:12345-192.168.204.40@tcp:4:dd.0 00000100:00100000:1.0:1784047607.530527:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+29:2400:x1870705689551744:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 133us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.530536:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5062 00010000:00000080:1.0:1784047607.531694:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca61180 x1870705689551616/t4294968805(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.531750:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+30:2400:x1870705689551616:12345-192.168.204.40@tcp:4:dd.0 Request processed in 1301us (1603us total) trans 4294968805 rc 0/0 00000100:00100000:1.0:1784047607.531765:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 632 00002000:00100000:1.0:1784047607.531774:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff99cceca61180 x1870705689551616/t4294968805(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.531783:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca61180 with x1870705689551616 ext(0->1023) 00002000:00010000:1.0:1784047607.531789:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca61180 00000100:00100000:0.0:1784047607.543132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.543221:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551872 00000100:00100000:1.0:1784047607.543232:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551872 00002000:00100000:1.0:1784047607.543284:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff99cceca62d80 x1870705689551872/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.543295:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca62d80 with x1870705689551872 ext(0->1023) 00002000:00010000:1.0:1784047607.543301:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca62d80 00000100:00100000:1.0:1784047607.543350:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 633 00000100:00100000:1.0:1784047607.543361:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+30:2401:x1870705689551872:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:1.0:1784047607.543843:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca62d80 x1870705689551872/t4294968806(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.543910:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+32:2401:x1870705689551872:12345-192.168.204.40@tcp:4:dd.0 Request processed in 550us (786us total) trans 4294968806 rc 0/0 00000100:00100000:1.0:1784047607.543918:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 633 00002000:00100000:1.0:1784047607.543925:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff99cceca62d80 x1870705689551872/t4294968806(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.543933:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca62d80 with x1870705689551872 ext(0->1023) 00002000:00010000:1.0:1784047607.543937:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca62d80 00000100:00100000:3.0:1784047607.544222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.544437:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552000 00000100:00100000:2.0:1784047607.544444:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552000 00000100:00100000:2.0:1784047607.544487:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5063 00000100:00100000:2.0:1784047607.544495:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+32:2401:x1870705689552000:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:2.0:1784047607.545651:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968806 is committed 00010000:00000080:3.0:1784047607.545749:0:26192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccf2ea8700 x1870705689552000/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.545823:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689552000:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 1328us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.545832:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5063 00000100:00100000:3.0:1784047607.556588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.557788:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552128 00000100:00100000:1.0:1784047607.557815:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552128 00000100:00100000:0.0:1784047607.557821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00002000:00100000:1.0:1784047607.557872:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff99ccec86d880 x1870705689552128/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.557889:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec86d880 with x1870705689552128 ext(0->1023) 00002000:00010000:1.0:1784047607.557895:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec86d880 00000100:00100000:2.0:1784047607.557921:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552256 00000100:00100000:2.0:1784047607.557928:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552256 00000100:00100000:1.0:1784047607.557940:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 634 00000100:00100000:1.0:1784047607.557953:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689552128:12345-192.168.204.40@tcp:4:dd.0 00000100:00100000:2.0:1784047607.557976:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5064 00000100:00100000:2.0:1784047607.557988:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689552256:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:2.0:1784047607.558027:0:13594:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca61f80 x1870705689552256/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.558087:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689552256:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.558095:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5064 00010000:00000080:1.0:1784047607.558324:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec86d880 x1870705689552128/t4294968807(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.558389:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689552128:12345-192.168.204.40@tcp:4:dd.0 Request processed in 439us (1811us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1784047607.558396:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 634 00002000:00100000:1.0:1784047607.558403:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff99ccec86d880 x1870705689552128/t4294968807(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.558411:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec86d880 with x1870705689552128 ext(0->1023) 00002000:00010000:1.0:1784047607.558415:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec86d880 00000100:00100000:3.0:1784047607.569363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.569859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.569906:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552512 00000100:00100000:2.0:1784047607.569919:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552512 00000100:00100000:2.0:1784047607.569986:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5065 00000100:00100000:2.0:1784047607.569998:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+27:2399:x1870705689552512:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:2.0:1784047607.570058:0:8433:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec86c380 x1870705689552512/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.570127:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+27:2399:x1870705689552512:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 132us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.570150:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5065 00000100:00100000:1.0:1784047607.570321:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552384 00000100:00100000:1.0:1784047607.570337:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552384 00002000:00100000:1.0:1784047607.570366:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff99ccec86e680 x1870705689552384/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.570375:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec86e680 with x1870705689552384 ext(0->1023) 00002000:00010000:1.0:1784047607.570381:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec86e680 00000100:00100000:1.0:1784047607.570417:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 635 00000100:00100000:1.0:1784047607.570424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+27:2399:x1870705689552384:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:1.0:1784047607.570850:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec86e680 x1870705689552384/t4294968808(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.570886:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+29:2399:x1870705689552384:12345-192.168.204.40@tcp:4:dd.0 Request processed in 462us (1535us total) trans 4294968808 rc 0/0 00000100:00100000:1.0:1784047607.570893:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 635 00002000:00100000:1.0:1784047607.570900:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff99ccec86e680 x1870705689552384/t4294968808(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.570908:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec86e680 with x1870705689552384 ext(0->1023) 00002000:00010000:1.0:1784047607.570912:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec86e680 00000100:00100000:3.0:1784047607.585115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.585172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.585317:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552768 00000100:00100000:0.0:1784047607.585338:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552768 00000100:00100000:0.0:1784047607.585414:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5066 00000100:00100000:0.0:1784047607.585425:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+29:2402:x1870705689552768:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:0.0:1784047607.585484:0:26193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce495b480 x1870705689552768/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.585553:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+29:2402:x1870705689552768:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 130us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.585561:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5066 00000100:00100000:1.0:1784047607.585987:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552640 00000100:00100000:1.0:1784047607.585994:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552640 00002000:00100000:1.0:1784047607.586027:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff99ccec86d180 x1870705689552640/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.586039:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec86d180 with x1870705689552640 ext(0->1023) 00002000:00010000:1.0:1784047607.586044:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec86d180 00000100:00100000:1.0:1784047607.586078:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 636 00000100:00100000:1.0:1784047607.586086:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+29:2401:x1870705689552640:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:1.0:1784047607.586712:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccec86d180 x1870705689552640/t4294968809(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.586752:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+31:2401:x1870705689552640:12345-192.168.204.40@tcp:4:dd.0 Request processed in 668us (1647us total) trans 4294968809 rc 0/0 00000100:00100000:1.0:1784047607.586759:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 636 00002000:00100000:1.0:1784047607.586765:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff99ccec86d180 x1870705689552640/t4294968809(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.586787:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccec86d180 with x1870705689552640 ext(0->1023) 00002000:00010000:1.0:1784047607.586791:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccec86d180 00000100:00100000:3.0:1784047607.602599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.602873:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552896 00000100:00100000:2.0:1784047607.602884:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552896 00002000:00100000:2.0:1784047607.602940:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff99cd0045aa00 x1870705689552896/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.602952:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0045aa00 with x1870705689552896 ext(0->1023) 00002000:00010000:2.0:1784047607.602959:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0045aa00 00000100:00100000:2.0:1784047607.602998:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 637 00000100:00100000:2.0:1784047607.603009:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+31:2401:x1870705689552896:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:2.0:1784047607.603414:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd0045aa00 x1870705689552896/t4294968810(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.603483:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+33:2401:x1870705689552896:12345-192.168.204.40@tcp:4:dd.0 Request processed in 476us (897us total) trans 4294968810 rc 0/0 00000100:00100000:2.0:1784047607.603492:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 637 00002000:00100000:2.0:1784047607.603499:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff99cd0045aa00 x1870705689552896/t4294968810(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.603508:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd0045aa00 with x1870705689552896 ext(0->1023) 00002000:00010000:2.0:1784047607.603512:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd0045aa00 00000100:00100000:2.0:1784047607.605257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.605419:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553024 00000100:00100000:0.0:1784047607.605428:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553024 00000100:00100000:0.0:1784047607.605484:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5067 00000100:00100000:0.0:1784047607.605495:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+33:2401:x1870705689553024:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:2.0:1784047607.605857:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968810 is committed 00010000:00000080:0.0:1784047607.605971:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbcaa15500 x1870705689553024/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.606039:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689553024:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 546us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.606048:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5067 00000100:00100000:3.0:1784047607.615838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.615892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.615992:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553152 00000100:00100000:1.0:1784047607.616002:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553152 00002000:00100000:1.0:1784047607.616055:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff99cd00459880 x1870705689553152/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.616066:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd00459880 with x1870705689553152 ext(0->1023) 00002000:00010000:1.0:1784047607.616072:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd00459880 00000100:00100000:1.0:1784047607.616110:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 638 00000100:00100000:1.0:1784047607.616121:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689553152:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:1.0:1784047607.616522:0:24866:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cd00459880 x1870705689553152/t4294968811(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.616746:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689553152:12345-192.168.204.40@tcp:4:dd.0 Request processed in 625us (919us total) trans 4294968811 rc 0/0 00000100:00100000:1.0:1784047607.616754:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 638 00002000:00100000:1.0:1784047607.616761:0:24866:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff99cd00459880 x1870705689553152/t4294968811(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.616770:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cd00459880 with x1870705689553152 ext(0->1023) 00002000:00010000:1.0:1784047607.616774:0:24866:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cd00459880 00000100:00100000:0.0:1784047607.616858:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553280 00000100:00100000:0.0:1784047607.616863:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553280 00000100:00100000:0.0:1784047607.616899:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5068 00000100:00100000:0.0:1784047607.616905:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689553280:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:0.0:1784047607.617110:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968811 is committed 00010000:00000080:0.0:1784047607.617145:0:26190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef517800 x1870705689553280/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047607.617173:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689553280:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 268us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047607.617180:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5068 00000100:00100000:3.0:1784047607.622857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.623176:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553408 00000100:00100000:2.0:1784047607.623187:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553408 00002000:00100000:2.0:1784047607.623238:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff99ccef516680 x1870705689553408/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.623268:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef516680 with x1870705689553408 ext(0->1023) 00002000:00010000:2.0:1784047607.623274:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef516680 00000100:00100000:2.0:1784047607.623316:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 639 00000100:00100000:2.0:1784047607.623338:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689553408:12345-192.168.204.40@tcp:4:dd.0 00000100:00100000:3.0:1784047607.623972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.624050:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553536 00000100:00100000:1.0:1784047607.624055:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553536 00000100:00100000:1.0:1784047607.624096:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5069 00000100:00100000:1.0:1784047607.624104:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689553536:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:1.0:1784047607.624147:0:26189:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef515180 x1870705689553536/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.624212:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689553536:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047607.624220:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5069 00010000:00000080:2.0:1784047607.625047:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99ccef516680 x1870705689553408/t4294968812(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.625143:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689553408:12345-192.168.204.40@tcp:4:dd.0 Request processed in 1817us (2293us total) trans 4294968812 rc 0/0 00000100:00100000:2.0:1784047607.625151:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 639 00002000:00100000:2.0:1784047607.625159:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff99ccef516680 x1870705689553408/t4294968812(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.625167:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccef516680 with x1870705689553408 ext(0->1023) 00002000:00010000:2.0:1784047607.625172:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccef516680 00000100:00100000:3.0:1784047607.629968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.630016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.630112:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553792 00000100:00100000:2.0:1784047607.630123:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553792 00000100:00100000:2.0:1784047607.630184:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5070 00000100:00100000:2.0:1784047607.630193:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689553792:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:2.0:1784047607.630246:0:26187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd060ce00 x1870705689553792/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.630302:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689553792:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.630309:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5070 00000100:00100000:1.0:1784047607.632163:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553664 00000100:00100000:1.0:1784047607.632177:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553664 00002000:00100000:1.0:1784047607.632225:0:24868:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff99cbd060df80 x1870705689553664/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.632237:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd060df80 with x1870705689553664 ext(0->1023) 00002000:00010000:1.0:1784047607.632243:0:24868:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd060df80 00000100:00100000:1.0:1784047607.632278:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 640 00000100:00100000:1.0:1784047607.632288:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689553664:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:1.0:1784047607.632989:0:24868:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd060df80 x1870705689553664/t4294968813(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.633055:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+29:2401:x1870705689553664:12345-192.168.204.40@tcp:4:dd.0 Request processed in 768us (3096us total) trans 4294968813 rc 0/0 00000100:00100000:1.0:1784047607.633064:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 640 00002000:00100000:1.0:1784047607.633071:0:24868:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff99cbd060df80 x1870705689553664/t4294968813(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.633080:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd060df80 with x1870705689553664 ext(0->1023) 00002000:00010000:1.0:1784047607.633084:0:24868:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd060df80 00000100:00100000:0.0:1784047607.634753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.634851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.635357:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553920 00000100:00100000:2.0:1784047607.635387:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553920 00002000:00100000:2.0:1784047607.635444:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff99cceca62a00 x1870705689553920/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.635803:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca62a00 with x1870705689553920 ext(0->1023) 00002000:00010000:2.0:1784047607.635810:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca62a00 00000100:00100000:2.0:1784047607.635896:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 641 00000100:00100000:2.0:1784047607.635908:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+29:2401:x1870705689553920:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:2.0:1784047607.636338:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca62a00 x1870705689553920/t4294968814(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.636430:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+31:2401:x1870705689553920:12345-192.168.204.40@tcp:4:dd.0 Request processed in 525us (1685us total) trans 4294968814 rc 0/0 00000100:00100000:2.0:1784047607.636439:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 641 00002000:00100000:2.0:1784047607.636446:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff99cceca62a00 x1870705689553920/t4294968814(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.636455:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cceca62a00 with x1870705689553920 ext(0->1023) 00002000:00010000:2.0:1784047607.636458:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cceca62a00 00000100:00100000:2.0:1784047607.636492:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554048 00000100:00100000:2.0:1784047607.636497:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554048 00000100:00100000:2.0:1784047607.636527:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5071 00000100:00100000:2.0:1784047607.636545:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+31:2401:x1870705689554048:12345-192.168.204.40@tcp:16:kworker.0 00000001:00080000:2.0:1784047607.636784:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968814 is committed 00010000:00000080:2.0:1784047607.636830:0:8432:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca60e00 x1870705689554048/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.636860:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+25:2401:x1870705689554048:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 316us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.636873:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5071 00000100:00100000:0.0:1784047607.640037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.640046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.640147:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554176 00000100:00100000:2.0:1784047607.640160:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554176 00000100:00100000:3.0:1784047607.640194:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554304 00000100:00100000:3.0:1784047607.640199:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554304 00002000:00100000:2.0:1784047607.640210:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff99cbd0c7f480 x1870705689554176/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.640219:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd0c7f480 with x1870705689554176 ext(0->1023) 00002000:00010000:2.0:1784047607.640225:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd0c7f480 00000100:00100000:3.0:1784047607.640240:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5072 00000100:00100000:3.0:1784047607.640258:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689554304:12345-192.168.204.40@tcp:16:kworker.0 00000100:00100000:2.0:1784047607.640346:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 642 00000100:00100000:2.0:1784047607.640355:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+26:2401:x1870705689554176:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:3.0:1784047607.640784:0:26184:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca60a80 x1870705689554304/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00010000:00000080:2.0:1784047607.640810:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd0c7f480 x1870705689554176/t4294968815(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.640881:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+28:2401:x1870705689554176:12345-192.168.204.40@tcp:4:dd.0 Request processed in 486us (793us total) trans 4294968815 rc 0/0 00000100:00100000:2.0:1784047607.640890:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 642 00002000:00100000:2.0:1784047607.640897:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff99cbd0c7f480 x1870705689554176/t4294968815(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.640898:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+28:2401:x1870705689554304:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 643us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.640905:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5072 00002000:00100000:2.0:1784047607.640905:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd0c7f480 with x1870705689554176 ext(0->1023) 00002000:00010000:2.0:1784047607.640908:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd0c7f480 00000100:00100000:1.0:1784047607.643984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047607.643984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.644081:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554560 00000100:00100000:3.0:1784047607.644093:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554560 00000100:00100000:2.0:1784047607.644093:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554432 00000100:00100000:2.0:1784047607.644097:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554432 00002000:00100000:2.0:1784047607.644139:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff99cbd0c7ea00 x1870705689554432/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.644147:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5073 00002000:00100000:2.0:1784047607.644149:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd0c7ea00 with x1870705689554432 ext(0->1023) 00002000:00010000:2.0:1784047607.644155:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd0c7ea00 00000100:00100000:3.0:1784047607.644157:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+28:2401:x1870705689554560:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:3.0:1784047607.644205:0:26192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca62680 x1870705689554560/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.644308:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0c846d7a-6357-4e9c-a620-e35737ede709+28:2401:x1870705689554560:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.644315:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5073 00000100:00100000:2.0:1784047607.644553:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 643 00000100:00100000:2.0:1784047607.644561:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+27:2401:x1870705689554432:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:2.0:1784047607.644948:0:24851:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd0c7ea00 x1870705689554432/t4294968816(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.645033:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+29:2401:x1870705689554432:12345-192.168.204.40@tcp:4:dd.0 Request processed in 472us (1059us total) trans 4294968816 rc 0/0 00000100:00100000:2.0:1784047607.645040:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 643 00002000:00100000:2.0:1784047607.645047:0:24851:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff99cbd0c7ea00 x1870705689554432/t4294968816(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.645056:0:24851:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd0c7ea00 with x1870705689554432 ext(0->1023) 00002000:00010000:2.0:1784047607.645060:0:24851:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd0c7ea00 00000100:00100000:1.0:1784047607.648020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047607.648064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.648161:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554688 00000100:00100000:2.0:1784047607.648172:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554688 00002000:00100000:2.0:1784047607.648222:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff99cbd0c7d880 x1870705689554688/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.648234:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd0c7d880 with x1870705689554688 ext(0->1023) 00002000:00010000:2.0:1784047607.648240:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd0c7d880 00000100:00100000:2.0:1784047607.648277:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 644 00000100:00100000:2.0:1784047607.648288:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+29:2401:x1870705689554688:12345-192.168.204.40@tcp:4:dd.0 00000100:00100000:3.0:1784047607.648703:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554816 00000100:00100000:3.0:1784047607.648709:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554816 00010000:00000080:2.0:1784047607.648734:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd0c7d880 x1870705689554688/t4294968817(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.648750:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5074 00000100:00100000:3.0:1784047607.648757:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+32:2402:x1870705689554816:12345-192.168.204.40@tcp:16:kworker.0 00000100:00100000:2.0:1784047607.648808:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+32:2401:x1870705689554688:12345-192.168.204.40@tcp:4:dd.0 Request processed in 522us (797us total) trans 4294968817 rc 0/0 00000100:00100000:2.0:1784047607.648817:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 644 00002000:00100000:2.0:1784047607.648832:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff99cbd0c7d880 x1870705689554688/t4294968817(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784047607.648840:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd0c7d880 with x1870705689554688 ext(0->1023) 00002000:00010000:2.0:1784047607.648844:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd0c7d880 00000001:00080000:2.0:1784047607.649186:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968817 is committed 00010000:00000080:3.0:1784047607.649275:0:26188:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd0c7c000 x1870705689554816/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047607.649373:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+25:2402:x1870705689554816:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 614us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047607.649380:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5074 00000100:00100000:3.0:1784047607.655975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047607.656027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047607.656524:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555072 00000100:00100000:2.0:1784047607.656544:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555072 00000100:00100000:2.0:1784047607.656642:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5075 00000100:00100000:2.0:1784047607.656654:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+25:2402:x1870705689555072:12345-192.168.204.40@tcp:16:kworker.0 00010000:00000080:2.0:1784047607.656719:0:8433:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd060d180 x1870705689555072/t0(0) o16->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 440/432 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047607.656777:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+25:2402:x1870705689555072:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 126us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047607.656785:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5075 00000100:00100000:1.0:1784047607.656875:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554944 00000100:00100000:1.0:1784047607.656880:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554944 00002000:00100000:1.0:1784047607.656908:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff99cbd060c700 x1870705689554944/t0(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/0 e 0 to 0 dl 1784047618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.656919:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd060c700 with x1870705689554944 ext(0->1023) 00002000:00010000:1.0:1784047607.656925:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd060c700 00000100:00100000:1.0:1784047607.656948:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 645 00000100:00100000:1.0:1784047607.656956:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+26:2402:x1870705689554944:12345-192.168.204.40@tcp:4:dd.0 00010000:00000080:1.0:1784047607.657321:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cbd060c700 x1870705689554944/t4294968818(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047607.657373:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+28:2402:x1870705689554944:12345-192.168.204.40@tcp:4:dd.0 Request processed in 418us (1346us total) trans 4294968818 rc 0/0 00000100:00100000:1.0:1784047607.657381:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 645 00002000:00100000:1.0:1784047607.657387:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff99cbd060c700 x1870705689554944/t4294968818(0) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:738/0 lens 1512/448 e 0 to 0 dl 1784047618 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784047607.657395:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cbd060c700 with x1870705689554944 ext(0->1023) 00002000:00010000:1.0:1784047607.657398:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99cbd060c700 00010000:00010000:1.0:1784047608.091178:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047608.599752:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709420928:0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.599837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.599881:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709420928 00000100:00100000:1.0:1784047608.599888:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709421440:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.599890:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709420928 00000100:00100000:1.0:1784047608.599925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.599942:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784047608.599953:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709420928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.599969:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709421952:0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.600011:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709420928:12345-0@lo:400:kworker.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047608.600019:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784047608.600032:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709422464:0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.600097:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421440 00000100:00100000:0.0:1784047608.600101:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421440 00000100:00100000:1.0:1784047608.600108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709420928:0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600124:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784047608.600132:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709421056:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.600137:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421952 00000100:00100000:0.0:1784047608.600141:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421952 00000100:00100000:0.0:1784047608.600159:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422464 00000100:00100000:1.0:1784047608.600163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.600164:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422464 00000100:00100000:0.0:1784047608.600180:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421056 00000100:00100000:1.0:1784047608.600182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709421568:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.600184:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421056 00000100:00100000:0.0:1784047608.600202:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:0.0:1784047608.600210:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709421440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047608.600240:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709422080:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.600251:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709421440:12345-0@lo:400:kworker.0 Request processed in 42us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047608.600258:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1784047608.600270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.600274:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1784047608.600281:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709421952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600304:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709421440:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.600324:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870705709421952:12345-0@lo:400:kworker.0 Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047608.600331:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1784047608.600333:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870705709421952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.600347:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1784047608.600361:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709422464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.600395:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709422464:12345-0@lo:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047608.600399:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1784047608.600407:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1784047608.600412:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709421056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600450:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870705709421056:12345-0@lo:400:kworker.0 Request processed in 42us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047608.600457:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00080000:1.0:1784047608.600478:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047608.600482:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784047608.600492:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421568 00000100:00100000:1.0:1784047608.600496:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421568 00000100:00100000:1.0:1784047608.600533:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422080 00000100:00100000:1.0:1784047608.600537:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422080 00000100:00100000:1.0:1784047608.600582:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1784047608.600589:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709421568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600642:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709421568:12345-0@lo:400:kworker.0 Request processed in 53us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047608.600649:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1784047608.600664:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1784047608.600670:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709422080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047608.600698:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709422080:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047608.600705:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1784047608.601092:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709421184:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.601146:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709421696:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.601186:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709422208:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601206:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.601226:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784047608.601233:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709421312:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.601271:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709421824:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601335:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.601355:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709422336:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.601414:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421184 00000100:00100000:2.0:1784047608.601418:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421184 00000100:00100000:2.0:1784047608.601453:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421312 00000100:00100000:2.0:1784047608.601455:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421312 00000100:00100000:2.0:1784047608.601467:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1784047608.601472:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709421184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601507:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709421184:12345-0@lo:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.601513:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1784047608.601525:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1784047608.601531:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709421312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601556:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfa3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709421312:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.601562:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1784047608.601628:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421696 00000100:00100000:2.0:1784047608.601631:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421696 00000100:00100000:2.0:1784047608.601657:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422208 00000100:00100000:2.0:1784047608.601660:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422208 00000100:00100000:2.0:1784047608.601675:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709421824 00000100:00100000:2.0:1784047608.601678:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709421824 00000100:00100000:2.0:1784047608.601696:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422336 00000100:00100000:2.0:1784047608.601699:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422336 00000100:00100000:2.0:1784047608.601717:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:2.0:1784047608.601723:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709421696:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784047608.601736:0:26186:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce453a300 x1870705709421696/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:739/0 lens 224/224 e 0 to 0 dl 1784047619 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047608.601774:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709421696:12345-0@lo:400:kworker.0 Request processed in 51us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.601781:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:2.0:1784047608.601793:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:2.0:1784047608.601799:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709422208:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1784047608.601812:0:26186:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cce4538a80 x1870705709422208/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:739/0 lens 224/224 e 0 to 0 dl 1784047619 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047608.601837:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709422208:12345-0@lo:400:kworker.0 Request processed in 39us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.601842:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:2.0:1784047608.601852:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:2.0:1784047608.601858:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709421824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601884:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709421824:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.601889:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:2.0:1784047608.601901:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:2.0:1784047608.601907:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709422336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.601934:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709422336:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.601940:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:2.0:1784047608.601964:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709422720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047608.601989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047608.602026:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709421312:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.602037:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709421824:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.602056:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709422336:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.602066:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709421184:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.602075:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709421696:0@lo:400:kworker.0 00000100:00100000:2.0:1784047608.602085:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709422208:0@lo:400:kworker.0 00000100:00080000:0.0:1784047608.605550:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047608.605560:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784047608.605564:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047608.605567:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047608.605660:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870705709421056:0@lo:400:kworker.0 00000100:00100000:3.0:1784047608.605661:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709422592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047608.605683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709421568:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.605696:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709422080:0@lo:400:kworker.0 00000100:00100000:0.0:1784047608.605709:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709422464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047608.605741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047608.605778:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422720 00000100:00100000:0.0:1784047608.605786:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422720 00000100:00100000:0.0:1784047608.605831:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422592 00000100:00100000:0.0:1784047608.605835:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422592 00000100:00100000:0.0:1784047608.605858:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:0.0:1784047608.605866:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709422720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047608.605900:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:0.0:1784047608.605946:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709422720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047608.605952:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:2.0:1784047608.606071:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709422720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047608.606107:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1784047608.606116:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709422592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047608.606135:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1784047608.606179:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709422592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047608.606185:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:1.0:1784047608.607541:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709422592:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784047609.108819:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047609.109648:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709422848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047609.109741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047609.109805:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422848 00000100:00100000:3.0:1784047609.109812:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422848 00000100:00100000:3.0:1784047609.109864:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:3.0:1784047609.109875:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709422848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047609.109908:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047609.109958:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709422848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047609.109965:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:3.0:1784047609.110118:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709422848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047609.113090:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709422976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784047609.113164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047609.113856:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709422976 00000100:00100000:1.0:1784047609.113865:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709422976 00000100:00100000:1.0:1784047609.113924:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:1.0:1784047609.113934:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709422976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784047609.113964:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176827840 pending 28672 free 3922399232 avail 3690876928 00010000:00000080:1.0:1784047609.113978:0:12054:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99cceca62300 x1870705709422976/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:740/0 lens 224/368 e 0 to 0 dl 1784047620 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047609.114034:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709422976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047609.114041:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:1.0:1784047609.114242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709422976:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1784047609.296379:0:96004:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1784047609.296435:0:96004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296450:0:96004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296458:0:96004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296466:0:96004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296503:0:96004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784047609.296509:0:96004:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1784047609.296794:0:15071:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784047609.296801:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296809:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6c600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:2.0:1784047609.296812:0:15071:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296822:0:15071:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784047609.296828:0:15071:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047609.296834:0:15071:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784047609.296837:0:15071:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784047609.296839:0:15071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784047609.296880:0:15071:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.296886:0:15071:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784047609.297173:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.297182:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6c600/0x4426598c0c776011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c776018 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047609.297194:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047609.297202:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047609.297204:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784047609.297218:0:96004:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784047609.297223:0:96004:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784047609.297228:0:96004:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784047609.297241:0:96004:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784047609.297291:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709423232:0@lo:39:umount.0 00000100:00100000:0.0:1784047609.297383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047609.297432:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423232 00000100:00100000:0.0:1784047609.297438:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423232 00000100:00100000:0.0:1784047609.297478:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:0.0:1784047609.297486:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709423232:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784047609.297519:0:67153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775c4b 00000100:00080000:0.0:1784047609.297533:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784047609.297586:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3644:x1870705709423232:12345-0@lo:39:umount.0 Request processed in 99us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047609.297593:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000020:00000080:0.0:1784047609.297603:0:67153:0:(genops.c:906:class_export_put()) final put ffff99ccfe665000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:1.0:1784047609.297679:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784047609.297691:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709423104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784047609.297724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047609.297773:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423104 00000100:00100000:1.0:1784047609.297781:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423104 00000100:00100000:1.0:1784047609.297816:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1784047609.297822:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709423104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784047609.297834:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784047609.297848:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c46600/0x4426598c0c776018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c776011 expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.297860:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784047609.297887:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+23:3645:x1870705709423104:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047609.297894:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1784047609.297930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709423104:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784047609.298215:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccfe665000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1784047609.298241:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047609.298261:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc64c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1784047609.298267:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd897f800 for lustre-MDT0000 00000100:00100000:0.0:1784047609.298280:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709423232:0@lo:39:umount.0 00000100:00080000:1.0:1784047609.298324:0:96004:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784047609.298327:0:96004:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784047609.298331:0:96004:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784047609.299793:0:96004:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784047609.299796:0:96004:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784047609.299802:0:96004:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784047609.299821:0:96004:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d54800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784047609.299903:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870705709423360:0@lo:39:umount.0 00000100:00100000:2.0:1784047609.299959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047609.300110:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423360 00000100:00100000:1.0:1784047609.300117:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423360 00000100:00100000:1.0:1784047609.300167:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:1.0:1784047609.300176:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870705709423360:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784047609.300199:0:68026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c76f9fe 00000100:00080000:1.0:1784047609.300208:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99cbc6ea6800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784047609.300263:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+1:3644:x1870705709423360:12345-0@lo:39:umount.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047609.300285:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000020:00000080:1.0:1784047609.300306:0:68026:0:(genops.c:906:class_export_put()) final put ffff99cbc6ea0000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1784047609.300327:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784047609.300335:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc6ea0000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1784047609.300389:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc6ea6800 for lustre-MDT0001 00000100:00080000:1.0:1784047609.300424:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc1d54800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784047609.300434:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870705709423360:0@lo:39:umount.0 00000100:00080000:1.0:1784047609.300454:0:96004:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784047609.300456:0:96004:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784047609.300459:0:96004:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784047609.303666:0:96004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303686:0:96004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303693:0:96004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303701:0:96004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303720:0:96004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784047609.303727:0:96004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303733:0:96004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303745:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047609.303753:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303760:0:96004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303760:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebd6ce00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047609.303765:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303767:0:96004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303773:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047609.303780:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047609.303781:0:96004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784047609.303785:0:96004:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:01000000:0.0:1784047609.303786:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784047609.303794:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1784047609.303796:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1784047609.303829:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784047609.303834:0:96004:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1784047609.303835:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000000:1.0:1784047609.303839:0:96004:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:1.0:1784047609.303843:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1784047609.303849:0:96004:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:0.0:1784047609.303862:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303868:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebd6ce00/0x4426598c0c77601f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c776026 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303881:0:16468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047609.303884:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303889:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbe000 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047609.303891:0:16468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303897:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047609.303903:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047609.303908:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784047609.303910:0:16468:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784047609.303912:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784047609.303926:0:16468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303941:0:16468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784047609.303949:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303954:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccebdbe000/0x4426598c0c775c1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4426598c0c775c21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047609.303963:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047609.303964:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047609.303966:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047609.303984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709423488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047609.304059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047609.304105:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784047609.304111:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709423616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047609.304133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047609.304163:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423488 00000100:00100000:0.0:1784047609.304169:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423488 00000100:00100000:0.0:1784047609.304291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423616 00000100:00100000:0.0:1784047609.304306:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423616 00000100:00100000:0.0:1784047609.304332:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1784047609.304341:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709423488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784047609.304349:0:10393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00010000:00010000:0.0:1784047609.304354:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784047609.304357:0:10393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709423616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047609.304364:0:10393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784047609.304368:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccebd6da00/0x4426598c0c776026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c77601f expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047609.304372:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cce3b88400/0x4426598c0c775c21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4426598c0c775c1a expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047609.304381:0:10393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784047609.304381:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784047609.304413:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709423488:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047609.304417:0:10393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709423616:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047609.304428:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1784047609.304431:0:10393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1784047609.304472:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709423616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047609.304481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709423488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047609.304758:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:1.0:1784047609.307784:0:96004:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1784047609.307834:0:96004:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:3.0:1784047609.308274:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968818 is committed 00000020:00000080:1.0:1784047609.308372:0:96004:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1784047609.308382:0:96004:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff99ccd8431000 0c846d7a-6357-4e9c-a620-e35737ede709 192.168.204.40@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294968818 stale:0 00000020:00080000:1.0:1784047609.308389:0:96004:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff99cbcaee3800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968774 stale:0 00000020:00080000:1.0:1784047609.308394:0:96004:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff99ccc832b000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968756 stale:0 00000020:00080000:1.0:1784047609.308400:0:96004:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff99cd00f00000) has exports, disconnecting them 00000020:00080000:1.0:1784047609.308405:0:96004:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.40@tcp (ffff99ccd8431000), last request at 1784047607 00000020:00000080:1.0:1784047609.308411:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775e5f 00000020:00010000:1.0:1784047609.308420:0:96004:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ccd8431000: total 0 00000100:00080000:1.0:1784047609.308425:0:96004:0:(import.c:65:import_set_state_nolock()) ffff99ccd8434000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784047609.308476:0:96004:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.40@tcp (ffff99ccd8431000): rc 0 00000020:00080000:1.0:1784047609.308481:0:96004:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff99cbcaee3800), last request at 1784047609 00000020:00000080:1.0:1784047609.308484:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c775b1e 00000100:00080000:1.0:1784047609.308488:0:96004:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee1800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1784047609.308587:0:15071:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ccd8431000: total 0 00010000:00010000:3.0:1784047609.308591:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047609.308650:0:15071:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ccd8431000, canceled 0 locks, left on hash table 20. 00002000:00010000:3.0:1784047609.308682:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308685:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308709:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abc29af/0x4426598c0c776868 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7d8 expref: 21 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308739:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308742:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308750:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000259199a2/0x4426598c0c776925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae817 expref: 20 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308768:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308771:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308779:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b23b2c/0x4426598c0c7769e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae856 expref: 19 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308795:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308798:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308806:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4dc9e6/0x4426598c0c7767e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7a7 expref: 18 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308822:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308831:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308841:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066057cc9/0x4426598c0c776a05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae864 expref: 17 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308857:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308860:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308867:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4f1366/0x4426598c0c7765f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae706 expref: 16 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308883:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308886:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308894:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edda9084/0x4426598c0c776829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7c3 expref: 15 pid: 26193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308908:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308911:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308918:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025fa1d3b/0x4426598c0c7768b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7f4 expref: 14 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308933:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308936:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308943:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962a7452/0x4426598c0c7766b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae745 expref: 13 pid: 26181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.308957:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.308959:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.308974:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e1e63ee/0x4426598c0c776734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae784 expref: 12 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309007:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309010:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309018:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034bb8fd7/0x4426598c0c7768ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ed expref: 11 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309035:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309037:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309044:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f3e8ddb/0x4426598c0c7766a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae73e expref: 10 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309060:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309063:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309070:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d122254d/0x4426598c0c77673b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae77d expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309086:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309089:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309095:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f498cedb/0x4426598c0c7769b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae84f expref: 8 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309111:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309114:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309121:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f19069/0x4426598c0c776582 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae6f1 expref: 7 pid: 13594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309147:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309149:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309158:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083d32881/0x4426598c0c7767ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae7ae expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309173:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309176:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309183:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0209d4/0x4426598c0c77699c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae82c expref: 5 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309197:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309199:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309206:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083aba387/0x4426598c0c776a0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae86b expref: 4 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309222:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309224:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309231:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2888778/0x4426598c0c776631 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae71b expref: 3 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784047609.309246:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1784047609.309249:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784047609.309256:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312cf760/0x4426598c0c7766ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae75a expref: 2 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047609.309283:0:15071:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ccd8431000, canceled 20 locks, left on hash table 0. 00000020:00080000:1.0:1784047609.310267:0:96004:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbcaee3800): rc 0 00000020:00000080:1.0:1784047609.310271:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cbcaee3800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1784047609.310286:0:96004:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff99ccc832b000), last request at 1784047608 00000020:00000080:1.0:1784047609.310292:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c76f972 00000100:00080000:1.0:1784047609.310316:0:96004:0:(import.c:65:import_set_state_nolock()) ffff99ccc832f000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784047609.310333:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784047609.310340:0:96004:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ccc832b000): rc 0 00000020:00000080:1.0:1784047609.310342:0:96004:0:(genops.c:906:class_export_put()) final put ffff99ccc832b000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1784047609.310368:0:96004:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff99cd00f00000) has no exports 00000020:00000080:3.0:1784047609.310894:0:15071:0:(genops.c:906:class_export_put()) final put ffff99ccd8431000/0c846d7a-6357-4e9c-a620-e35737ede709 00010000:00010000:3.0:1784047609.310901:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047609.310903:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047609.310905:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784047609.310915:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbcaee3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784047609.310956:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc832b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784047609.310980:0:81515:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccd8431000/0c846d7a-6357-4e9c-a620-e35737ede709 for lustre-OST0000 00000020:00000080:3.0:1784047609.311624:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbcaee1800 for lustre-OST0000 00000020:00000080:3.0:1784047609.311633:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc832f000 for lustre-OST0000 00000020:00000080:3.0:1784047609.311637:0:81515:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccd8434000 for lustre-OST0000 00010000:00010000:3.0:1784047609.312687:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784047609.313111:0:96004:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ccff3e00c0 - data ffff99cbc5c33bd0/ffff99cbc7867000 00000020:01000000:1.0:1784047609.313266:0:96004:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cd00c9d420 - data ffff99ccf314f870/ffff99cbc6529800 00100000:10000000:1.0:1784047609.331353:0:96004:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784047609.348031:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c72fa29 00000020:00000080:2.0:1784047609.348045:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cd00328000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784047609.348066:0:96004:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccfe6b8800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784047609.348070:0:96004:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccfe6b8800 2 00000020:01000004:2.0:1784047609.348073:0:96004:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ccfe6b8800 from lustre-OST0000 00000020:00000080:2.0:1784047609.348101:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784047609.348115:0:96004:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784047609.348118:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cbc1d52000/lustre-OST0000_UUID 00000020:00000080:2.0:1784047609.348121:0:96004:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc1d52000/lustre-OST0000_UUID for lustre-OST0000 00000020:00000080:3.0:1784047609.348124:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd00328000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1784047609.348128:0:96004:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784047609.348498:0:96004:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1784047609.348503:0:96004:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784047609.348507:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784047609.348515:0:96004:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784047609.348523:0:96004:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99cbc64c9800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784047609.348529:0:96004:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff99cd00f019c0) has exports, disconnecting them 00000020:00080000:2.0:1784047609.348534:0:96004:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99cbc64c9800), last request at 1784044099 00000020:00000080:2.0:1784047609.348538:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c72fa53 00000020:00080000:2.0:1784047609.348549:0:96004:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc64c9800): rc 0 00000020:00000080:2.0:1784047609.348555:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cbc64c9800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784047609.348672:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc64c9800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1784047609.365723:0:96004:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784047609.365732:0:96004:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784047609.365736:0:96004:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784047609.365744:0:96004:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784047609.365890:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784047609.365904:0:96004:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1784047609.365911:0:96004:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784047609.365919:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784047609.365924:0:96004:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784047609.365932:0:96004:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99cbc1d57800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784047609.365940:0:96004:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff99cd00f04d40) has exports, disconnecting them 00000020:00080000:3.0:1784047609.365944:0:96004:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99cbc1d57800), last request at 1784044099 00000020:00000080:3.0:1784047609.365962:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c72fa68 00000020:00080000:3.0:1784047609.365977:0:96004:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cbc1d57800): rc 0 00000020:00000080:3.0:1784047609.365982:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cbc1d57800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784047609.366309:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc64c8000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784047609.366316:0:52247:0:(genops.c:906:class_export_put()) final put ffff99cbc64cf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784047609.366319:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc64cf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784047609.366330:0:52247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784047609.366409:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc1d57800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1784047609.371345:0:96004:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784047609.371357:0:96004:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784047609.371366:0:96004:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784047609.371374:0:96004:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784047609.371410:0:52247:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cbc1d54800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784047609.371599:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784047609.371640:0:96004:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1784047609.371646:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cbc64c8800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1784047609.371651:0:96004:0:(genops.c:865:class_export_destroy()) destroying export ffff99cbc64c8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1784047609.371658:0:96004:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1784047609.371775:0:96004:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccfe6b8800 1 00000020:00000080:0.0:1784047609.371781:0:96004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4426598c0c72f9f1 00000020:00000080:0.0:1784047609.371788:0:96004:0:(genops.c:906:class_export_put()) final put ffff99cd0032f800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784047609.371795:0:96004:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784047609.371802:0:52247:0:(genops.c:865:class_export_destroy()) destroying export ffff99cd0032f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784047609.371810:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784047609.371815:0:96004:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784047609.371838:0:96004:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff99cd00d78000) has no exports 00000020:00000080:1.0:1784047609.479593:0:96004:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000100:00100000:3.0:1784047609.479868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047609.479912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047609.479939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047609.479964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047609.479991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047609.480020:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555584 00000100:00100000:3.0:1784047609.480031:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555584 00000100:00100000:3.0:1784047609.480072:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555712 00000100:00100000:3.0:1784047609.480075:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555712 00000100:00100000:3.0:1784047609.480120:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2695 00000100:00100000:3.0:1784047609.480132:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689555712:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047609.480204:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689555712:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047609.480211:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2695 00000100:00100000:3.0:1784047609.480231:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5076 00000100:00100000:3.0:1784047609.480235:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1870705689555584:12345-192.168.204.40@tcp:400:kworker.0 00000020:00080000:3.0:1784047609.480241:0:26183:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.40@tcp 00000100:00100000:3.0:1784047609.480268:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1870705689555584:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (304us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784047609.480275:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5076 00000100:00100000:2.0:1784047609.480545:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555200 00000100:00100000:2.0:1784047609.480564:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555200 00000100:00100000:2.0:1784047609.480705:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 181 00000100:00100000:2.0:1784047609.480714:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689555200:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047609.480759:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689555200:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047609.480767:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 181 00000100:00080000:2.0:1784047609.480932:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047609.480943:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555328 00000100:00100000:2.0:1784047609.480947:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555328 00000100:00100000:2.0:1784047609.480977:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555456 00000100:00100000:2.0:1784047609.480980:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555456 00000100:00100000:2.0:1784047609.481005:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1462 00000100:00100000:2.0:1784047609.481012:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+151:2399:x1870705689555328:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047609.481051:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+151:2399:x1870705689555328:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047609.481058:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1462 00000100:00100000:2.0:1784047609.481071:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1463 00000100:00100000:2.0:1784047609.481077:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689555456:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047609.481101:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689555456:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047609.481108:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1463 00000100:00080000:2.0:1784047609.481126:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784047609.481129:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1784047609.482641:0:96004:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784047609.482651:0:96004:0:(genops.c:906:class_export_put()) final put ffff99ccc48bb800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784047609.482657:0:96004:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc48bb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784047609.482669:0:96004:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784047609.483172:0:96004:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ccc48be000 00000020:02000400:1.0:1784047609.483237:0:96004:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:2.0:1784047609.494850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047609.495287:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555840 00000100:00100000:1.0:1784047609.495307:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555840 00000100:00100000:1.0:1784047609.495356:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5077 00000100:00100000:1.0:1784047609.495365:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2398:x1870705689555840:12345-192.168.204.40@tcp:8:ptlrpcd_00_00.0 00010000:00020000:1.0:1784047609.495389:0:26184:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784047609.495457:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2398:x1870705689555840:12345-192.168.204.40@tcp:8:ptlrpcd_00_00.0 Request processed in 91us (612us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784047609.495466:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5077 00010000:00010000:0.0:1784047610.130722:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047610.130898:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709423744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047610.130988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047610.131072:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423744 00000100:00100000:2.0:1784047610.131080:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423744 00000100:00100000:2.0:1784047610.131151:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1784047610.131161:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709423744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047610.131183:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047610.131228:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709423744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047610.131235:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00080000:2.0:1784047610.131257:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784047610.131315:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709423744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047610.131554:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709423872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784047610.131585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047610.131639:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709423872 00000100:00100000:0.0:1784047610.131644:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709423872 00000100:00100000:0.0:1784047610.131669:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1784047610.131673:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3646:x1870705709423872:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:0.0:1784047610.131679:0:12054:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784047610.131708:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3646:x1870705709423872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (122us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784047610.131715:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:02020000:0.0:1784047610.131742:0:3646:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784047610.131746:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047610.131751:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047610.131755:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1784047610.131765:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1784047610.131767:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047610.131780:0:3646:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2801 00000100:00080000:0.0:1784047610.131787:0:3646:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cbc7a6e000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047610.131810:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9ae8700 x1870705709424000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784047610.132070:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709424000:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1784047610.132126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047610.132266:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424000 00000100:00100000:0.0:1784047610.132271:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424000 00000100:00100000:0.0:1784047610.132309:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078 00000100:00100000:0.0:1784047610.132315:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3644:x1870705709424000:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:0.0:1784047610.132345:0:26192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047610.132398:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3644:x1870705709424000:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 81us (271us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047610.132405:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078 00000100:00080000:0.0:1784047610.132431:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784047610.132436:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784047610.132439:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709424000:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:0.0:1784047611.154772:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047612.178890:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784047612.696520:0:94368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051732 is committed 00010000:00010000:0.0:1784047612.696558:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.696574:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.696778:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.696787:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cee00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.696803:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.696813:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697028:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff99ccc37d2600) 00010000:00010000:0.0:1784047612.697031:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.697037:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697045:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cee00/0x4426598c0c77657b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697196:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697204:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697210:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697216:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.697218:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697224:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697245:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff99ccc37d2f00) 00010000:00010000:0.0:1784047612.697247:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.697251:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697257:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0031a00/0x4426598c0c7765ba lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697335:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697344:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697351:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697365:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.697369:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697375:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697386:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff99ccc37d2e00) 00010000:00010000:0.0:1784047612.697388:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.697392:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697397:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030600/0x4426598c0c7765f9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697414:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697421:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697427:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697433:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.697435:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697441:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697461:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff99ccc37d2000) 00010000:00010000:0.0:1784047612.697463:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.697466:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697472:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b400/0x4426598c0c776669 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697485:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697492:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697498:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697503:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.697506:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697512:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697521:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff99ccc37d2900) 00010000:00010000:0.0:1784047612.697524:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.697526:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697532:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a600/0x4426598c0c776685 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697557:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697564:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697569:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697575:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24a400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.697578:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697682:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.697775:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff99ccfebe4000) 00010000:00010000:0.0:1784047612.697779:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.697783:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.698051:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24a400/0x4426598c0c7766af lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.698069:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.698075:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.698081:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700193:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.700201:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700211:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700246:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff99ccc34a7d00) 00010000:00010000:0.0:1784047612.700249:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.700256:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700266:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf600/0x4426598c0c7766f5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700373:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700381:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700390:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700395:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce033b200 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.700398:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700406:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700431:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff99cbc9aa9200) 00010000:00010000:0.0:1784047612.700433:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.700437:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700442:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b200/0x4426598c0c77672d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700459:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700465:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700489:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700496:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc27da000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.700499:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700505:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700514:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff99cbc9aa9600) 00010000:00010000:0.0:1784047612.700517:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.700520:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.700526:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc27da000/0x4426598c0c7767a4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702332:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702343:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702352:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702360:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9cf000 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702365:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702384:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702403:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff99cbc9aa9b00) 00010000:00010000:0.0:1784047612.702406:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702411:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702418:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9cf000/0x4426598c0c7767ab lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702431:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702437:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702444:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702466:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef9ce800 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702469:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702475:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702484:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff99cbc9aa9d00) 00010000:00010000:0.0:1784047612.702487:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702490:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702496:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef9ce800/0x4426598c0c7767f1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702510:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702516:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702523:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702529:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c3600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702531:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702538:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702560:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff99cbc9aa9e00) 00010000:00010000:0.0:1784047612.702563:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702566:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702573:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c3600/0x4426598c0c776861 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702587:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702592:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702598:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702601:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce033aa00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702619:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702627:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702636:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff99cbc9aa9900) 00010000:00010000:0.0:1784047612.702639:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702643:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702649:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033aa00/0x4426598c0c77686f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702677:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702684:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702701:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702707:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cce033b400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702709:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702716:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702725:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff99cbc9aa9c00) 00010000:00010000:0.0:1784047612.702728:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702731:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702737:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cce033b400/0x4426598c0c7768a7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702753:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702759:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702764:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702776:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601e00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702779:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702785:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702806:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff99cbc9aa9300) 00010000:00010000:0.0:1784047612.702809:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702812:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702828:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601e00/0x4426598c0c7768ed lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702843:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702849:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702855:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702860:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccef5c2a00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.702862:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702868:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702886:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff99cbc9aa9400) 00010000:00010000:0.0:1784047612.702889:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.702892:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702898:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccef5c2a00/0x4426598c0c77692c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702923:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702991:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.702999:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703004:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24b600 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.703007:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703015:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703024:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff99cbc9aa9f00) 00010000:00010000:0.0:1784047612.703026:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.703030:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703036:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccec24b600/0x4426598c0c776964 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703064:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703071:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703077:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703082:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00601c00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.703096:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703104:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703113:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff99ccfebe4800) 00010000:00010000:0.0:1784047612.703116:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.703119:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703125:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00601c00/0x4426598c0c7769a3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703140:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703146:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703153:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703164:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600400 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.703168:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703174:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703185:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff99ccfebe4900) 00010000:00010000:0.0:1784047612.703188:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.703191:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703197:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd00600400/0x4426598c0c7769e9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703215:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703220:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703226:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703243:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccebdbde00 already unused, calling callback (ffffffffc1a764f0) 00010000:00010000:0.0:1784047612.703245:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703251:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703272:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff99cd02171e00) 00010000:00010000:0.0:1784047612.703274:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784047612.703278:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047612.703284:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccebdbde00/0x4426598c0c7769fe lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047613.203302:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784047613.715437:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047613.715445:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784047613.715450:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047613.715461:0:52247:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3708 00000100:00080000:0.0:1784047613.715468:0:52247:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784047613.715475:0:52247:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cbc7a6e000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1784047613.715503:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc9aea300 x1870705709424640/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047613.715581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709424128:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.715696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.715708:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709424384:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.715747:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709424768:0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.715758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047613.715782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.715801:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709425024:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.715809:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709425280:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.720056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.720571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.720673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709424512:0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.720734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.720789:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424128 00000100:00100000:2.0:1784047613.720799:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424128 00000100:00100000:0.0:1784047613.720835:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784047613.720848:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709424256:0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.720881:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784047613.720899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047613.720937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709424896:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.720962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047613.720981:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709425408:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.721002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047613.721038:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709424640:0@lo:8:kworker.0 00000100:00100000:0.0:1784047613.721064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047613.721099:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424768 00000100:00100000:0.0:1784047613.721104:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424768 00000100:00100000:2.0:1784047613.721164:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:3647:x1870705709424128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.721245:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:3647:x1870705709424128:12345-0@lo:400:kworker.0 Request processed in 85us (5550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.721254:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784047613.721295:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424384 00000100:00100000:2.0:1784047613.721300:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424384 00000100:00100000:2.0:1784047613.721342:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424256 00000100:00100000:2.0:1784047613.721353:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424256 00000100:00100000:2.0:1784047613.721370:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424896 00000100:00100000:2.0:1784047613.721373:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424896 00000100:00100000:2.0:1784047613.721382:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425408 00000100:00100000:2.0:1784047613.721384:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425408 00000100:00100000:2.0:1784047613.721395:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1784047613.721401:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709424384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.721442:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709424384:12345-0@lo:400:kworker.0 Request processed in 40us (5685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.721448:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1784047613.721461:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1784047613.721467:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709424256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.721514:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709424256:12345-0@lo:400:kworker.0 Request processed in 47us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.721522:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1784047613.721533:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425280 00000100:00100000:0.0:1784047613.721539:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425280 00000100:00100000:2.0:1784047613.721540:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1784047613.721551:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709424896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.721571:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424640 00000100:00100000:0.0:1784047613.721576:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424640 00000100:00100000:2.0:1784047613.721678:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709424896:12345-0@lo:400:kworker.0 Request processed in 36us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.721687:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1784047613.721705:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1784047613.721711:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709425408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.721745:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709425408:12345-0@lo:400:kworker.0 Request processed in 35us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.721751:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1784047613.721765:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1784047613.721776:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709424768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.721817:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709424768:12345-0@lo:400:kworker.0 Request processed in 44us (6035us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047613.721824:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1784047613.721838:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:0.0:1784047613.721844:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709425280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.721875:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709425280:12345-0@lo:400:kworker.0 Request processed in 32us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047613.721881:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:0.0:1784047613.721893:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079 00000100:00100000:0.0:1784047613.721896:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3644:x1870705709424640:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784047613.721919:0:26188:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047613.721966:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3644:x1870705709424640:12345-0@lo:8:kworker.0 Request processed in 68us (901us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047613.721982:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079 00000100:00100000:0.0:1784047613.722012:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709425152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.722048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.722070:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425152 00000100:00100000:2.0:1784047613.722076:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425152 00000100:00100000:0.0:1784047613.722077:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709425664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047613.722113:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5080 00000100:00100000:0.0:1784047613.722113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047613.722120:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1870705709425152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784047613.722126:0:8433:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784047613.722158:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1870705709425152:12345-0@lo:400:kworker.0 Request processed in 37us (110us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784047613.722165:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5080 00000100:00100000:2.0:1784047613.722184:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425024 00000100:00100000:2.0:1784047613.722188:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425024 00000100:00100000:2.0:1784047613.722229:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709424512 00000100:00100000:2.0:1784047613.722232:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709424512 00000100:00100000:2.0:1784047613.722253:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:2.0:1784047613.722260:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709425024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.722298:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709425024:12345-0@lo:400:kworker.0 Request processed in 39us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.722305:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:2.0:1784047613.722317:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1784047613.722323:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709424512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.722353:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709424512:12345-0@lo:400:kworker.0 Request processed in 30us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047613.722362:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1784047613.722376:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425664 00000100:00100000:2.0:1784047613.722379:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425664 00000100:00100000:2.0:1784047613.722395:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:2.0:1784047613.722400:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709425664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047613.722433:0:23872:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1784047613.722433:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709424512:0@lo:400:kworker.0 00000100:00080000:0.0:1784047613.722456:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784047613.722461:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784047613.722466:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1784047613.722478:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709425664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000004:00080000:0.0:1784047613.722486:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1784047613.722490:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784047613.722498:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00080000:0.0:1784047613.722499:0:3646:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3660 00000100:00080000:0.0:1784047613.722510:0:3646:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccf7599800 using connection 192.168.204.140@tcp/0@lo 00000100:00080000:2.0:1784047613.722530:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784047613.722537:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047613.722539:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784047613.722548:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce7ed7800 x1870705709425792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784047613.722569:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709425152:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.722775:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709425664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784047613.722802:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784047613.722812:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709425536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047613.722843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047613.722920:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425536 00000100:00100000:0.0:1784047613.722925:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425536 00000100:00100000:0.0:1784047613.722954:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1784047613.722962:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709425536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047613.722993:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:0.0:1784047613.723032:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870705709425536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047613.723040:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1784047613.723094:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709425536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047613.723257:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709425024:0@lo:400:kworker.0 00000100:00100000:2.0:1784047613.723285:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709424384:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.723501:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709424256:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.723515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709424896:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.723527:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709425408:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.723539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709424128:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.723552:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709424768:0@lo:400:kworker.0 00000100:00100000:0.0:1784047613.723564:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709425280:0@lo:400:kworker.0 00000100:00100000:3.0:1784047613.724019:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709425792:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:3.0:1784047613.724071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784047613.727137:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047613.727163:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047613.727170:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709424640:0@lo:8:kworker.0 00000100:00100000:0.0:1784047613.727689:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425792 00000100:00100000:0.0:1784047613.727761:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425792 00000100:00100000:0.0:1784047613.727825:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5081 00000100:00100000:0.0:1784047613.727836:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870705709425792:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:0.0:1784047613.727871:0:8431:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784047613.727972:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870705709425792:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 135us (3897us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047613.727980:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5081 00000100:00080000:3.0:1784047613.728016:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047613.728024:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784047613.728027:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709425792:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:3.0:1784047614.226952:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047614.226962:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709425920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047614.227033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047614.227122:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709425920 00000100:00100000:3.0:1784047614.227132:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709425920 00000100:00100000:3.0:1784047614.227193:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:3.0:1784047614.227214:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709425920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047614.227245:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784047614.234265:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709425920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7051us (7219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047614.234284:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00100000:0.0:1784047614.239512:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709425920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784047614.601290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047614.601439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047614.601490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047614.601518:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689555968 00000100:00100000:0.0:1784047614.601518:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556224 00000100:00100000:1.0:1784047614.601528:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689555968 00000100:00100000:0.0:1784047614.601528:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556224 00000100:00100000:1.0:1784047614.601575:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 183 00000100:00100000:0.0:1784047614.601575:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1468 00000100:00100000:1.0:1784047614.601585:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689555968:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047614.601585:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689556224:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047614.601784:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689555968:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 200us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047614.601792:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 183 00000100:00100000:3.0:1784047614.602286:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556352 00000100:00100000:3.0:1784047614.602292:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556352 00000100:00100000:3.0:1784047614.602338:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5082 00000100:00100000:3.0:1784047614.602344:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2398:x1870705689556352:12345-192.168.204.40@tcp:8:kworker.0 00010000:00020000:3.0:1784047614.602364:0:26189:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784047614.602526:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2398:x1870705689556352:12345-192.168.204.40@tcp:8:kworker.0 Request processed in 181us (1249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047614.602531:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5082 00000100:00080000:1.0:1784047614.603979:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784047614.604375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047614.604451:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556096 00000100:00100000:1.0:1784047614.604460:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556096 00000100:00100000:2.0:1784047614.604515:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047614.604530:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1469 00000100:00100000:1.0:1784047614.604541:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+51:2399:x1870705689556096:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047614.604636:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+51:2399:x1870705689556096:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047614.604645:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1469 00000100:00100000:0.0:1784047614.604706:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689556224:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 3121us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047614.604715:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1468 00000100:00100000:3.0:1784047614.604794:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556480 00000100:00100000:3.0:1784047614.604798:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556480 00000100:00100000:3.0:1784047614.604842:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2698 00000100:00100000:3.0:1784047614.604860:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689556480:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047614.604903:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689556480:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047614.604909:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2698 00000100:00080000:3.0:1784047614.604975:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784047614.604979:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047615.251034:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709426048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047615.251103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047615.251158:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426048 00000100:00100000:2.0:1784047615.251166:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426048 00000100:00100000:2.0:1784047615.251232:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1784047615.251242:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709426048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784047615.251266:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047615.251308:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709426048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047615.251315:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1784047615.251367:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709426048:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784047615.251527:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784047615.252631:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784047616.073007:0:96349:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:0.0:1784047616.274745:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047617.298877:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047618.323154:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1784047618.835191:0:75669:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1784047618.835233:0:75669:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000000504f47] to pc [ptlrpcd_00_00+0] req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047618.835306:0:94384:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1784047618.835323:0:94384:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000eaad79a3] to pc [ptlrpcd_00_01+1] req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835341:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835349:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047618.835360:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 6e36843b-2016-43fe-8842-da5818d68597->MGS req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835371:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000491a2af4] to pc [ptlrpcd_00_02+2] req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835397:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835404:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc753d000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1784047618.835411:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835421:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000078261565] to pc [ptlrpcd_00_03+3] req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835429:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835434:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc753a800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1784047618.835458:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835468:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008e2d20d9] to pc [ptlrpcd_00_00+0] req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835475:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835480:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1784047618.835486:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835495:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c5e2ceab] to pc [ptlrpcd_00_01+1] req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047618.835501:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047618.835504:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784047618.835507:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047618.835512:0:81515:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3711 00000100:00080000:3.0:1784047618.835516:0:81515:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1784047618.835518:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047618.835522:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047618.835525:0:81515:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f95d 00000020:00000040:3.0:1784047618.835529:0:81515:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccec31f000 refcount=4 00000100:00000040:3.0:1784047618.835532:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047618.835534:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047618.835537:0:81515:0:(genops.c:900:class_export_put()) PUTting export ffff99ccec31f000 : new refcount 3 00000100:00080000:3.0:1784047618.835539:0:81515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cbc7a6e000 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:3.0:1784047618.835551:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc7a6e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1784047618.835562:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835582:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ad2453a0] to pc [ptlrpcd_rcv+-1] req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835597:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835603:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1784047618.835653:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835663:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000021cd1922] to pc [ptlrpcd_00_02+2] req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835672:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835677:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbcaee6800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1784047618.835683:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835692:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000010149917] to pc [ptlrpcd_00_03+3] req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835700:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835705:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1784047618.835710:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835718:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000406910a9] to pc [ptlrpcd_00_00+0] req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047618.835804:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047618.835807:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784047618.835809:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047618.835819:0:81515:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3711 00000100:00080000:3.0:1784047618.835822:0:81515:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:3.0:1784047618.835824:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047618.835827:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047618.835830:0:81515:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b17 00000020:00000040:3.0:1784047618.835833:0:81515:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5c03000 refcount=4 00000100:00000040:3.0:1784047618.835835:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047618.835837:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047618.835839:0:81515:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5c03000 : new refcount 3 00000100:00080000:3.0:1784047618.835841:0:81515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccf7599800 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:3.0:1784047618.835847:0:81515:0:(genops.c:1231:class_import_get()) import ffff99ccf7599800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1784047618.835856:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835864:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005966d003] to pc [ptlrpcd_rcv+-1] req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835871:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835966:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1784047618.835976:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.835985:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c84a8b51] to pc [ptlrpcd_00_01+1] req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.835992:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047618.835998:0:81515:0:(genops.c:1231:class_import_get()) import ffff99ccc5e52000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1784047618.836004:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047618.836031:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000adab64f8] to pc [ptlrpcd_00_02+2] req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.836047:0:81515:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3722) 00000100:00000040:3.0:1784047618.836065:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047618.836076:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709426944:0@lo:8:kworker.0 00000100:00000040:3.0:1784047618.836104:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047638 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.836124:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047618.836166:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef51c700 x1870705709426944 msgsize 520 00000100:00100000:3.0:1784047618.836170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047618.836192:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047638 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.836205:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5608 usecs (6 jiffies) 00000100:00000040:3.0:1784047618.836213:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047618.836221:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709427456:0@lo:8:kworker.0 00000100:00000040:3.0:1784047618.836234:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047633 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.836241:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047618.836253:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef51f800 x1870705709427456 msgsize 520 00000100:00100000:3.0:1784047618.836257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047618.836268:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047633 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047618.836277:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7903 usecs (8 jiffies) 00000100:00000040:2.0:1784047618.836475:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.836497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709426432:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.836514:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.836522:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.836548:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd79c50 x1870705709426432 msgsize 224 00000100:00100000:2.0:1784047618.836552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047618.836553:0:3647:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047618.836574:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.836596:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.836690:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709427072:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.836704:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.836710:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.836739:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee3480 x1870705709427072 msgsize 224 00000100:00100000:2.0:1784047618.836742:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047618.836757:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.836766:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5677 usecs (6 jiffies) 00000100:00000040:2.0:1784047618.836771:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.836779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709427712:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.836792:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.836799:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.836821:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee2a00 x1870705709427712 msgsize 224 00000100:00100000:2.0:1784047618.836825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047618.836837:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.836845:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8085 usecs (9 jiffies) 00000100:00100000:2.0:1784047618.836854:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:2.0:1784047618.836859:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.836867:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709426560:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.837019:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837026:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.837041:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee1880 x1870705709426560 msgsize 224 00000100:00100000:2.0:1784047618.837045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047618.837061:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837071:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8156 usecs (9 jiffies) 00000100:00000040:2.0:1784047618.837077:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837084:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709427200:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.837098:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837104:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.837128:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee0000 x1870705709427200 msgsize 224 00000100:00100000:2.0:1784047618.837132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047618.837145:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837153:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 124896 usecs (125 jiffies) 00000100:00100000:2.0:1784047618.837187:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426944 00000100:00100000:2.0:1784047618.837195:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426944 00000020:00000040:2.0:1784047618.837198:0:26185:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f972 00000100:00100000:2.0:1784047618.837229:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427456 00000100:00100000:2.0:1784047618.837232:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427456 00000020:00000040:2.0:1784047618.837233:0:26185:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b1e 00000100:00100000:2.0:1784047618.837248:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427072 00000100:00100000:2.0:1784047618.837250:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427072 00000020:00000040:2.0:1784047618.837252:0:26185:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:2.0:1784047618.837255:0:26185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000020:00000040:2.0:1784047618.837267:0:26185:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:2.0:1784047618.837284:0:26185:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1784047618.837301:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00000040:2.0:1784047618.837306:0:26185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:2.0:1784047618.837311:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee3480 x1870705709427072/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837324:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709427072:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784047618.837344:0:26185:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709427072 00000100:00000040:2.0:1784047618.837353:0:26185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047618.837357:0:26185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.837373:0:26185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837390:0:26185:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047618.837394:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3480 x1870705709427072/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837402:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709427072:12345-0@lo:400:kworker.0 Request processed in 81us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047618.837409:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00000040:2.0:1784047618.837412:0:26185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000020:00000040:2.0:1784047618.837427:0:26185:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00100000:2.0:1784047618.837436:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5083 00000100:00000040:2.0:1784047618.837439:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef51c700 x1870705709426944/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837447:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3644:x1870705709426944:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784047618.837464:0:26185:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1784047618.837472:0:26185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047618.837475:0:26185:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047618.837478:0:26185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.837493:0:26185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047638 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837510:0:26185:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047618.837514:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef51c700 x1870705709426944/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047638 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837521:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3644:x1870705709426944:12345-0@lo:8:kworker.0 Request processed in 73us (1355us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047618.837527:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5083 00000100:00100000:2.0:1784047618.837541:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5084 00000100:00000040:2.0:1784047618.837545:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef51f800 x1870705709427456/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837551:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3644:x1870705709427456:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784047618.837561:0:26185:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1784047618.837568:0:26185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047618.837571:0:26185:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047618.837573:0:26185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.837587:0:26185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047633 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.837637:0:26185:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047618.837641:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef51f800 x1870705709427456/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047638 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.837649:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3644:x1870705709427456:12345-0@lo:8:kworker.0 Request processed in 97us (1394us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784047618.837655:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5084 00000100:00100000:2.0:1784047618.837685:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427712 00000100:00100000:2.0:1784047618.837688:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427712 00000020:00000040:2.0:1784047618.837690:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c60 00000020:00000040:2.0:1784047618.837693:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5e57800 refcount=5 00000100:00000040:2.0:1784047618.837703:0:67153:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1784047618.837719:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426560 00000100:00100000:3.0:1784047618.837823:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426432 00000100:00100000:3.0:1784047618.837828:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426432 00000020:00000040:3.0:1784047618.837829:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047618.837832:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=21 00000100:00000040:3.0:1784047618.837851:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:0.0:1784047618.837923:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.837934:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709426176:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1784047618.837950:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.837958:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.837976:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9ae8000 x1870705709426176 msgsize 224 00000100:00100000:0.0:1784047618.837980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047618.837993:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838003:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1623692 usecs (1624 jiffies) 00000100:00000040:0.0:1784047618.838009:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838018:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709426688:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.838036:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838043:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838053:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9aeb800 x1870705709426688 msgsize 224 00000100:00100000:0.0:1784047618.838057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047618.838066:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838076:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7732 usecs (8 jiffies) 00000100:00000040:0.0:1784047618.838081:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838089:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709427328:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.838099:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838105:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838125:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9aea680 x1870705709427328 msgsize 224 00000100:00100000:0.0:1784047618.838130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047618.838140:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838148:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5090 usecs (6 jiffies) 00000100:00100000:0.0:1784047618.838158:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00000040:0.0:1784047618.838163:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838171:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709426304:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1784047618.838180:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838186:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838195:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9aeb100 x1870705709426304 msgsize 224 00000100:00100000:0.0:1784047618.838203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047618.838214:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838222:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5090 usecs (6 jiffies) 00000100:00000040:0.0:1784047618.838227:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709426816:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.838244:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838251:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838259:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9aea300 x1870705709426816 msgsize 224 00000100:00100000:0.0:1784047618.838263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047618.838272:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838279:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1623692 usecs (1624 jiffies) 00000100:00000040:0.0:1784047618.838284:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709427584:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.838301:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838308:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838316:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9aead80 x1870705709427584 msgsize 224 00000100:00100000:0.0:1784047618.838320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047618.838330:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838338:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9635 usecs (10 jiffies) 00000100:00100000:0.0:1784047618.838361:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427200 00000100:00100000:0.0:1784047618.838369:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427200 00000020:00000040:0.0:1784047618.838371:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c59 00000020:00000040:0.0:1784047618.838373:0:68026:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897e000 refcount=5 00000100:00100000:0.0:1784047618.838390:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426688 00000100:00100000:0.0:1784047618.838392:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426688 00000020:00000040:0.0:1784047618.838394:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76fa05 00000020:00000040:0.0:1784047618.838396:0:68026:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc6ea1800 refcount=5 00000020:00000040:0.0:1784047618.838402:0:68026:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00100000:0.0:1784047618.838412:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00000040:0.0:1784047618.838414:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc5e57800 : new rpc_count 1 00000100:00000040:0.0:1784047618.838419:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee2a00 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838429:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709427712:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047618.838440:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709427712 00000100:00000040:0.0:1784047618.838446:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.838449:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838465:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838476:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.838480:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee2a00 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838488:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709427712:12345-0@lo:400:kworker.0 Request processed in 60us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.838494:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00000040:0.0:1784047618.838496:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc5e57800 : new rpc_count 0 00000020:00000040:0.0:1784047618.838502:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5e57800 : new refcount 4 00000100:00100000:0.0:1784047618.838508:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00000040:0.0:1784047618.838510:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897e000 : new rpc_count 1 00000100:00000040:0.0:1784047618.838514:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee0000 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838528:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709427200:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047618.838536:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709427200 00000100:00000040:0.0:1784047618.838541:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.838544:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838559:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838569:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.838573:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0000 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838580:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709427200:12345-0@lo:400:kworker.0 Request processed in 54us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.838586:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00000040:0.0:1784047618.838588:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897e000 : new rpc_count 0 00000020:00000040:0.0:1784047618.838595:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897e000 : new refcount 4 00000100:00100000:0.0:1784047618.838603:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00000040:0.0:1784047618.838629:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbc6ea1800 : new rpc_count 1 00000100:00000040:0.0:1784047618.838634:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9aeb800 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838644:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709426688:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047618.838652:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709426688 00000100:00000040:0.0:1784047618.838656:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.838659:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838673:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838689:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.838700:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aeb800 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838707:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709426688:12345-0@lo:400:kworker.0 Request processed in 65us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.838714:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00000040:0.0:1784047618.838716:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbc6ea1800 : new rpc_count 0 00000020:00000040:0.0:1784047618.838735:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc6ea1800 : new refcount 4 00000100:00100000:0.0:1784047618.838756:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427584 00000100:00100000:0.0:1784047618.838760:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427584 00000020:00000040:0.0:1784047618.838762:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:0.0:1784047618.838765:0:26192:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000100:00000040:0.0:1784047618.838776:0:26192:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1784047618.838796:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00000040:0.0:1784047618.838798:0:26192:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:0.0:1784047618.838803:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9aead80 x1870705709427584/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838812:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709427584:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047618.838821:0:26192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709427584 00000100:00000040:0.0:1784047618.838825:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.838829:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.838845:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.838858:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.838862:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aead80 x1870705709427584/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.838869:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709427584:12345-0@lo:400:kworker.0 Request processed in 59us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.838875:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00000040:0.0:1784047618.838883:0:26192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:0.0:1784047618.838890:0:26192:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00000100:00100000:0.0:1784047618.838913:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426176 00000100:00100000:0.0:1784047618.838917:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426176 00000020:00000040:0.0:1784047618.838919:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:0.0:1784047618.838922:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=7 00000100:00000040:0.0:1784047618.838932:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1784047618.838940:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427328 00000100:00100000:0.0:1784047618.838943:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427328 00000020:00000040:0.0:1784047618.838944:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:0.0:1784047618.838946:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=5 00000100:00100000:0.0:1784047618.838956:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426304 00000100:00100000:0.0:1784047618.838958:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426304 00000020:00000040:0.0:1784047618.838960:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:0.0:1784047618.838962:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=6 00000100:00100000:0.0:1784047618.838972:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709426816 00000100:00100000:0.0:1784047618.838974:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426816 00000020:00000040:0.0:1784047618.838976:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:0.0:1784047618.838978:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=8 00000100:00100000:0.0:1784047618.838992:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00000040:0.0:1784047618.838995:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:0.0:1784047618.838999:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9ae8000 x1870705709426176/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839009:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1870705709426176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047618.839034:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00010000:00000040:0.0:1784047618.839044:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709426176 00000100:00000040:0.0:1784047618.839049:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.839052:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.839070:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839081:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.839091:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9ae8000 x1870705709426176/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:749/0 lens 224/368 e 0 to 0 dl 1784047629 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839098:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1870705709426176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.839103:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00000040:0.0:1784047618.839106:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:0.0:1784047618.839121:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 7 00000100:00100000:0.0:1784047618.839131:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00000040:0.0:1784047618.839133:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00000100:00000040:0.0:1784047618.839137:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9aea680 x1870705709427328/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839147:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709427328:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047618.839156:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709427328 00000100:00000040:0.0:1784047618.839160:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.839164:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.839179:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839192:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.839196:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aea680 x1870705709427328/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839204:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870705709427328:12345-0@lo:400:kworker.0 Request processed in 59us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.839211:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00000040:0.0:1784047618.839213:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:0.0:1784047618.839218:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 5 00000100:00100000:0.0:1784047618.839226:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00000040:0.0:1784047618.839228:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00000100:00000040:0.0:1784047618.839241:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9aeb100 x1870705709426304/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839251:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709426304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047618.839267:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00010000:00000040:0.0:1784047618.839274:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709426304 00000100:00000040:0.0:1784047618.839279:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.839283:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.839300:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839311:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.839315:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aeb100 x1870705709426304/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:749/0 lens 224/368 e 0 to 0 dl 1784047629 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839322:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709426304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.839328:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00000040:0.0:1784047618.839329:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:0.0:1784047618.839334:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 4 00000100:00100000:0.0:1784047618.839343:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00000040:0.0:1784047618.839345:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:0.0:1784047618.839348:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9aea300 x1870705709426816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839356:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709426816:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047618.839365:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709426816 00000100:00000040:0.0:1784047618.839369:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047618.839372:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047618.839386:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839406:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047618.839411:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aea300 x1870705709426816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839419:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709426816:12345-0@lo:400:kworker.0 Request processed in 63us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047618.839425:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00000040:0.0:1784047618.839427:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:0.0:1784047618.839433:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 6 00000100:00000040:0.0:1784047618.839491:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784047618.839497:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784047618.839509:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352912 avail=317209 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023684 state=0: rc = 0 00000100:00000040:0.0:1784047618.839517:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839524:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709426304:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1784047618.839535:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00000040:0.0:1784047618.839539:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839546:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839553:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709426816:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.839563:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:0.0:1784047618.839567:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839579:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839586:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709427584:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.839597:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00000040:0.0:1784047618.839601:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784047618.839629:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352773 avail=317070 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023573 state=0: rc = 0 00000100:00000040:0.0:1784047618.839637:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839645:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709426176:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1784047618.839656:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784047618.839660:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839667:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839673:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709426688:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.839680:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784047618.839684:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047618.839691:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047618.839697:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709427328:0@lo:400:kworker.0 00000100:00000040:0.0:1784047618.839709:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060f100 x1870705709426304/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047618.839717:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1784047618.839730:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060d880 x1870705709426816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047618.839736:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784047618.839741:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060ed80 x1870705709427584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047618.839747:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047618.839752:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0380 x1870705709426176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047618.839758:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784047618.839766:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060e300 x1870705709426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047618.839772:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc753a800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1784047618.839777:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060d180 x1870705709427328/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047618.839783:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00100000:2.0:1784047618.840026:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709426560 00000020:00000040:2.0:1784047618.840030:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c52 00000020:00000040:2.0:1784047618.840034:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897d800 refcount=5 00000020:00000040:2.0:1784047618.840043:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00000040:2.0:1784047618.840055:0:67153:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1784047618.840084:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00000040:2.0:1784047618.840087:0:67153:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897d800 : new rpc_count 1 00000100:00000040:2.0:1784047618.840091:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee1880 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840103:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709426560:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1784047618.840123:0:67153:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709426560 00000100:00000040:2.0:1784047618.840129:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047618.840132:0:67153:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047618.840156:0:67153:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.840170:0:67153:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047618.840183:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee1880 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840190:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709426560:12345-0@lo:400:kworker.0 Request processed in 89us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047618.840196:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00000040:2.0:1784047618.840198:0:67153:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897d800 : new rpc_count 0 00000020:00000040:2.0:1784047618.840205:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897d800 : new refcount 4 00000100:00080000:2.0:1784047618.840230:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1784047618.840234:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00080000:2.0:1784047618.840237:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1784047618.840239:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00080000:2.0:1784047618.840242:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1784047618.840244:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:2.0:1784047618.840271:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047638 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047618.840281:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047618.840286:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1784047618.840289:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047638 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840296:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709426944:0@lo:8:kworker.0 00000100:00000040:2.0:1784047618.840309:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047633 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047618.840315:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784047618.840318:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1784047618.840322:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047633 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840327:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709427456:0@lo:8:kworker.0 00000100:00000040:2.0:1784047618.840339:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060c380 x1870705709426944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047638 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.840346:0:3644:0:(genops.c:1244:class_import_put()) import ffff99cbc7a6e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1784047618.840351:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060ca80 x1870705709427456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047633 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.840357:0:3644:0:(genops.c:1244:class_import_put()) import ffff99ccf7599800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1784047618.840392:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1784047618.840398:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.840406:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840412:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709426560:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.840423:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1784047618.840427:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.840434:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840440:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709427200:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.840452:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:2.0:1784047618.840457:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.840465:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840472:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709427072:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.840496:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1784047618.840501:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.840509:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.840516:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709427712:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.840520:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060ea00 x1870705709426560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.840529:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc753d000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1784047618.840541:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060ce00 x1870705709427200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.840548:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbcaee6800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1784047618.840552:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060e680 x1870705709427072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.840558:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784047618.840562:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce7ed7800 x1870705709427712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.840567:0:3647:0:(genops.c:1244:class_import_put()) import ffff99ccc5e52000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:1.0:1784047618.841292:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00000040:1.0:1784047618.841299:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:1.0:1784047618.841308:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd79c50 x1870705709426432/t0(0) o400->6e36843b-2016-43fe-8842-da5818d68597@0@lo:749/0 lens 224/0 e 0 to 0 dl 1784047629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047618.841324:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:3647:x1870705709426432:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047618.841340:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709426432 00000100:00000040:1.0:1784047618.841347:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047618.841352:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047618.841383:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047618.841418:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047618.841423:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd79c50 x1870705709426432/t0(0) o400->6e36843b-2016-43fe-8842-da5818d68597@0@lo:749/0 lens 224/224 e 0 to 0 dl 1784047629 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047618.841433:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:3647:x1870705709426432:12345-0@lo:400:kworker.0 Request processed in 113us (4882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047618.841441:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00000040:1.0:1784047618.841444:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047618.841458:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 20 00000100:00000040:2.0:1784047618.843008:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047618.843022:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047618.843029:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709426432:0@lo:400:kworker.0 00000100:00000040:2.0:1784047618.843035:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060fb80 x1870705709426432/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047618.843062:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000020:00000040:0.0:1784047619.347722:0:94388:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047619.347779:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bfa4956c] to pc [ptlrpcd_00_03+3] req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047619.347829:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047619.347858:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709427840:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784047619.347905:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047635 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047619.347930:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047619.347987:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060fb80 x1870705709427840 msgsize 224 00000100:00100000:0.0:1784047619.347992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047619.348027:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047635 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047619.348042:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9427 usecs (10 jiffies) 00000100:00100000:3.0:1784047619.348154:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427840 00000100:00100000:3.0:1784047619.348166:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427840 00000020:00000040:3.0:1784047619.348170:0:39444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:3.0:1784047619.348176:0:39444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000100:00000040:3.0:1784047619.348214:0:39444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1784047619.348260:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00000040:3.0:1784047619.348266:0:39444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:3.0:1784047619.348272:0:39444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060fb80 x1870705709427840/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:750/0 lens 224/0 e 0 to 0 dl 1784047630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047619.348287:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709427840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784047619.348339:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1784047619.348353:0:39444:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709427840 00000100:00000040:3.0:1784047619.348366:0:39444:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047619.348373:0:39444:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047619.348409:0:39444:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047635 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047619.348434:0:39444:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047619.348439:0:39444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060fb80 x1870705709427840/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:750/0 lens 224/368 e 0 to 0 dl 1784047630 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047619.348447:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709427840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047619.348455:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00000040:3.0:1784047619.348458:0:39444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:3.0:1784047619.348474:0:39444:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00010000:00010000:1.0:1784047619.349494:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1784047619.349937:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:0.0:1784047619.349954:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784047619.350021:0:3648:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1784047619.350025:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1784047619.350036:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047635 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047619.350044:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709427840:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784047619.350052:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc9aeb480 x1870705709427840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047635 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047619.350064:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047619.724961:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060e680 x1870705689556736 msgsize 224 00000100:00100000:0.0:1784047619.724979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047619.725026:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060ce00 x1870705689557120 msgsize 224 00000100:00100000:0.0:1784047619.725031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047619.725056:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556736 00000100:00000040:0.0:1784047619.725063:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd79050 x1870705689556608 msgsize 224 00000100:00100000:1.0:1784047619.725067:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556736 00000100:00100000:0.0:1784047619.725071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000020:00000040:1.0:1784047619.725073:0:66221:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775ad1 00000100:00000040:0.0:1784047619.725074:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000020:00000040:1.0:1784047619.725080:0:66221:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001c000 refcount=51 00000020:00000040:1.0:1784047619.725108:0:66221:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00000040:0.0:1784047619.725110:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060ea00 x1870705689556864 msgsize 224 00000100:00100000:0.0:1784047619.725117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:1.0:1784047619.725136:0:66221:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:0.0:1784047619.725160:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060ca80 x1870705689556992 msgsize 520 00000100:00100000:1.0:1784047619.725162:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556864 00000100:00100000:1.0:1784047619.725168:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556864 00000100:00100000:0.0:1784047619.725168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000020:00000040:1.0:1784047619.725172:0:66221:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c7750c1 00000020:00000040:1.0:1784047619.725176:0:66221:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff387000 refcount=11 00000020:00000040:1.0:1784047619.725185:0:66221:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00100000:0.0:1784047619.725196:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557120 00000100:00100000:0.0:1784047619.725201:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557120 00000020:00000040:0.0:1784047619.725204:0:26193:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775e66 00000020:00000040:0.0:1784047619.725207:0:26193:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd8435000 refcount=7 00000100:00100000:1.0:1784047619.725215:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1474 00000020:00000040:0.0:1784047619.725217:0:26193:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:1.0:1784047619.725221:0:66221:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001c000 : new rpc_count 1 00000100:00000040:1.0:1784047619.725230:0:66221:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060e680 x1870705689556736/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:750/0 lens 224/0 e 0 to 0 dl 1784047630 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047619.725231:0:26193:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1784047619.725248:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556992 00000100:00100000:0.0:1784047619.725251:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556992 00000100:00100000:1.0:1784047619.725255:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+51:2400:x1870705689556736:12345-192.168.204.40@tcp:400:kworker.0 00000020:00000040:0.0:1784047619.725256:0:26193:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775e5f 00000100:00100000:0.0:1784047619.725273:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2701 00000100:00000040:0.0:1784047619.725277:0:26193:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd8435000 : new rpc_count 1 00010000:00000040:1.0:1784047619.725283:0:66221:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051732, transno 0, xid 1870705689556736 00000100:00000040:0.0:1784047619.725283:0:26193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060ce00 x1870705689557120/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:750/0 lens 224/0 e 0 to 0 dl 1784047630 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047619.725297:0:66221:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00100000:0.0:1784047619.725301:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689557120:12345-192.168.204.40@tcp:400:kworker.0 00000100:00000040:1.0:1784047619.725315:0:66221:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00010000:00000040:0.0:1784047619.725316:0:26193:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689557120 00000100:00000040:0.0:1784047619.725323:0:26193:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047619.725328:0:26193:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047619.725352:0:26193:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00100000:2.0:1784047619.725407:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1475 00000100:00000040:2.0:1784047619.725410:0:67153:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff387000 : new rpc_count 1 00000100:00000040:2.0:1784047619.725415:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060ea00 x1870705689556864/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:750/0 lens 224/0 e 0 to 0 dl 1784047630 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047619.725428:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689556864:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:2.0:1784047619.725438:0:67153:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411472, transno 0, xid 1870705689556864 00000100:00000040:2.0:1784047619.725443:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047619.725447:0:67153:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047619.725475:0:26193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ce00 x1870705689557120/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:750/0 lens 224/224 e 0 to 0 dl 1784047630 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047619.725485:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689557120:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 188us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047619.725492:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2701 00000100:00000040:0.0:1784047619.725496:0:26193:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd8435000 : new rpc_count 0 00000020:00000040:0.0:1784047619.725506:0:26193:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd8435000 : new refcount 6 00000100:00100000:0.0:1784047619.725514:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5085 00000100:00000040:0.0:1784047619.725523:0:26193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060ca80 x1870705689556992/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047619.725532:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2398:x1870705689556992:12345-192.168.204.40@tcp:8:kworker.0 00010000:00020000:0.0:1784047619.725552:0:26193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1784047619.725562:0:26193:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047619.725565:0:26193:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047619.725568:0:26193:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047619.725881:0:66221:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047619.725889:0:66221:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060e680 x1870705689556736/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:750/0 lens 224/224 e 0 to 0 dl 1784047630 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047619.725898:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+51:2400:x1870705689556736:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 649us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047619.725904:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1474 00000100:00000040:1.0:1784047619.725907:0:66221:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001c000 : new rpc_count 0 00000020:00000040:1.0:1784047619.725915:0:66221:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001c000 : new refcount 50 00000100:00100000:1.0:1784047619.725935:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689556608 00000100:00100000:1.0:1784047619.725940:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689556608 00000020:00000040:1.0:1784047619.725942:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a45 00000020:00000040:1.0:1784047619.725945:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001a800 refcount=10 00000100:00000040:1.0:1784047619.725958:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:2.0:1784047619.725966:0:67153:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047619.725974:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ea00 x1870705689556864/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:750/0 lens 224/224 e 0 to 0 dl 1784047630 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047619.725983:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 185 00000100:00000040:1.0:1784047619.725989:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001a800 : new rpc_count 1 00000100:00100000:2.0:1784047619.725990:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689556864:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 560us (873us total) trans 0 rc 0/0 00000100:00000040:1.0:1784047619.725997:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd79050 x1870705689556608/t0(0) o400->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:750/0 lens 224/0 e 0 to 0 dl 1784047630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047619.726004:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1475 00000100:00000040:2.0:1784047619.726009:0:67153:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff387000 : new rpc_count 0 00000100:00100000:1.0:1784047619.726016:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689556608:12345-192.168.204.40@tcp:400:kworker.0 00000020:00000040:2.0:1784047619.726020:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff387000 : new refcount 10 00010000:00000040:1.0:1784047619.726027:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689556608 00000100:00000040:1.0:1784047619.726033:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047619.726039:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047619.726056:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047619.726061:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd79050 x1870705689556608/t0(0) o400->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:750/0 lens 224/224 e 0 to 0 dl 1784047630 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047619.726071:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689556608:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 58us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047619.726088:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 185 00000100:00000040:1.0:1784047619.726091:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001a800 : new rpc_count 0 00000020:00000040:1.0:1784047619.726113:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 9 00000100:00080000:1.0:1784047619.726141:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784047619.726145:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00080000:1.0:1784047619.726148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784047619.726150:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00080000:1.0:1784047619.726152:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1784047619.726153:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00000040:0.0:1784047619.726464:0:26193:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047619.726470:0:26193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ca80 x1870705689556992/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047619.726478:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2398:x1870705689556992:12345-192.168.204.40@tcp:8:kworker.0 Request processed in 946us (1317us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047619.726485:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5085 00010000:00010000:3.0:1784047620.371174:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1784047620.371964:0:75673:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1784047620.372015:0:75673:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ba430ac0] to pc [ptlrpcd_00_00+0] req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047620.372095:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1784047620.372114:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047620.372130:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709427968:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1784047620.372175:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047636 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047620.372185:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047620.372256:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2ea8380 x1870705709427968 msgsize 224 00000100:00100000:3.0:1784047620.372262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047620.372292:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047636 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047620.372311:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5678 usecs (6 jiffies) 00000100:00100000:3.0:1784047620.372342:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709427968 00000100:00100000:3.0:1784047620.372351:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709427968 00000020:00000040:3.0:1784047620.372354:0:12054:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:3.0:1784047620.372359:0:12054:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000020:00000040:3.0:1784047620.372376:0:12054:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:3.0:1784047620.372407:0:12054:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1784047620.372442:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00000040:3.0:1784047620.372448:0:12054:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:3.0:1784047620.372455:0:12054:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2ea8380 x1870705709427968/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:751/0 lens 224/0 e 0 to 0 dl 1784047631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047620.372471:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709427968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784047620.372504:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1784047620.372517:0:12054:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709427968 00000100:00000040:3.0:1784047620.372532:0:12054:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047620.372538:0:12054:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047620.372567:0:12054:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047636 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047620.372588:0:12054:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047620.372593:0:12054:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2ea8380 x1870705709427968/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:751/0 lens 224/368 e 0 to 0 dl 1784047631 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047620.372603:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709427968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047620.372641:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00000040:3.0:1784047620.372646:0:12054:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000020:00000040:3.0:1784047620.372662:0:12054:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00080000:3.0:1784047620.372679:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1784047620.372684:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:3.0:1784047620.374058:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:3.0:1784047620.374079:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784047620.374113:0:3646:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1784047620.374118:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:3.0:1784047620.374130:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047636 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047620.374138:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709427968:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1784047620.374150:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef51dc00 x1870705709427968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047636 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047620.374165:0:3646:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1784047621.396791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047622.421589:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784047623.449412:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784047623.954676:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.954692:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047623.954728:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 6e36843b-2016-43fe-8842-da5818d68597->MGS req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.954753:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000882dda1d] to pc [ptlrpcd_00_01+1] req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.954788:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.954795:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc753d000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1784047623.954805:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.954814:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ba430ac0] to pc [ptlrpcd_00_02+2] req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.954827:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.954833:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc753a800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1784047623.954842:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.954850:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000050d1743a] to pc [ptlrpcd_00_03+3] req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.954857:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.954862:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1784047623.954869:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.954877:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fa33086e] to pc [ptlrpcd_00_00+0] req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047623.954884:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047623.954887:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784047623.954890:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047623.954900:0:81515:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3717 00000100:00080000:3.0:1784047623.954916:0:81515:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:3.0:1784047623.954920:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047623.954923:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047623.954926:0:81515:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f95d 00000020:00000040:3.0:1784047623.954930:0:81515:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccec31f000 refcount=4 00000100:00000040:3.0:1784047623.954934:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047623.954936:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047623.954938:0:81515:0:(genops.c:900:class_export_put()) PUTting export ffff99ccec31f000 : new refcount 3 00000100:00080000:3.0:1784047623.954941:0:81515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cbc7a6e000 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:3.0:1784047623.954953:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc7a6e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1784047623.954965:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.954975:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f2075bb4] to pc [ptlrpcd_rcv+-1] req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.954991:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.954998:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1784047623.955006:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.955029:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3811c16] to pc [ptlrpcd_00_01+1] req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955037:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.955042:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbcaee6800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1784047623.955049:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.955058:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bf6ce4bc] to pc [ptlrpcd_00_02+2] req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955071:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.955076:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1784047623.955084:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.955093:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007a9835dc] to pc [ptlrpcd_00_03+3] req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047623.955100:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047623.955103:0:81515:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784047623.955105:0:81515:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784047623.955109:0:81515:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3717 00000100:00080000:3.0:1784047623.955111:0:81515:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1784047623.955114:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047623.955116:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047623.955118:0:81515:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b17 00000020:00000040:3.0:1784047623.955120:0:81515:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5c03000 refcount=4 00000100:00000040:3.0:1784047623.955123:0:81515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 50 to 0@lo 00000100:00000040:3.0:1784047623.955126:0:81515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000020:00000040:3.0:1784047623.955128:0:81515:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5c03000 : new refcount 3 00000100:00080000:3.0:1784047623.955130:0:81515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccf7599800 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:3.0:1784047623.955136:0:81515:0:(genops.c:1231:class_import_get()) import ffff99ccf7599800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1784047623.955144:0:81515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.955153:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bd9e77ec] to pc [ptlrpcd_rcv+-1] req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955160:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.955171:0:81515:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1784047623.955181:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.955195:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ef42889f] to pc [ptlrpcd_00_00+0] req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955202:0:81515:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1784047623.955207:0:81515:0:(genops.c:1231:class_import_get()) import ffff99ccc5e52000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1784047623.955213:0:81515:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047623.955222:0:81515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000079da5045] to pc [ptlrpcd_00_01+1] req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955232:0:81515:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3727) 00000100:00000040:3.0:1784047623.955251:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955262:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709428608:0@lo:8:kworker.0 00000100:00000040:3.0:1784047623.955303:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047648 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955312:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047623.955349:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cceca62680 x1870705709428608 msgsize 520 00000100:00100000:3.0:1784047623.955354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047623.955372:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047648 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955386:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5610 usecs (6 jiffies) 00000100:00000040:3.0:1784047623.955394:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955402:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709429120:0@lo:8:kworker.0 00000100:00000040:3.0:1784047623.955420:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047643 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955427:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047623.955439:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef517800 x1870705709429120 msgsize 520 00000100:00100000:3.0:1784047623.955443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047623.955456:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047643 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955465:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7808 usecs (8 jiffies) 00000100:00100000:3.0:1784047623.955492:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428608 00000100:00100000:3.0:1784047623.955499:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428608 00000020:00000040:3.0:1784047623.955501:0:8824:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f972 00000100:00100000:3.0:1784047623.955526:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429120 00000100:00100000:3.0:1784047623.955529:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429120 00000020:00000040:3.0:1784047623.955531:0:8824:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b1e 00000100:00100000:3.0:1784047623.955550:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5086 00000100:00000040:3.0:1784047623.955557:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cceca62680 x1870705709428608/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955566:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870705709428608:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784047623.955585:0:8824:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1784047623.955599:0:8824:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047623.955602:0:8824:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047623.955632:0:8824:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047623.955649:0:8824:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047648 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955667:0:8824:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047623.955672:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca62680 x1870705709428608/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047643 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955681:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870705709428608:12345-0@lo:8:kworker.0 Request processed in 114us (330us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047623.955694:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5086 00000100:00100000:3.0:1784047623.955711:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5087 00000100:00000040:3.0:1784047623.955715:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef517800 x1870705709429120/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955724:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870705709429120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784047623.955734:0:8824:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1784047623.955742:0:8824:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047623.955745:0:8824:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047623.955748:0:8824:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047623.955763:0:8824:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047643 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.955777:0:8824:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047623.955781:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef517800 x1870705709429120/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047643 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955788:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870705709429120:12345-0@lo:8:kworker.0 Request processed in 64us (348us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784047623.955794:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5087 00000100:00000040:3.0:1784047623.955828:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047648 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047623.955837:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047623.955841:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1784047623.955844:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047648 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955852:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709428608:0@lo:8:kworker.0 00000100:00000040:3.0:1784047623.955863:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047643 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047623.955876:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047623.955878:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1784047623.955882:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047643 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.955889:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709429120:0@lo:8:kworker.0 00000100:00000040:3.0:1784047623.955895:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccfdcf9880 x1870705709428608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047648 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047623.955906:0:3644:0:(genops.c:1244:class_import_put()) import ffff99cbc7a6e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784047623.955914:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cceca61f80 x1870705709429120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047643 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047623.955921:0:3644:0:(genops.c:1244:class_import_put()) import ffff99ccf7599800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784047623.956363:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.956374:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdcfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709428480:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.956393:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956400:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.956421:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7ed80 x1870705709428480 msgsize 224 00000100:00100000:1.0:1784047623.956425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047623.956451:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956461:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1613942 usecs (1614 jiffies) 00000100:00000040:1.0:1784047623.956467:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.956475:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709429248:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.956487:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956494:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.956513:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7f100 x1870705709429248 msgsize 224 00000100:00100000:1.0:1784047623.956518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047623.956533:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956543:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9167 usecs (10 jiffies) 00000100:00100000:1.0:1784047623.956553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00000040:1.0:1784047623.956559:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.956567:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709428096:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.956580:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956587:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.956602:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd79850 x1870705709428096 msgsize 224 00000100:00100000:1.0:1784047623.956630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047623.956632:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784047623.956646:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956669:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.956679:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709428736:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.956691:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956773:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.956788:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7e300 x1870705709428736 msgsize 224 00000100:00100000:1.0:1784047623.956792:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047623.956807:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956818:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5665 usecs (6 jiffies) 00000100:00000040:1.0:1784047623.956831:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.956840:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709429376:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.956854:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956861:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.956876:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7c380 x1870705709429376 msgsize 224 00000100:00100000:1.0:1784047623.956880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047623.956894:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.956904:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7875 usecs (8 jiffies) 00000100:00100000:1.0:1784047623.956942:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429248 00000100:00100000:1.0:1784047623.956947:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429248 00000020:00000040:1.0:1784047623.956949:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:1.0:1784047623.956952:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000020:00000040:1.0:1784047623.956966:0:26183:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:1.0:1784047623.956987:0:26183:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1784047623.957004:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428736 00000100:00100000:1.0:1784047623.957007:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428736 00000020:00000040:1.0:1784047623.957009:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:1.0:1784047623.957011:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000100:00100000:1.0:1784047623.957045:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00000040:1.0:1784047623.957049:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:1.0:1784047623.957054:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7f100 x1870705709429248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957065:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709429248:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047623.957083:0:26183:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709429248 00000100:00000040:1.0:1784047623.957091:0:26183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.957101:0:26183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.957120:0:26183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.957138:0:26183:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.957143:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7f100 x1870705709429248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957151:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709429248:12345-0@lo:400:kworker.0 Request processed in 87us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.957157:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00000040:1.0:1784047623.957159:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:1.0:1784047623.957168:0:26183:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00000100:00100000:1.0:1784047623.957177:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00000040:1.0:1784047623.957179:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:1.0:1784047623.957183:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7e300 x1870705709428736/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957193:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709428736:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047623.957204:0:26183:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709428736 00000100:00000040:1.0:1784047623.957209:0:26183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.957212:0:26183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.957227:0:26183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.957238:0:26183:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.957243:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7e300 x1870705709428736/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957250:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709428736:12345-0@lo:400:kworker.0 Request processed in 59us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.957256:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00000040:1.0:1784047623.957264:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000020:00000040:1.0:1784047623.957269:0:26183:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00100000:1.0:1784047623.957297:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428096 00000100:00100000:1.0:1784047623.957302:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428096 00000020:00000040:1.0:1784047623.957303:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:1.0:1784047623.957306:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=21 00000100:00000040:1.0:1784047623.957315:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784047623.957331:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:1.0:1784047623.957333:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:1.0:1784047623.957337:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd79850 x1870705709428096/t0(0) o400->6e36843b-2016-43fe-8842-da5818d68597@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957346:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:3645:x1870705709428096:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047623.957355:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709428096 00000100:00000040:1.0:1784047623.957360:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.957363:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.957380:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.957392:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.957396:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd79850 x1870705709428096/t0(0) o400->6e36843b-2016-43fe-8842-da5818d68597@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957403:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+21:3645:x1870705709428096:12345-0@lo:400:kworker.0 Request processed in 57us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.957409:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:1.0:1784047623.957412:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047623.957417:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 20 00000100:00100000:1.0:1784047623.957444:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429376 00000100:00100000:1.0:1784047623.957447:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429376 00000020:00000040:1.0:1784047623.957449:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c60 00000020:00000040:1.0:1784047623.957451:0:68026:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5e57800 refcount=5 00000100:00000040:1.0:1784047623.957466:0:68026:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784047623.957485:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00000040:1.0:1784047623.957487:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc5e57800 : new rpc_count 1 00000100:00000040:1.0:1784047623.957491:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7c380 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957500:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709429376:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047623.957510:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709429376 00000100:00000040:1.0:1784047623.957514:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.957518:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.957533:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.957546:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.957550:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7c380 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957557:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709429376:12345-0@lo:400:kworker.0 Request processed in 58us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.957563:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00000040:1.0:1784047623.957565:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc5e57800 : new rpc_count 0 00000020:00000040:1.0:1784047623.957571:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5e57800 : new refcount 4 00000100:00080000:1.0:1784047623.957583:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784047623.957587:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:1.0:1784047623.957640:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.957649:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957656:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709428096:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.957668:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:1.0:1784047623.957678:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.957686:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.957692:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccec86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709428736:0@lo:400:kworker.0 00000100:00100000:3.0:1784047623.958168:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428480 00000100:00100000:3.0:1784047623.958173:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428480 00000020:00000040:3.0:1784047623.958175:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:3.0:1784047623.958178:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=7 00000100:00000040:3.0:1784047623.958193:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1784047623.958213:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00000040:3.0:1784047623.958216:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:3.0:1784047623.958220:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7ed80 x1870705709428480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.958232:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709428480:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784047623.958245:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709428480 00000100:00000040:3.0:1784047623.958250:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047623.958254:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047623.958464:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.958495:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047623.958501:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7ed80 x1870705709428480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.958510:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709428480:12345-0@lo:400:kworker.0 Request processed in 280us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047623.958517:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00000040:3.0:1784047623.958520:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:3.0:1784047623.958527:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 6 00000100:00000040:0.0:1784047623.958922:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.958936:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709428224:0@lo:400:kworker.0 00000100:00000040:0.0:1784047623.958960:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.958967:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047623.958986:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060c380 x1870705709428224 msgsize 224 00000100:00100000:0.0:1784047623.958991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047623.959009:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959029:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8153 usecs (9 jiffies) 00000100:00000040:0.0:1784047623.959036:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959055:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709428864:0@lo:400:kworker.0 00000100:00000040:0.0:1784047623.959069:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959076:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047623.959090:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060d180 x1870705709428864 msgsize 224 00000100:00100000:0.0:1784047623.959093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047623.959107:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959116:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 124310 usecs (125 jiffies) 00000100:00100000:0.0:1784047623.959126:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:0.0:1784047623.959132:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959141:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709428352:0@lo:400:kworker.0 00000100:00000040:0.0:1784047623.959153:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959159:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047623.959171:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060e300 x1870705709428352 msgsize 224 00000100:00100000:0.0:1784047623.959175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047623.959188:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959197:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7728 usecs (8 jiffies) 00000100:00000040:0.0:1784047623.959202:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959210:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709428992:0@lo:400:kworker.0 00000100:00000040:0.0:1784047623.959222:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959238:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047623.959255:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060ed80 x1870705709428992 msgsize 224 00000100:00100000:0.0:1784047623.959258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047623.959271:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959293:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5083 usecs (6 jiffies) 00000100:00100000:0.0:1784047623.959322:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428992 00000100:00100000:0.0:1784047623.959326:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428992 00000020:00000040:0.0:1784047623.959329:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:0.0:1784047623.959332:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=5 00000100:00000040:0.0:1784047623.959345:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1784047623.959363:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00000040:0.0:1784047623.959365:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00000100:00000040:0.0:1784047623.959370:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060ed80 x1870705709428992/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959379:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709428992:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047623.959392:0:8442:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709428992 00000100:00000040:0.0:1784047623.959398:0:8442:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047623.959401:0:8442:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047623.959415:0:8442:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.959430:0:8442:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047623.959435:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060ed80 x1870705709428992/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959443:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709428992:12345-0@lo:400:kworker.0 Request processed in 64us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047623.959450:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00000040:0.0:1784047623.959458:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:0.0:1784047623.959466:0:8442:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 4 00000020:00000040:0.0:1784047623.959484:0:75669:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784047623.959507:0:75669:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c5e2ceab] to pc [ptlrpcd_00_02+2] req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047623.959528:0:94384:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1784047623.959537:0:94384:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000eaad79a3] to pc [ptlrpcd_00_03+3] req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959554:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428224 00000100:00100000:0.0:1784047623.959557:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428224 00000020:00000040:0.0:1784047623.959559:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c52 00000020:00000040:0.0:1784047623.959561:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897d800 refcount=5 00000020:00000040:0.0:1784047623.959571:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00000040:0.0:1784047623.959585:0:67153:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784047623.959600:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428864 00000100:00100000:0.0:1784047623.959623:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428864 00000020:00000040:0.0:1784047623.959626:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c59 00000020:00000040:0.0:1784047623.959629:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897e000 refcount=5 00000100:00100000:0.0:1784047623.959647:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709428352 00000100:00100000:0.0:1784047623.959650:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709428352 00000020:00000040:0.0:1784047623.959652:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76fa05 00000020:00000040:0.0:1784047623.959654:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc6ea1800 refcount=5 00000020:00000040:0.0:1784047623.959660:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00100000:0.0:1784047623.959671:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00000040:0.0:1784047623.959674:0:67153:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897d800 : new rpc_count 1 00000100:00000040:0.0:1784047623.959678:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060c380 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.959687:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709428224:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.959878:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1784047623.959886:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.959899:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.959908:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709429376:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.959922:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00000040:1.0:1784047623.959928:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.959936:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.959944:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdcfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709428480:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.959956:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:1.0:1784047623.959961:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.959969:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.959976:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709429248:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.959994:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2ea8700 x1870705709428096/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.960005:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000100:00000040:1.0:1784047623.960087:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccec86c380 x1870705709428736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.960096:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1784047623.960101:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cceca60a80 x1870705709429376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.960107:0:3645:0:(genops.c:1244:class_import_put()) import ffff99ccc5e52000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1784047623.960116:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccfdcfb480 x1870705709428480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.960121:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1784047623.960127:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cceca60e00 x1870705709429248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.960133:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00100000:1.0:1784047623.960716:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00000040:1.0:1784047623.960720:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897e000 : new rpc_count 1 00000100:00000040:1.0:1784047623.960727:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060d180 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.960739:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709428864:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047623.960802:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709428864 00000100:00000040:1.0:1784047623.960907:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.960911:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.960934:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.960945:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.960953:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060d180 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.960959:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709428864:12345-0@lo:400:kworker.0 Request processed in 223us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.960964:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00000040:1.0:1784047623.960965:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897e000 : new rpc_count 0 00000020:00000040:1.0:1784047623.960972:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897e000 : new refcount 4 00000100:00100000:1.0:1784047623.960983:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00000040:1.0:1784047623.960985:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbc6ea1800 : new rpc_count 1 00000100:00000040:1.0:1784047623.960988:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060e300 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.960996:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709428352:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047623.961003:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709428352 00000100:00000040:1.0:1784047623.961008:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.961012:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.961046:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961064:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.961069:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060e300 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961077:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709428352:12345-0@lo:400:kworker.0 Request processed in 82us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.961083:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00000040:1.0:1784047623.961086:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbc6ea1800 : new rpc_count 0 00000020:00000040:1.0:1784047623.961093:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc6ea1800 : new refcount 4 00000100:00000040:1.0:1784047623.961112:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961137:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709429504:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1784047623.961156:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961164:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:0.0:1784047623.961174:0:67153:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709428224 00000100:00000040:1.0:1784047623.961181:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7f800 x1870705709429504 msgsize 224 00000100:00100000:1.0:1784047623.961190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047623.961190:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047623.961198:0:67153:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.961214:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961224:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1609115 usecs (1610 jiffies) 00000100:00000040:0.0:1784047623.961224:0:67153:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961243:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784047623.961246:0:67153:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.961249:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047623.961255:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060c380 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:754/0 lens 224/224 e 0 to 0 dl 1784047634 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961259:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961277:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709428352:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.961289:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1784047623.961293:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961300:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961374:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709428992:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.961391:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1784047623.961396:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961415:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961421:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709428224:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.961435:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1784047623.961439:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961544:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961554:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709428864:0@lo:400:kworker.0 00000100:00000040:1.0:1784047623.961561:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccfdcfaa00 x1870705709428352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.961571:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc753a800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1784047623.961581:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cceca63100 x1870705709428992/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.961671:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1784047623.961679:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef51dc00 x1870705709428224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.961687:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc753d000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1784047623.961730:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cceca63b80 x1870705709428864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047639 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.961738:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbcaee6800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00100000:1.0:1784047623.961913:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1784047623.961921:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.961945:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709429632:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1784047623.961961:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.961967:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.961983:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7c700 x1870705709429632 msgsize 224 00000100:00100000:1.0:1784047623.961986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047623.962002:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.962011:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5186 usecs (6 jiffies) 00000100:00100000:3.0:1784047623.962516:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429504 00000100:00100000:3.0:1784047623.962525:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429504 00000020:00000040:3.0:1784047623.962527:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:3.0:1784047623.962532:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=7 00000100:00000040:3.0:1784047623.962551:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1784047623.962581:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429632 00000100:00100000:3.0:1784047623.962585:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429632 00000020:00000040:3.0:1784047623.962587:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:3.0:1784047623.962589:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=5 00000100:00100000:1.0:1784047623.962693:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00000040:1.0:1784047623.962697:0:83733:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:1.0:1784047623.962712:0:83733:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7f800 x1870705709429504/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.962725:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709429504:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047623.962787:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00000040:3.0:1784047623.962790:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00000100:00000040:3.0:1784047623.962795:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7c700 x1870705709429632/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:754/0 lens 224/0 e 0 to 0 dl 1784047634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000024:1.0:1784047623.962955:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00010000:00000040:1.0:1784047623.962968:0:83733:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709429504 00000100:00000040:1.0:1784047623.962976:0:83733:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047623.962981:0:83733:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047623.963005:0:83733:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047623.963105:0:83733:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047623.963110:0:83733:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7f800 x1870705709429504/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:754/0 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.963119:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709429504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 396us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047623.963138:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00000040:1.0:1784047623.963140:0:83733:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:1.0:1784047623.963151:0:83733:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 6 00000100:00000040:1.0:1784047623.963183:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00100000:0.0:1784047623.963187:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709428224:12345-0@lo:400:kworker.0 Request processed in 3496us (4196us total) trans 0 rc 0/0 00000100:00000040:1.0:1784047623.963192:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047623.963202:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00000040:0.0:1784047623.963207:0:67153:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897d800 : new rpc_count 0 00000004:00000040:1.0:1784047623.963209:0:3647:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352773 avail=317070 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023573 state=0: rc = 0 00000020:00000040:0.0:1784047623.963218:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897d800 : new refcount 4 00000100:00000040:1.0:1784047623.963222:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.963232:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709429504:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1784047623.963239:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060d880 x1870705709429504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.963249:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:3.0:1784047623.963301:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709429632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784047623.963322:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00010000:00000040:3.0:1784047623.963329:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709429632 00000100:00000040:3.0:1784047623.963334:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047623.963338:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047623.963356:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047623.963397:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047623.963402:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7c700 x1870705709429632/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:754/0 lens 224/368 e 0 to 0 dl 1784047634 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047623.963410:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709429632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047623.963416:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00000040:3.0:1784047623.963418:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:3.0:1784047623.963425:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 4 00000100:00000040:1.0:1784047623.963449:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1784047623.963456:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1784047623.963474:0:3647:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352912 avail=317209 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023684 state=0: rc = 0 00000100:00000040:1.0:1784047623.963480:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047623.963486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709429632:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1784047623.963491:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060f100 x1870705709429632/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047639 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047623.963500:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00080000:0.0:1784047623.964029:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1784047623.964034:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00080000:0.0:1784047623.964038:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784047623.964040:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000020:00000040:0.0:1784047624.466725:0:94388:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047624.466773:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000eaad79a3] to pc [ptlrpcd_00_00+0] req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047624.466876:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784047624.466919:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047624.466933:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709429760:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1784047624.466964:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047640 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047624.466973:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047624.467025:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef515180 x1870705709429760 msgsize 224 00000100:00100000:3.0:1784047624.467030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047624.467060:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047640 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047624.467075:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9047 usecs (10 jiffies) 00000100:00100000:0.0:1784047624.467387:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429760 00000100:00100000:0.0:1784047624.467394:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429760 00000020:00000040:0.0:1784047624.467397:0:39444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:0.0:1784047624.467401:0:39444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000100:00000040:0.0:1784047624.467424:0:39444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1784047624.467457:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00000040:0.0:1784047624.467462:0:39444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:0.0:1784047624.467468:0:39444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef515180 x1870705709429760/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1784047635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.467499:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709429760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047624.467528:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1784047624.467538:0:39444:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709429760 00000100:00000040:0.0:1784047624.467549:0:39444:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047624.467553:0:39444:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047624.467575:0:39444:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047624.467593:0:39444:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047624.467599:0:39444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515180 x1870705709429760/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 224/368 e 0 to 0 dl 1784047635 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.467637:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709429760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047624.467644:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00000040:0.0:1784047624.467648:0:39444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:0.0:1784047624.467658:0:39444:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00000100:00000040:3.0:1784047624.467752:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:3.0:1784047624.467759:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784047624.467769:0:3645:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:3.0:1784047624.467772:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:3.0:1784047624.467780:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047624.467795:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709429760:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1784047624.467803:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060f100 x1870705709429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047624.467813:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047624.841552:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd7a050 x1870705689557248 msgsize 224 00000100:00100000:0.0:1784047624.841569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047624.841571:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784047624.841629:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060d880 x1870705689557632 msgsize 520 00000100:00100000:0.0:1784047624.841635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047624.841663:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060f100 x1870705689557504 msgsize 224 00000100:00100000:0.0:1784047624.841668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047624.841687:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9aeb480 x1870705689557376 msgsize 224 00000100:00100000:0.0:1784047624.841692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047624.841759:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cce453a300 x1870705689557760 msgsize 224 00000100:00100000:0.0:1784047624.841765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047624.841807:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557632 00000100:00100000:0.0:1784047624.841815:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557632 00000020:00000040:0.0:1784047624.841819:0:13594:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775e5f 00000100:00100000:0.0:1784047624.841850:0:13594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557760 00000100:00100000:0.0:1784047624.841853:0:13594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557760 00000020:00000040:0.0:1784047624.841855:0:13594:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775e66 00000020:00000040:0.0:1784047624.841858:0:13594:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd8435000 refcount=7 00000020:00000040:0.0:1784047624.841870:0:13594:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:0.0:1784047624.841884:0:13594:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1784047624.841902:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2704 00000100:00000040:0.0:1784047624.841906:0:13594:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd8435000 : new rpc_count 1 00000100:00000040:0.0:1784047624.841914:0:13594:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cce453a300 x1870705689557760/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 224/0 e 0 to 0 dl 1784047635 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.841930:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689557760:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:0.0:1784047624.841951:0:13594:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689557760 00000100:00000040:0.0:1784047624.841961:0:13594:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.841968:0:13594:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842020:0:13594:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842026:0:13594:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce453a300 x1870705689557760/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 224/224 e 0 to 0 dl 1784047635 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842036:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce453a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689557760:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047624.842043:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2704 00000100:00000040:0.0:1784047624.842047:0:13594:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd8435000 : new rpc_count 0 00000020:00000040:0.0:1784047624.842057:0:13594:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd8435000 : new refcount 6 00000100:00100000:0.0:1784047624.842067:0:13594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5088 00000100:00000040:0.0:1784047624.842071:0:13594:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060d880 x1870705689557632/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842102:0:13594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1870705689557632:12345-192.168.204.40@tcp:8:kworker.0 00010000:00020000:0.0:1784047624.842126:0:13594:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.40@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1784047624.842141:0:13594:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842144:0:13594:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842148:0:13594:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00100000:3.0:1784047624.842380:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557248 00000100:00100000:3.0:1784047624.842386:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557248 00000020:00000040:3.0:1784047624.842388:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a45 00000020:00000040:3.0:1784047624.842391:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001a800 refcount=10 00000100:00000040:3.0:1784047624.842405:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047624.842426:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 187 00000100:00000040:3.0:1784047624.842429:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001a800 : new rpc_count 1 00000100:00000040:3.0:1784047624.842434:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd7a050 x1870705689557248/t0(0) o400->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:0/0 lens 224/0 e 0 to 0 dl 1784047635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047624.842445:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689557248:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:3.0:1784047624.842455:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689557248 00000100:00000040:3.0:1784047624.842460:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047624.842464:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047624.842480:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047624.842484:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd7a050 x1870705689557248/t0(0) o400->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:0/0 lens 224/224 e 0 to 0 dl 1784047635 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047624.842491:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689557248:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 48us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047624.842497:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 187 00000100:00000040:3.0:1784047624.842500:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001a800 : new rpc_count 0 00000020:00000040:3.0:1784047624.842508:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 9 00000100:00000040:0.0:1784047624.842566:0:13594:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842573:0:13594:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060d880 x1870705689557632/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047644 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842582:0:13594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1870705689557632:12345-192.168.204.40@tcp:8:kworker.0 Request processed in 481us (950us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784047624.842589:0:13594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5088 00000100:00100000:0.0:1784047624.842634:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557504 00000100:00100000:0.0:1784047624.842638:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557504 00000020:00000040:0.0:1784047624.842640:0:66220:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c7750c1 00000020:00000040:0.0:1784047624.842643:0:66220:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff387000 refcount=11 00000020:00000040:0.0:1784047624.842651:0:66220:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00000040:0.0:1784047624.842660:0:66220:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784047624.842679:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557376 00000100:00100000:0.0:1784047624.842682:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557376 00000020:00000040:0.0:1784047624.842684:0:66220:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775ad1 00000020:00000040:0.0:1784047624.842686:0:66220:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001c000 refcount=51 00000020:00000040:0.0:1784047624.842693:0:66220:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00100000:0.0:1784047624.842712:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1480 00000100:00000040:0.0:1784047624.842715:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff387000 : new rpc_count 1 00000100:00000040:0.0:1784047624.842719:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060f100 x1870705689557504/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 224/0 e 0 to 0 dl 1784047635 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842731:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689557504:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:0.0:1784047624.842749:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411472, transno 0, xid 1870705689557504 00000100:00000040:0.0:1784047624.842754:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842758:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842772:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842777:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060f100 x1870705689557504/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 224/224 e 0 to 0 dl 1784047635 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842786:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689557504:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 56us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047624.842793:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1480 00000100:00000040:0.0:1784047624.842795:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff387000 : new rpc_count 0 00000020:00000040:0.0:1784047624.842801:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff387000 : new refcount 10 00000100:00100000:0.0:1784047624.842810:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1481 00000100:00000040:0.0:1784047624.842812:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001c000 : new rpc_count 1 00000100:00000040:0.0:1784047624.842817:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9aeb480 x1870705689557376/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 224/0 e 0 to 0 dl 1784047635 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842827:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+51:2399:x1870705689557376:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:0.0:1784047624.842837:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051732, transno 0, xid 1870705689557376 00000100:00000040:0.0:1784047624.842842:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842846:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842858:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047624.842863:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9aeb480 x1870705689557376/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 224/224 e 0 to 0 dl 1784047635 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047624.842872:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c846d7a-6357-4e9c-a620-e35737ede709+51:2399:x1870705689557376:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 46us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047624.842879:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1481 00000100:00000040:0.0:1784047624.842887:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001c000 : new rpc_count 0 00000020:00000040:0.0:1784047624.842893:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001c000 : new refcount 50 00000100:00080000:0.0:1784047624.842917:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784047624.842921:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 14 - evictor 00000100:00080000:0.0:1784047624.842924:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1784047624.842926:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00080000:0.0:1784047624.842929:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784047624.842930:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000020:00000040:1.0:1784047625.491855:0:75673:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1784047625.491895:0:75673:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006eedf27b] to pc [ptlrpcd_00_01+1] req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047625.491919:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047625.491935:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709429888:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1784047625.491967:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047641 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047625.491976:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047625.492037:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99ccff57e450 x1870705709429888 msgsize 224 00000100:00100000:3.0:1784047625.492043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047625.492046:0:3646:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047625.492074:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047641 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047625.492090:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5657 usecs (6 jiffies) 00010000:00010000:3.0:1784047625.492137:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784047625.493511:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709429888 00000100:00100000:1.0:1784047625.493523:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709429888 00000020:00000040:1.0:1784047625.493527:0:12054:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:1.0:1784047625.493531:0:12054:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000020:00000040:1.0:1784047625.493558:0:12054:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:1.0:1784047625.493590:0:12054:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1784047625.493633:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00000040:1.0:1784047625.493638:0:12054:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:1.0:1784047625.493645:0:12054:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccff57e450 x1870705709429888/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:1/0 lens 224/0 e 0 to 0 dl 1784047636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047625.493661:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccff57e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709429888:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784047625.493661:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784047625.493666:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00002000:00000024:1.0:1784047625.493689:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1784047625.493698:0:12054:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709429888 00000100:00000040:1.0:1784047625.493710:0:12054:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047625.493715:0:12054:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047625.493765:0:12054:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047641 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047625.493797:0:12054:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047625.493803:0:12054:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccff57e450 x1870705709429888/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:1/0 lens 224/368 e 0 to 0 dl 1784047636 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047625.493812:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccff57e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709429888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047625.493819:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00000040:1.0:1784047625.493822:0:12054:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000020:00000040:1.0:1784047625.493834:0:12054:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00000040:0.0:1784047625.493843:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:0.0:1784047625.493850:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784047625.493860:0:3646:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1784047625.493863:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1784047625.493870:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047641 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047625.493877:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709429888:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1784047625.493886:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd0c7e680 x1870705709429888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047641 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047625.493896:0:3646:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000020:01000004:0.0:1784047625.763313:0:96944:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784047625.763317:0:96944:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784047625.763319:0:96944:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784047625.763553:0:96944:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cbc64c8800 00000020:01000004:0.0:1784047625.763570:0:96944:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784047625.763586:0:96944:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784047625.763740:0:96944:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99ccc5e499c0) 00000020:00000040:0.0:1784047625.763820:0:96944:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cbc64c8000 with handle 0x4426598c0c776a13 to hash 00000020:00000040:0.0:1784047625.763834:0:96944:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc64c8000 : new refcount 1 00000020:00000040:0.0:1784047625.763843:0:96944:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99ccc5e499c0) now 2 - obd_device_list 00000020:00000080:0.0:1784047625.763848:0:96944:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:3.0:1784047626.335128:0:96944:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:3.0:1784047626.341358:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784047626.341469:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784047626.341493:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784047626.341516:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1784047626.341542:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784047626.341570:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784047626.341594:0:96944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1784047626.343128:0:96944:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:3.0:1784047626.343412:0:96944:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99ccc5e499c0) now 3 - setup 00000020:00000080:3.0:1784047626.343419:0:96944:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784047626.343431:0:96944:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:3.0:1784047626.343437:0:96944:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cbcd4b1800 with handle 0x4426598c0c776a1a to hash 00000020:00000040:3.0:1784047626.343444:0:96944:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99ccc5e499c0) now 4 - export 00000020:00000040:3.0:1784047626.343448:0:96944:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcd4b1800 : new refcount 1 00000020:00000080:3.0:1784047626.343461:0:96944:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4426598c0c776a1a 00000020:00000040:3.0:1784047626.343464:0:96944:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a1a 00000020:00000040:3.0:1784047626.343466:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcd4b1800 refcount=2 00000020:01000004:3.0:1784047626.343472:0:96944:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784047626.343499:0:96944:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784047626.343502:0:96944:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784047626.343508:0:96944:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784047626.343536:0:96944:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1784047626.343540:0:96944:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:3.0:1784047626.344520:0:96944:0:(genops.c:889:class_export_get()) GET export ffff99cbc64c8000 refcount=2 00000040:00000040:3.0:1784047626.344526:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 00000040:00000040:2.0:1784047626.346272:0:96944:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99cbc79ef600 : new refcount 1 00000040:01000000:2.0:1784047626.346279:0:96944:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 10000000:00000040:2.0:1784047626.346282:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 10000000:00000040:2.0:1784047626.346284:0:96944:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99cbc79ef600 : new refcount 1 00000020:00000040:2.0:1784047626.346287:0:96944:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.140@tcp (ffff99ccc5e4b380) now 6 - mgc_fs 00000020:01000004:2.0:1784047626.346319:0:96944:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784047626.346323:0:96944:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784047626.346329:0:96944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047626.346330:0:96944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047626.346332:0:96944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047626.346333:0:96944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047626.346334:0:96944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047626.346335:0:96944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047626.346337:0:96944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047626.346338:0:96944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784047626.346341:0:96944:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784047626.346343:0:96944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784047626.346344:0:96944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047626.346345:0:96944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047626.346345:0:96944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047626.346346:0:96944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047626.346347:0:96944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047626.346348:0:96944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047626.346349:0:96944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047626.346350:0:96944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:2.0:1784047626.346356:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 10000000:01000000:2.0:1784047626.346376:0:96944:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1784047626.346393:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.346405:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430016:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1784047626.346432:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.346441:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.346490:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd7bc50 x1870705709430016 msgsize 4848 00000100:00100000:2.0:1784047626.346495:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.346496:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.346582:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.346638:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784047626.346780:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430016 00000100:00100000:1.0:1784047626.346787:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430016 00000020:00000040:1.0:1784047626.346790:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:1.0:1784047626.346795:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=21 00000100:00000040:1.0:1784047626.346818:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784047626.346946:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1784047626.346952:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:1.0:1784047626.346958:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd7bc50 x1870705709430016/t0(0) o253->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 4848/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.346981:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:96944:x1870705709430016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784047626.347013:0:94374:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784047626.347017:0:94374:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1784047626.347021:0:94374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1784047626.347314:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430016 00000100:00000040:1.0:1784047626.347326:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047626.347332:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.347357:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.347386:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047626.347391:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd7bc50 x1870705709430016/t0(0) o253->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 4848/4768 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.347401:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+21:96944:x1870705709430016:12345-0@lo:253:mount.lustre.0 Request processed in 432us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.347408:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1784047626.347411:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047626.347420:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 20 00000100:00000040:2.0:1784047626.347499:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.347522:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.347529:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430016:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1784047626.347536:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784047626.347545:0:96944:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784047626.347547:0:96944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784047626.347549:0:96944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047626.347550:0:96944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047626.347551:0:96944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047626.347552:0:96944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047626.347553:0:96944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047626.347554:0:96944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047626.347555:0:96944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047626.347556:0:96944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:2.0:1784047626.347559:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0700 x1870705709430016/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.347570:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000020:01000004:2.0:1784047626.347585:0:96944:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cbc64c8800 from lustre-OST0000 10000000:01000000:2.0:1784047626.347632:0:96944:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784047626.347635:0:96944:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:2.0:1784047626.347645:0:96944:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff99cce490ca00) refs 5 10000000:01000000:2.0:1784047626.347648:0:96944:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ccc5e4b380 local copy 00000020:00000040:2.0:1784047626.347653:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebd6d200 refcount=2 00010000:00010000:2.0:1784047626.347661:0:96944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1784047626.347686:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccc834ca80 : new refcount 2 10000000:00000040:2.0:1784047626.347688:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 10000000:00000040:2.0:1784047626.347690:0:96944:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.140@tcp: copy local log lustre-sptlrpc 00000020:00000040:2.0:1784047626.347728:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.347732:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.347751:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.347761:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430144:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784047626.347775:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.347780:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.347797:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd78450 x1870705709430144 msgsize 512 00000100:00100000:2.0:1784047626.347800:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.347802:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.348296:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.348316:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047626.348382:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430144 00000100:00100000:3.0:1784047626.348389:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430144 00000020:00000040:3.0:1784047626.348392:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047626.348396:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=21 00000100:00000040:3.0:1784047626.348415:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047626.348430:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:3.0:1784047626.348434:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047626.348439:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd78450 x1870705709430144/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 512/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.348451:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:96944:x1870705709430144:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1784047626.348467:0:94375:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:3.0:1784047626.348470:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:3.0:1784047626.348496:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:3.0:1784047626.348500:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430144 00000100:00000040:3.0:1784047626.348508:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047626.348513:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.348535:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.348562:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047626.348577:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd78450 x1870705709430144/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 512/272 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.348585:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:96944:x1870705709430144:12345-0@lo:501:mount.lustre.0 Request processed in 136us (787us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784047626.348593:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:3.0:1784047626.348595:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:3.0:1784047626.348769:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 20 00000100:00000040:2.0:1784047626.349029:0:96944:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.349038:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.349047:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.349053:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430144:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784047626.349060:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.349069:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.349073:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0700 x1870705709430144/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.349094:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:01000000:2.0:1784047626.349102:0:96944:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784047626.349125:0:96944:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:2.0:1784047626.349130:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebd6d200 refcount=3 00010000:00010000:2.0:1784047626.349137:0:96944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.349146:0:96944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784047626.349191:0:96944:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cbc64c8800 10000000:01000000:2.0:1784047626.349196:0:96944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:2.0:1784047626.349201:0:96944:0:(genops.c:889:class_export_get()) GET export ffff99cce74a3000 refcount=18 10000000:00000040:2.0:1784047626.349205:0:96944:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff99cce4908200) refs 4 10000000:01000000:2.0:1784047626.349207:0:96944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784047626.349210:0:96944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1784047626.349212:0:96944:0:(genops.c:889:class_export_get()) GET export ffff99cce74a3000 refcount=19 10000000:01000000:2.0:1784047626.349216:0:96944:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1784047626.349218:0:96944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:2.0:1784047626.349222:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00010000:00000040:2.0:1784047626.349239:0:96944:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7100 count: 8 00000020:00000040:2.0:1784047626.349246:0:96944:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccebdbd000 with handle 0x4426598c0c776a21 to hash 00010000:00010000:2.0:1784047626.349253:0:96944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.349260:0:96944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.349269:0:96944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784047626.349291:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.349302:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430272:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1784047626.349316:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.349323:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.349344:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd7b450 x1870705709430272 msgsize 328 00000100:00100000:2.0:1784047626.349348:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.349351:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.349375:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.349393:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd0780 going to sleep for 11 seconds 00000100:00100000:3.0:1784047626.349498:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430272 00000100:00100000:3.0:1784047626.349503:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430272 00000020:00000040:3.0:1784047626.349505:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047626.349508:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=21 00000100:00000040:3.0:1784047626.349521:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047626.349535:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:3.0:1784047626.349538:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047626.349542:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd7b450 x1870705709430272/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.349553:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+21:96944:x1870705709430272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784047626.349562:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1784047626.349570:0:94375:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccfebe4c00 count: 10 00000020:00000040:3.0:1784047626.349576:0:94375:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccec24b200 with handle 0x4426598c0c776a28 to hash 00010000:00010000:3.0:1784047626.349579:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b200/0x4426598c0c776a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776a21 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349586:0:94375:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99ccc832d800 : new locks_count 16 00000020:00000040:3.0:1784047626.349587:0:94375:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=22 00010000:00000040:3.0:1784047626.349601:0:94375:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99ccfebe4c00) refcount = 10 00010000:00000040:3.0:1784047626.349638:0:94375:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784047626.349645:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cbc67b5e00/0x4426598c0c776042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae569 expref: 9 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349660:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cbc67b4800/0x4426598c0c77603b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae562 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349667:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c776034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77602d expref: 22 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349674:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cceff29c00/0x4426598c0c77600a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776003 expref: 22 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349679:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775ff5 expref: 22 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349685:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebd6c800/0x4426598c0c775fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fe7 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349691:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebd6ca00/0x4426598c0c775fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fd9 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349697:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebd6c000/0x4426598c0c775fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fcb expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.349703:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cceff28800/0x4426598c0c775fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fbd expref: 22 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.349708:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b200/0x4426598c0c776a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776a21 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.349719:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b200/0x4426598c0c776a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a21 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.349728:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b200, rc 0) 00010000:00000040:3.0:1784047626.349731:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430272 00000100:00000040:3.0:1784047626.349744:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047626.349749:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.349768:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.349787:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047626.349792:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd7b450 x1870705709430272/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/344 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.349801:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430272:12345-0@lo:101:mount.lustre.0 Request processed in 250us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047626.349807:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:3.0:1784047626.349810:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:3.0:1784047626.349818:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 21 00000100:00000040:2.0:1784047626.349985:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.349995:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.350002:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430272:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1784047626.350009:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.350020:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebdbd000 refcount=4 00010000:00000040:2.0:1784047626.350024:0:96944:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99ccebdbd000, remote cookie: 0x4426598c0c776a28, flags: 0x0 00010000:00000040:2.0:1784047626.350030:0:96944:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99ccc34a7100) refcount = 8 00010000:00000040:2.0:1784047626.350032:0:96944:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784047626.350034:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.350050:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77600a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.350056:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775ffc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.350063:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.350069:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.350076:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fd2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.350082:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fc4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.350088:0:96944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a28 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.350098:0:96944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776a28 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784047626.350108:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0700 x1870705709430272/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.350116:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:00000040:2.0:1784047626.350122:0:96944:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff99ccebd29400) refs 2 00000020:00000040:2.0:1784047626.350125:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebdbd000 refcount=3 10000000:00000040:2.0:1784047626.350147:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccc834ca80 : new refcount 2 10000000:00000040:2.0:1784047626.350155:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 10000000:00000040:2.0:1784047626.350158:0:96944:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.140@tcp: copy local log lustre-OST0000 00000040:00080000:2.0:1784047626.350376:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784047626.351086:0:96944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784047626.352690:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784047626.352738:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784047626.352758:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784047626.352773:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784047626.352785:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784047626.352796:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784047626.352818:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784047626.352824:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:2.0:1784047626.353120:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.353128:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.353166:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.353240:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430400:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784047626.353266:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.353275:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.353318:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99ccefd7b050 x1870705709430400 msgsize 512 00000100:00100000:2.0:1784047626.353322:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.353325:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.353397:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.353426:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047626.355477:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430400 00000100:00100000:3.0:1784047626.355491:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430400 00000020:00000040:3.0:1784047626.355495:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047626.355502:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=22 00000100:00000040:3.0:1784047626.355535:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047626.355779:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:3.0:1784047626.355785:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047626.355793:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccefd7b050 x1870705709430400/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 512/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.355816:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccefd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430400:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1784047626.356029:0:94375:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:3.0:1784047626.356035:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:3.0:1784047626.356169:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00000020:00000040:3.0:1784047626.356181:0:94375:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=23 00000020:00000040:3.0:1784047626.356185:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00010000:00000040:3.0:1784047626.356191:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430400 00000100:00000040:3.0:1784047626.356203:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:3.0:1784047626.356226:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.356275:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.356305:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:3.0:1784047626.356313:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccefd7b050 x1870705709430400/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 512/272 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.356323:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccefd7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430400:12345-0@lo:501:mount.lustre.0 Request processed in 511us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047626.356332:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:3.0:1784047626.356336:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:3.0:1784047626.356349:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 21 00000100:00000040:2.0:1784047626.357377:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.357392:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.357411:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430400:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784047626.357422:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.357434:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.357439:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0700 x1870705709430400/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.357450:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.357462:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.357467:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.357490:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.357503:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430528:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784047626.357540:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.357549:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.357574:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cd000c5450 x1870705709430528 msgsize 272 00000100:00100000:2.0:1784047626.357578:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.357581:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.357621:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.357648:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cd00cd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047626.357835:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430528 00000100:00100000:0.0:1784047626.357842:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430528 00000020:00000040:0.0:1784047626.357844:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:0.0:1784047626.357849:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=22 00000100:00000040:0.0:1784047626.357869:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784047626.357901:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1784047626.357904:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:0.0:1784047626.357910:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd000c5450 x1870705709430528/t0(0) o503->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.357922:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430528:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1784047626.357948:0:94372:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:0.0:1784047626.358010:0:94372:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:0.0:1784047626.358014:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430528 00000100:00000040:0.0:1784047626.358022:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047626.358026:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.358047:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.358065:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047626.358070:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd000c5450 x1870705709430528/t0(0) o503->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8416 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.358079:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd000c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430528:12345-0@lo:503:mount.lustre.0 Request processed in 158us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.358086:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1784047626.358089:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.358098:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 21 00000100:00000040:2.0:1784047626.358339:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.358348:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.358367:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430528:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784047626.358374:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.358386:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0700 x1870705709430528/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.358400:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.358406:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:2.0:1784047626.358852:0:96944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1784047626.358907:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.358911:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.358932:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.358944:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430656:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.358982:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.358990:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.359015:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaacb050 x1870705709430656 msgsize 272 00000100:00100000:2.0:1784047626.359019:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.359021:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.359034:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.359045:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047626.359196:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430656 00000100:00100000:3.0:1784047626.359202:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430656 00000020:00000040:3.0:1784047626.359204:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047626.359208:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=22 00000100:00000040:3.0:1784047626.359223:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047626.359250:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1784047626.359254:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047626.359259:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaacb050 x1870705709430656/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.359271:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430656:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784047626.359292:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:2.0:1784047626.359771:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:2.0:1784047626.359778:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430656 00000100:00000040:2.0:1784047626.359787:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047626.359792:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.359825:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.359864:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047626.359871:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaacb050 x1870705709430656/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.359881:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430656:12345-0@lo:502:mount.lustre.0 Request processed in 611us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047626.359889:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1784047626.359892:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047626.359902:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 21 00000100:00000040:3.0:1784047626.360052:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.360061:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.360068:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430656:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784047626.360082:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.360096:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee0700 x1870705709430656/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.360111:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.360118:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:3.0:1784047626.360330:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784047626.360361:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784047626.360378:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784047626.360395:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784047626.360412:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784047626.360428:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784047626.360444:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784047626.360460:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784047626.360476:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784047626.360492:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784047626.360508:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784047626.360524:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:3.0:1784047626.360531:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.360536:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047626.360558:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.360569:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430784:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784047626.360598:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.360644:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.360674:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaac8850 x1870705709430784 msgsize 272 00000100:00100000:3.0:1784047626.360678:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.360679:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047626.360704:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.360727:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047626.360858:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430784 00000100:00100000:2.0:1784047626.360864:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430784 00000020:00000040:2.0:1784047626.360867:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047626.360871:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=22 00000100:00000040:2.0:1784047626.360888:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047626.360915:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1784047626.360919:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047626.360924:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaac8850 x1870705709430784/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.360937:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430784:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784047626.360959:0:94374:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:2.0:1784047626.361014:0:94374:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:2.0:1784047626.361019:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430784 00000100:00000040:2.0:1784047626.361026:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047626.361030:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.361051:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.361067:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047626.361078:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaac8850 x1870705709430784/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.361086:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430784:12345-0@lo:502:mount.lustre.0 Request processed in 152us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047626.361093:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1784047626.361095:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047626.361103:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 21 00000100:00000040:3.0:1784047626.361429:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.361439:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.361447:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430784:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784047626.361454:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.361468:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef516a00 x1870705709430784/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.361482:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.361489:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:3.0:1784047626.361520:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784047626.361530:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:3.0:1784047626.362315:0:96944:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccc834ca80 : new refcount 1 00000020:00000040:3.0:1784047626.362322:0:96944:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:2.0:1784047626.362795:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784047626.362803:0:96948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784047626.362809:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784047626.362811:0:96948:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784047626.362817:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784047626.362843:0:96948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99ccc4ac4d40) 00000020:00000040:2.0:1784047626.362850:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccfdd8e800 with handle 0x4426598c0c776a2f to hash 00000020:00000040:2.0:1784047626.362857:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd8e800 : new refcount 1 00000020:00000040:2.0:1784047626.362873:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 2 - obd_device_list 00000020:00000080:2.0:1784047626.362878:0:96948:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:2.0:1784047626.362883:0:96948:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:2.0:1784047626.362886:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784047626.362954:0:96948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc64c8800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784047626.362962:0:96948:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:2.0:1784047626.362966:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccfdd88800 with handle 0x4426598c0c776a36 to hash 00000020:00000040:2.0:1784047626.362983:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99ccc5e499c0) now 5 - export 00000020:00000040:2.0:1784047626.362986:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd88800 : new refcount 1 00000020:00000080:2.0:1784047626.362988:0:96948:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4426598c0c776a36 00000020:00000040:2.0:1784047626.362991:0:96948:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a36 00000020:00000040:2.0:1784047626.362993:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfdd88800 refcount=2 00010000:00010000:2.0:1784047626.367343:0:96948:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1784047626.367355:0:96948:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 509, crc32c 3991, adler 547, t10ip512 2179, t10ip4k 3691, t10crc512 591, t10crc4k 539 00002000:00000040:2.0:1784047626.367397:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1784047626.367488:0:96948:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968756: rc = 0 00000001:00000040:2.0:1784047626.367493:0:96948:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1784047626.367502:0:96948:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968756, last_xid = 1870705709335808, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784047626.367506:0:96948:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968756 srv lr: 4294968756 lx: 1870705709335808 gen 0 00000020:00000040:2.0:1784047626.367514:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccfdd8d800 with handle 0x4426598c0c776a3d to hash 00000020:00000040:2.0:1784047626.367537:0:96948:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd8d800 refcount=3 00000020:00000040:2.0:1784047626.367542:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 3 - export 00000001:00000040:2.0:1784047626.367546:0:96948:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1784047626.367550:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd8d800 : new refcount 2 00000001:00000040:2.0:1784047626.367555:0:96948:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968774, last_xid = 1870705709416192, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784047626.367559:0:96948:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968774 srv lr: 4294968756 lx: 1870705709416192 gen 0 00000020:00000040:2.0:1784047626.367563:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccfe6b8800 with handle 0x4426598c0c776a44 to hash 00000020:00000040:2.0:1784047626.367573:0:96948:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6b8800 refcount=3 00000020:00000040:2.0:1784047626.367575:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 4 - export 00000001:00000040:2.0:1784047626.367577:0:96948:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1784047626.367579:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6b8800 : new refcount 2 00000001:00000040:2.0:1784047626.367582:0:96948:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = 0c846d7a-6357-4e9c-a620-e35737ede709, last_transno = 4294968778, last_xid = 1870705689523456, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784047626.367586:0:96948:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0c846d7a-6357-4e9c-a620-e35737ede709 idx: 2 lr: 4294968778 srv lr: 4294968756 lx: 1870705689523456 gen 0 00000020:00000040:2.0:1784047626.367589:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccfe6bc800 with handle 0x4426598c0c776a4b to hash 00000020:00000040:2.0:1784047626.367598:0:96948:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=3 00000020:00000040:2.0:1784047626.367600:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 5 - export 00000001:00000040:2.0:1784047626.367602:0:96948:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID '0c846d7a-6357-4e9c-a620-e35737ede709' added, generation 0 00000020:00000040:2.0:1784047626.367638:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 2 00000001:00000040:2.0:1784047626.367650:0:96948:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1784047626.367654:0:96948:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:2.0:1784047626.367659:0:96948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968778 00000001:00000040:2.0:1784047626.367702:0:96948:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968778: rc = 0 00000001:00000040:2.0:1784047626.367714:0:96948:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968778: rc = 0 00002000:00000040:2.0:1784047626.367726:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:2.0:1784047626.367763:0:96948:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:2.0:1784047626.367814:0:96948:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:2.0:1784047626.367823:0:96948:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:2.0:1784047626.367978:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:2.0:1784047626.368027:0:96948:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:2.0:1784047626.368036:0:96948:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:2.0:1784047626.368079:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:2.0:1784047626.368100:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:2.0:1784047626.368143:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:2.0:1784047626.368266:0:96948:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:2.0:1784047626.368302:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:2.0:1784047626.368502:0:96948:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:2.0:1784047626.369033:0:96948:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:0.0:1784047626.370453:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 6 - setup 00000020:00000080:0.0:1784047626.370459:0:96948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784047626.370471:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047626.370477:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047626.370479:0:96948:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784047626.370483:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784047626.370485:0:96948:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1784047626.370487:0:96948:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047626.370488:0:96948:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784047626.370490:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784047626.370492:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047626.370494:0:96948:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784047626.370496:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047626.370498:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047626.370500:0:96948:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784047626.370502:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784047626.370504:0:96948:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784047626.370506:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047626.370508:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047626.370509:0:96948:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784047626.370512:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784047626.370514:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047626.370515:0:96948:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784047626.370518:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784047626.370546:0:96948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784047626.370549:0:96948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784047626.370550:0:96948:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784047626.370554:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1784047626.370759:0:96944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784047626.370790:0:96944:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:3.0:1784047626.370810:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebdbd000 refcount=3 00010000:00010000:3.0:1784047626.370818:0:96944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a28 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.370839:0:96944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a28 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047626.370848:0:96944:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cbc64c8800 from 1 10000000:01000000:3.0:1784047626.370860:0:96944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:3.0:1784047626.370868:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00010000:00000040:3.0:1784047626.370889:0:96944:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7500 count: 4 00000020:00000040:3.0:1784047626.370896:0:96944:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccec24a800 with handle 0x4426598c0c776a52 to hash 00010000:00010000:3.0:1784047626.370903:0:96944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.370911:0:96944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.370922:0:96944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.370947:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.370962:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430912:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1784047626.371004:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.371014:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.371061:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaaca850 x1870705709430912 msgsize 328 00000100:00100000:3.0:1784047626.371066:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.371069:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047626.371090:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.371119:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc8b239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047626.371349:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709430912 00000100:00100000:2.0:1784047626.371356:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709430912 00000020:00000040:2.0:1784047626.371358:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047626.371362:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=22 00000100:00000040:2.0:1784047626.371393:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047626.371453:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1784047626.371458:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047626.371462:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaaca850 x1870705709430912/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.371474:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:96944:x1870705709430912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047626.371497:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1784047626.371506:0:94374:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccef89e600 count: 5 00000020:00000040:2.0:1784047626.371512:0:94374:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccebdbce00 with handle 0x4426598c0c776a59 to hash 00010000:00010000:2.0:1784047626.371516:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbce00/0x4426598c0c776a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776a52 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.371523:0:94374:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99ccc832d800 : new locks_count 17 00000020:00000040:2.0:1784047626.371526:0:94374:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=23 00010000:00000040:2.0:1784047626.371541:0:94374:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff99ccef89e600) refcount = 5 00010000:00000040:2.0:1784047626.371544:0:94374:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784047626.371548:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccf6c47000/0x4426598c0c775bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bf0 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.371555:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccf6c47800/0x4426598c0c775bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775bc6 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.371561:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebdbe400/0x4426598c0c775b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b4f expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.371569:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebdbfe00/0x4426598c0c775a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae4f9 expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.371575:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbce00/0x4426598c0c776a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776a52 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.371585:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbce00/0x4426598c0c776a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a52 expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.371593:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbce00, rc 0) 00010000:00000040:2.0:1784047626.371597:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709430912 00000100:00000040:2.0:1784047626.371630:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047626.371641:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.371662:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.371682:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047626.371686:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaaca850 x1870705709430912/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/344 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.371695:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709430912:12345-0@lo:101:mount.lustre.0 Request processed in 222us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047626.371701:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1784047626.371704:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047626.371712:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:3.0:1784047626.371791:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.371802:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.371821:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709430912:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1784047626.371844:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.371855:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24a800 refcount=4 00010000:00000040:3.0:1784047626.371860:0:96944:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99ccec24a800, remote cookie: 0x4426598c0c776a59, flags: 0x0 00010000:00000040:3.0:1784047626.371865:0:96944:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff99ccc34a7500) refcount = 4 00010000:00000040:3.0:1784047626.371867:0:96944:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784047626.371870:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccebdbf800/0x4426598c0c775bf0 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bf7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.371877:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cd00601200/0x4426598c0c775bc6 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775bcd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.371882:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47a00/0x4426598c0c775b4f lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775b56 expref: -99 pid: 94367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.371888:0:96944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a59 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.371895:0:96944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776a59 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.371902:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef516a00 x1870705709430912/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.371911:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:00000040:3.0:1784047626.371918:0:96944:0:(mgc_request.c:108:config_log_get()) log params (ffff99ccebd28c00) refs 2 00000020:00000040:3.0:1784047626.371921:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24a800 refcount=3 10000000:00000040:3.0:1784047626.371945:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccc834ca80 : new refcount 2 10000000:00000040:3.0:1784047626.371953:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 10000000:00000040:3.0:1784047626.371956:0:96944:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.140@tcp: copy local log params 00000040:00080000:3.0:1784047626.372116:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784047626.372888:0:96944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784047626.373358:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784047626.373478:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784047626.373498:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784047626.373503:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:3.0:1784047626.373558:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.373564:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047626.373598:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.373640:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef516a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431040:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1784047626.373662:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.373669:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.373704:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaacb850 x1870705709431040 msgsize 504 00000100:00100000:3.0:1784047626.373708:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.373711:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047626.378867:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.378906:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a540 going to sleep for 11 seconds 00000100:00100000:0.0:1784047626.378979:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431040 00000100:00100000:0.0:1784047626.378989:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431040 00000020:00000040:0.0:1784047626.378992:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:0.0:1784047626.378996:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:0.0:1784047626.379020:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784047626.379043:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1784047626.379048:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:0.0:1784047626.379063:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaacb850 x1870705709431040/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 504/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.379077:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431040:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1784047626.379099:0:94372:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:0.0:1784047626.379102:0:94372:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:0.0:1784047626.379189:0:94372:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:0.0:1784047626.379197:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431040 00000100:00000040:0.0:1784047626.379208:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047626.379213:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.379257:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.379279:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047626.379284:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaacb850 x1870705709431040/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 504/272 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.379293:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431040:12345-0@lo:501:mount.lustre.0 Request processed in 219us (5588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.379300:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1784047626.379303:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.379312:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:0.0:1784047626.381703:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.381719:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.381727:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef516a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431040:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1784047626.381736:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.381768:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:0.0:1784047626.381774:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef516a00 x1870705709431040/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.381782:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000020:00000040:0.0:1784047626.381796:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:0.0:1784047626.381802:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:0.0:1784047626.381909:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.381924:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431168:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1784047626.381962:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.381982:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.382024:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaaca050 x1870705709431168 msgsize 272 00000100:00100000:0.0:1784047626.382029:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.382032:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784047626.382055:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.382071:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047626.382138:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431168 00000100:00100000:2.0:1784047626.382144:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431168 00000020:00000040:2.0:1784047626.382147:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047626.382152:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:2.0:1784047626.382245:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047626.382277:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1784047626.382281:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047626.382287:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaaca050 x1870705709431168/t0(0) o503->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.382299:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431168:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1784047626.382326:0:94372:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:2.0:1784047626.382987:0:94372:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:2.0:1784047626.382993:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431168 00000100:00000040:2.0:1784047626.383003:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047626.383009:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.383042:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.383084:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047626.383090:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaaca050 x1870705709431168/t0(0) o503->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8416 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.383099:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaaca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431168:12345-0@lo:503:mount.lustre.0 Request processed in 802us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047626.383107:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1784047626.383111:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047626.383121:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:0.0:1784047626.383275:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.383284:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.383290:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431168:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1784047626.383297:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.383321:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce4538a80 x1870705709431168/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.383336:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:0.0:1784047626.383342:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:0.0:1784047626.384736:0:96944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1784047626.384801:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:0.0:1784047626.384809:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:0.0:1784047626.385096:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.385110:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431296:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1784047626.385151:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.385159:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.385304:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaac8450 x1870705709431296 msgsize 272 00000100:00100000:0.0:1784047626.385309:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.385311:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784047626.385383:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.385409:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3c9d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784047626.385949:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431296 00000100:00100000:2.0:1784047626.385958:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431296 00000020:00000040:2.0:1784047626.385961:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047626.385965:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:2.0:1784047626.385996:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047626.386058:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:2.0:1784047626.386062:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047626.386069:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaac8450 x1870705709431296/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.386081:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431296:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784047626.386113:0:94374:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:2.0:1784047626.386163:0:94374:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:2.0:1784047626.386168:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431296 00000100:00000040:2.0:1784047626.386246:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047626.386252:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.386280:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.386309:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047626.386314:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaac8450 x1870705709431296/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.386329:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431296:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047626.386336:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:2.0:1784047626.386339:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047626.386348:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:3.0:1784047626.386430:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.386441:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.386447:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431296:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784047626.386455:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.386473:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce4538a80 x1870705709431296/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.386486:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.386493:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:3.0:1784047626.386706:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784047626.386736:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784047626.386749:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784047626.386762:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784047626.386775:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:3.0:1784047626.386782:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.386787:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047626.386808:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.386817:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431424:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784047626.386959:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.386976:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.386999:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaac9c50 x1870705709431424 msgsize 272 00000100:00100000:3.0:1784047626.387004:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.387006:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047626.387137:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.387158:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047626.387298:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431424 00000100:00100000:0.0:1784047626.387304:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431424 00000020:00000040:0.0:1784047626.387306:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:0.0:1784047626.387309:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:0.0:1784047626.387325:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784047626.387340:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1784047626.387343:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:0.0:1784047626.387349:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaac9c50 x1870705709431424/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.387374:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431424:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1784047626.387394:0:94372:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:0.0:1784047626.387433:0:94372:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:0.0:1784047626.387437:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431424 00000100:00000040:0.0:1784047626.387444:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047626.387463:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.387486:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.387512:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047626.387517:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaac9c50 x1870705709431424/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.387526:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431424:12345-0@lo:502:mount.lustre.0 Request processed in 154us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.387533:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1784047626.387535:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.387542:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:3.0:1784047626.387650:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.387658:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.387677:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431424:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1784047626.387684:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.387694:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef515f80 x1870705709431424/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.387706:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.387713:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:3.0:1784047626.387741:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784047626.387751:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:3.0:1784047626.388043:0:96944:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccc834ca80 : new refcount 1 00000020:00000040:3.0:1784047626.388049:0:96944:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:3.0:1784047626.388961:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047626.388987:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047626.388990:0:96952:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784047626.388998:0:96952:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbc64c8800 00000020:00000080:3.0:1784047626.389001:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784047626.389010:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047626.389013:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047626.389014:0:96952:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784047626.389016:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784047626.389019:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047626.389020:0:96952:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784047626.389024:0:96952:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cbc64c8800 00000020:00000080:3.0:1784047626.389026:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784047626.389091:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784047626.389095:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784047626.389096:0:96952:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784047626.389099:0:96952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:3.0:1784047626.389664:0:96944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784047626.389708:0:96944:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:3.0:1784047626.389720:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24a800 refcount=3 00010000:00010000:3.0:1784047626.389727:0:96944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a59 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.389739:0:96944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24a800/0x4426598c0c776a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a59 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047626.389782:0:96944:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784047626.389784:0:96944:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cbc64c8800 10000000:01000000:3.0:1784047626.389787:0:96944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cbc64c8800 10000000:01000000:3.0:1784047626.389791:0:96944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1784047626.389795:0:96944:0:(genops.c:889:class_export_get()) GET export ffff99cce74a3000 refcount=20 10000000:01000000:3.0:1784047626.389798:0:96944:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cbc64c8800 from 1 10000000:01000000:3.0:1784047626.389801:0:96944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:3.0:1784047626.389806:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00010000:00000040:3.0:1784047626.389825:0:96944:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7100 count: 9 00000020:00000040:3.0:1784047626.389843:0:96944:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccec24b000 with handle 0x4426598c0c776a60 to hash 00010000:00010000:3.0:1784047626.389850:0:96944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.389857:0:96944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.389867:0:96944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.389886:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.389899:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431552:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1784047626.389927:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.389935:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.389985:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaacb450 x1870705709431552 msgsize 328 00000100:00100000:3.0:1784047626.389990:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.389993:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047626.390008:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.390036:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc798a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784047626.390932:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431552 00000100:00100000:2.0:1784047626.390942:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431552 00000020:00000040:2.0:1784047626.390945:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047626.390949:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:2.0:1784047626.390982:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047626.391006:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1784047626.391010:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047626.391016:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaacb450 x1870705709431552/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.391029:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:96944:x1870705709431552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784047626.391042:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1784047626.391050:0:94374:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccfebe4c00 count: 11 00000020:00000040:2.0:1784047626.391056:0:94374:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccebdbde00 with handle 0x4426598c0c776a67 to hash 00010000:00010000:2.0:1784047626.391061:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbde00/0x4426598c0c776a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776a60 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391068:0:94374:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99ccc832d800 : new locks_count 18 00000020:00000040:2.0:1784047626.391071:0:94374:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=24 00010000:00000040:2.0:1784047626.391088:0:94374:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99ccfebe4c00) refcount = 11 00010000:00000040:2.0:1784047626.391091:0:94374:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784047626.391095:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccec24b200/0x4426598c0c776a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a21 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391117:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cbc67b5e00/0x4426598c0c776042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae569 expref: 9 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391125:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cbc67b4800/0x4426598c0c77603b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae562 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391132:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccf6c46e00/0x4426598c0c776034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c77602d expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391138:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cceff29c00/0x4426598c0c77600a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776003 expref: 24 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391145:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cbc67b5600/0x4426598c0c775ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775ff5 expref: 24 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391151:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebd6c800/0x4426598c0c775fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fe7 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391158:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebd6ca00/0x4426598c0c775fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fd9 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391164:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebd6c000/0x4426598c0c775fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fcb expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047626.391170:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cceff28800/0x4426598c0c775fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775fbd expref: 24 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.391186:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbde00/0x4426598c0c776a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776a60 expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.391197:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbde00/0x4426598c0c776a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a60 expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.391214:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbde00, rc 0) 00010000:00000040:2.0:1784047626.391218:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431552 00000100:00000040:2.0:1784047626.391226:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:2.0:1784047626.391232:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.391261:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.391286:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:2.0:1784047626.391291:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaacb450 x1870705709431552/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/344 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.391300:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431552:12345-0@lo:101:mount.lustre.0 Request processed in 273us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047626.391306:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1784047626.391309:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047626.391319:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:3.0:1784047626.391500:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.391510:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.391517:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431552:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1784047626.391525:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.391537:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24b000 refcount=4 00010000:00000040:3.0:1784047626.391542:0:96944:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99ccec24b000, remote cookie: 0x4426598c0c776a67, flags: 0x0 00010000:00000040:3.0:1784047626.391547:0:96944:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff99ccc34a7100) refcount = 9 00010000:00000040:3.0:1784047626.391550:0:96944:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784047626.391552:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccebdbd000/0x4426598c0c776a21 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776a28 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391559:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccebd6d200/0x4426598c0c77602d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776034 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391565:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5a00/0x4426598c0c776003 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c77600a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391581:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cceff28000/0x4426598c0c775ff5 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775ffc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391587:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4600/0x4426598c0c775fe7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391592:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b4000/0x4426598c0c775fd9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391597:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99cbc67b5c00/0x4426598c0c775fcb lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fd2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.391603:0:96944:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccf6c46a00/0x4426598c0c775fbd lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c775fc4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.391623:0:96944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a67 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.391631:0:96944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776a67 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.391641:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef515f80 x1870705709431552/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.391652:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:00000040:3.0:1784047626.391662:0:96944:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff99ccc34dda00) refs 2 00000020:00000040:3.0:1784047626.391665:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24b000 refcount=3 10000000:00000040:3.0:1784047626.391691:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccc834ca80 : new refcount 2 10000000:00000040:3.0:1784047626.391694:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 10000000:00000040:3.0:1784047626.391697:0:96944:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.140@tcp: copy local log lustre-client 00000040:00080000:3.0:1784047626.392278:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1784047626.392518:0:96944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784047626.392708:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784047626.392733:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784047626.392746:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784047626.392761:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784047626.392775:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784047626.392788:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784047626.392801:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784047626.392812:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784047626.392824:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784047626.394555:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784047626.394588:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784047626.395521:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784047626.395569:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784047626.395586:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784047626.395601:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784047626.395645:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784047626.395661:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784047626.395675:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784047626.395690:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784047626.395703:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784047626.395717:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784047626.395731:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784047626.395746:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784047626.395764:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784047626.395779:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1784047626.395793:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1784047626.395807:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1784047626.395822:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1784047626.396947:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1784047626.396986:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1784047626.397003:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1784047626.397018:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1784047626.397052:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1784047626.397065:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1784047626.397080:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1784047626.397094:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1784047626.397108:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1784047626.397134:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1784047626.397140:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1784047626.397726:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:3.0:1784047626.397734:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047626.397779:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.397794:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431680:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1784047626.397821:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.398070:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.398114:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaacbc50 x1870705709431680 msgsize 512 00000100:00100000:3.0:1784047626.398119:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.398120:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784047626.399553:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.399590:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784047626.401443:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431680 00000100:00100000:0.0:1784047626.401456:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431680 00000020:00000040:0.0:1784047626.401459:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:0.0:1784047626.401464:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:0.0:1784047626.401487:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784047626.401557:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:0.0:1784047626.401563:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:0.0:1784047626.401571:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaacbc50 x1870705709431680/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 512/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.401585:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431680:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1784047626.401641:0:94374:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:0.0:1784047626.401645:0:94374:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:0.0:1784047626.401725:0:94374:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00000020:00000040:0.0:1784047626.401737:0:94374:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=25 00000020:00000040:0.0:1784047626.401741:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 24 00010000:00000040:0.0:1784047626.401746:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431680 00000100:00000040:0.0:1784047626.401757:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047626.401763:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.401807:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.401918:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047626.401925:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaacbc50 x1870705709431680/t0(0) o501->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 512/272 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.401934:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaacbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431680:12345-0@lo:501:mount.lustre.0 Request processed in 352us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.401943:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:0.0:1784047626.401946:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.401955:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:2.0:1784047626.402063:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.402076:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.402083:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431680:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784047626.402092:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.402103:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.402107:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef515f80 x1870705709431680/t0(0) o501->MGC192.168.204.140@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.402116:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.402136:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.402140:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.402164:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.402189:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431808:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784047626.402221:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.402228:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.402249:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99ccd4efd050 x1870705709431808 msgsize 272 00000100:00100000:2.0:1784047626.402254:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.402256:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.402442:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.402467:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047626.402505:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431808 00000100:00100000:1.0:1784047626.402510:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431808 00000020:00000040:1.0:1784047626.402512:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:1.0:1784047626.402522:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:1.0:1784047626.402538:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784047626.402552:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1784047626.402555:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:1.0:1784047626.402559:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccd4efd050 x1870705709431808/t0(0) o503->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.402570:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431808:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1784047626.402590:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:1.0:1784047626.402649:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:1.0:1784047626.402653:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431808 00000100:00000040:1.0:1784047626.402659:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047626.402663:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.402684:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.402705:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047626.402709:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccd4efd050 x1870705709431808/t0(0) o503->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8416 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.402718:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd4efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431808:12345-0@lo:503:mount.lustre.0 Request processed in 149us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.402725:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1784047626.402727:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047626.402734:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:2.0:1784047626.402824:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.402846:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.402853:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431808:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784047626.402859:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.402870:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee3800 x1870705709431808/t0(0) o503->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.402884:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.402890:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:2.0:1784047626.403479:0:96944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1784047626.403544:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.403550:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.403572:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.403583:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431936:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.403631:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.403638:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.403663:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cce3e8ac50 x1870705709431936 msgsize 272 00000100:00100000:2.0:1784047626.403668:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.403670:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.403687:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.403706:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047626.403789:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709431936 00000100:00100000:1.0:1784047626.403795:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709431936 00000020:00000040:1.0:1784047626.403797:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:1.0:1784047626.403801:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:1.0:1784047626.403813:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784047626.403927:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:1.0:1784047626.403932:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:1.0:1784047626.403944:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cce3e8ac50 x1870705709431936/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.403956:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431936:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1784047626.403987:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:1.0:1784047626.404147:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:1.0:1784047626.404153:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709431936 00000100:00000040:1.0:1784047626.404161:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047626.404165:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.404251:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.404277:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047626.404283:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce3e8ac50 x1870705709431936/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.404291:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709431936:12345-0@lo:502:mount.lustre.0 Request processed in 338us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.404297:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:1.0:1784047626.404299:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047626.404306:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:2.0:1784047626.404384:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.404393:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.404401:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709431936:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.404407:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.404418:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee3800 x1870705709431936/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.404431:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.404437:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:2.0:1784047626.404645:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784047626.404675:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784047626.404706:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784047626.404722:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784047626.404738:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784047626.404756:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784047626.404775:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784047626.404793:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784047626.404810:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784047626.404907:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784047626.404933:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784047626.404948:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784047626.404976:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784047626.404995:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784047626.405009:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784047626.405131:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784047626.405152:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784047626.405168:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784047626.405265:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784047626.405282:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784047626.405297:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784047626.405311:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784047626.405328:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784047626.405344:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784047626.405359:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784047626.405374:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784047626.405389:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784047626.405404:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784047626.405420:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784047626.405436:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784047626.405451:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784047626.405466:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784047626.405479:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784047626.405494:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784047626.405511:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784047626.405537:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784047626.405551:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784047626.405565:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784047626.405579:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784047626.405590:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784047626.405602:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784047626.405643:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784047626.405657:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784047626.405670:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784047626.405684:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784047626.405698:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784047626.405713:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784047626.405729:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:2.0:1784047626.405748:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.405755:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.405784:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.405796:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709432064:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.405827:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.406101:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.406137:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cce3e8b850 x1870705709432064 msgsize 272 00000100:00100000:2.0:1784047626.406142:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.406144:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.406265:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.406292:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784047626.406338:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432064 00000100:00100000:1.0:1784047626.406346:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432064 00000020:00000040:1.0:1784047626.406349:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:1.0:1784047626.406354:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:1.0:1784047626.406373:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784047626.406431:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:1.0:1784047626.406436:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:1.0:1784047626.406441:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cce3e8b850 x1870705709432064/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.406453:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709432064:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1784047626.406482:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:1.0:1784047626.406533:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:1.0:1784047626.406538:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709432064 00000100:00000040:1.0:1784047626.406548:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047626.406553:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.406574:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.406600:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:1.0:1784047626.406631:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce3e8b850 x1870705709432064/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.406641:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce3e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709432064:12345-0@lo:502:mount.lustre.0 Request processed in 190us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.406648:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:1.0:1784047626.406651:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047626.406661:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:2.0:1784047626.406748:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.406758:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.406770:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709432064:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.406777:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.406789:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee3800 x1870705709432064/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.406803:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.406811:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:2.0:1784047626.407016:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1784047626.407041:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:2.0:1784047626.407058:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1784047626.407072:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:2.0:1784047626.407086:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:2.0:1784047626.407100:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:2.0:1784047626.407112:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:2.0:1784047626.407125:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:2.0:1784047626.407137:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:2.0:1784047626.407150:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:2.0:1784047626.407164:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:2.0:1784047626.407193:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:2.0:1784047626.407211:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:2.0:1784047626.407227:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:2.0:1784047626.407234:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.407239:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.407258:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.407268:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709432192:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.407293:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.407306:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.407329:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc76b1450 x1870705709432192 msgsize 272 00000100:00100000:2.0:1784047626.407334:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.407336:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.407597:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.407637:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784047626.407684:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432192 00000100:00100000:0.0:1784047626.407690:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432192 00000020:00000040:0.0:1784047626.407692:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:0.0:1784047626.407696:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:0.0:1784047626.407712:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1784047626.407728:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:0.0:1784047626.407731:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:0.0:1784047626.407736:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc76b1450 x1870705709432192/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.407748:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709432192:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1784047626.407777:0:94372:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99ccff0ff540 : new refcount 2 00000040:00000040:0.0:1784047626.407817:0:94372:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccff0ff540 : new refcount 1 00010000:00000040:0.0:1784047626.407821:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709432192 00000100:00000040:0.0:1784047626.407937:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:0.0:1784047626.407942:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.407963:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.408032:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 51 to 0@lo 00000100:00000040:0.0:1784047626.408037:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc76b1450 x1870705709432192/t0(0) o502->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 272/8472 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.408046:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709432192:12345-0@lo:502:mount.lustre.0 Request processed in 300us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.408053:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:0.0:1784047626.408056:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.408063:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:2.0:1784047626.408158:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.408167:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.408239:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709432192:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784047626.408247:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.408258:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee3800 x1870705709432192/t0(0) o502->MGC192.168.204.140@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.408272:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047626.408278:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000040:00080000:2.0:1784047626.408311:0:96944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:2.0:1784047626.408321:0:96944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:2.0:1784047626.408927:0:96944:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99ccc834ca80 : new refcount 1 00000020:00000040:2.0:1784047626.408934:0:96944:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:1.0:1784047626.409400:0:96955:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.140@tcp 192.168.204.140@tcp cnt=1 00000020:01000004:1.0:1784047626.409424:0:96955:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784047626.409439:0:96955:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) 00000020:00000040:1.0:1784047626.409446:0:96955:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccc3566800 with handle 0x4426598c0c776a6e to hash 00000020:00000040:1.0:1784047626.409451:0:96955:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc3566800 : new refcount 1 00000020:00000040:1.0:1784047626.409467:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) now 2 - obd_device_list 00000020:00000080:1.0:1784047626.409472:0:96955:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1784047626.409732:0:96955:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc64c8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784047626.409737:0:96955:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbc64c8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784047626.409740:0:96955:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc64c8800 3 00000020:00000040:1.0:1784047626.409756:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) now 3 - import 00000020:00000040:1.0:1784047626.409761:0:96955:0:(genops.c:1244:class_import_put()) import ffff99ccd897f800 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1784047626.409771:0:96955:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047626.409781:0:96955:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 52 to 0@lo 00000100:00000040:1.0:1784047626.409784:0:96955:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.140@tcp -> ffff99ccc8ec6fc0 00010000:00080000:1.0:1784047626.409788:0:96955:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccd897f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1784047626.411777:0:96955:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:1.0:1784047626.411984:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) now 4 - setup 00000020:00000080:1.0:1784047626.411989:0:96955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784047626.412034:0:96955:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1784047626.412041:0:96955:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cd0032c800 with handle 0x4426598c0c776a75 to hash 00000020:00000040:1.0:1784047626.412047:0:96955:0:(genops.c:889:class_export_get()) GET export ffff99cd0032c800 refcount=3 00000020:00000040:1.0:1784047626.412051:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) now 5 - export 00000020:00000040:1.0:1784047626.412054:0:96955:0:(genops.c:900:class_export_put()) PUTting export ffff99cd0032c800 : new refcount 2 00000020:00000080:1.0:1784047626.412057:0:96955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4426598c0c776a75 00000020:00000040:1.0:1784047626.412060:0:96955:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a75 00000020:00000040:1.0:1784047626.412062:0:96955:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cd0032c800 refcount=3 00000100:00080000:1.0:1784047626.412070:0:96955:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1784047626.412074:0:96955:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 53 to 0@lo 00000020:00000040:1.0:1784047626.412076:0:96955:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a75 00000020:00000040:1.0:1784047626.412078:0:96955:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cd0032c800 refcount=4 00000100:00000040:1.0:1784047626.412080:0:96955:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 54 to 0@lo 00000020:00000040:1.0:1784047626.412081:0:96955:0:(genops.c:900:class_export_put()) PUTting export ffff99cd0032c800 : new refcount 3 00000100:00080000:1.0:1784047626.412084:0:96955:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ccd897f800 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:1.0:1784047626.412098:0:96955:0:(genops.c:1231:class_import_get()) import ffff99ccd897f800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1784047626.412119:0:96955:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784047626.412133:0:96955:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006eedf27b] to pc [ptlrpcd_rcv+-1] req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.412201:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.412226:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709432320:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1784047626.412259:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784047636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.412274:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.412314:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee3800 x1870705709432320 msgsize 520 00000100:00100000:2.0:1784047626.412319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.412346:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784047636 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.412358:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00080000:1.0:1784047626.412699:0:96955:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:1.0:1784047626.412703:0:96955:0:(genops.c:1231:class_import_get()) import ffff99ccd897f800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:0.0:1784047626.413964:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432320 00000100:00100000:0.0:1784047626.413985:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432320 00000020:00000040:0.0:1784047626.413988:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:0.0:1784047626.414032:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00000040:0.0:1784047626.414041:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee3800 x1870705709432320/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1784047646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.414052:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1870705709432320:12345-0@lo:38:llog_process_th.0 00000020:00000040:0.0:1784047626.414068:0:68026:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 14 - find 00010000:00000040:0.0:1784047626.414081:0:68026:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1784047626.414090:0:68026:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3724 last 0 00000020:00000040:0.0:1784047626.414100:0:68026:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccfdd89800 with handle 0x4426598c0c776a7c to hash 00000020:00000040:0.0:1784047626.414131:0:68026:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd89800 refcount=3 00000020:00000040:0.0:1784047626.414142:0:68026:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 15 - export 00000020:00000040:0.0:1784047626.414145:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd89800 : new refcount 2 00000020:00000080:0.0:1784047626.414147:0:68026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4426598c0c776a7c 00000020:00000040:0.0:1784047626.414150:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a7c 00000020:00000040:0.0:1784047626.414152:0:68026:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfdd89800 refcount=3 00000001:00000040:0.0:1784047626.414163:0:68026:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.140@tcp 00000001:00000040:0.0:1784047626.414168:0:68026:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 17 00000020:00000040:0.0:1784047626.414171:0:68026:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd89800 refcount=4 00000001:00000040:0.0:1784047626.414248:0:68026:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 18 00000001:00000040:0.0:1784047626.414252:0:68026:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99ccecd71400) : new refcount 17 00000004:00100000:0.0:1784047626.414258:0:68026:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:0.0:1784047626.414269:0:68026:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99cd00117a80 for nid 0@lo - ref 6 00000020:00000040:0.0:1784047626.414278:0:68026:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 16 - import 00000020:00000040:0.0:1784047626.414284:0:68026:0:(genops.c:1244:class_import_put()) import ffff99ccfdd8b000 refcount=1 obd=lustre-MDT0000 00000020:00000040:0.0:1784047626.414292:0:68026:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd89800 refcount=5 00000100:00000040:0.0:1784047626.414294:0:68026:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99ccfdd89800 : new rpc_count 1 00000100:00000040:0.0:1784047626.414299:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 55 to 0@lo 00000100:00000040:0.0:1784047626.414303:0:68026:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 55 to 0@lo 00000020:00000040:0.0:1784047626.414306:0:68026:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd89800 refcount=6 00000100:00000040:0.0:1784047626.414312:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00080000:0.0:1784047626.414321:0:68026:0:(import.c:65:import_set_state_nolock()) ffff99ccfdd8b000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1784047626.414326:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd89800 : new refcount 5 00000020:00000040:0.0:1784047626.414329:0:68026:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 16 - find 00010000:00000040:0.0:1784047626.414343:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709432320 00000100:00000040:0.0:1784047626.414353:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:0.0:1784047626.414360:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.414401:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784047636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.414600:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:0.0:1784047626.414632:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3800 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784047646 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.414647:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870705709432320:12345-0@lo:38:llog_process_th.0 Request processed in 594us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.414655:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00000040:0.0:1784047626.414658:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfdd89800 : new rpc_count 0 00000020:00000040:0.0:1784047626.414667:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd89800 : new refcount 4 00000100:00000040:0.0:1784047626.414688:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.414699:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc753d000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1784047626.414716:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.414730:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000124bbdcc] to pc [ptlrpcd_00_02+2] req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.414747:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.414754:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc753a800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1784047626.414762:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.414770:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009f1d5397] to pc [ptlrpcd_00_03+3] req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.414778:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.414782:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1784047626.414788:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.414796:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000035ab37c6] to pc [ptlrpcd_00_00+0] req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047626.414825:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047626.414842:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784047626.414845:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047626.414850:0:52247:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3722 00000100:00080000:0.0:1784047626.414855:0:52247:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1784047626.414859:0:52247:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 55 to 0@lo 00000100:00000040:0.0:1784047626.414861:0:52247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000020:00000040:0.0:1784047626.414864:0:52247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f95d 00000020:00000040:0.0:1784047626.414867:0:52247:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccec31f000 refcount=4 00000100:00000040:0.0:1784047626.414870:0:52247:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 55 to 0@lo 00000100:00000040:0.0:1784047626.414873:0:52247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000020:00000040:0.0:1784047626.414875:0:52247:0:(genops.c:900:class_export_put()) PUTting export ffff99ccec31f000 : new refcount 3 00000100:00080000:0.0:1784047626.414878:0:52247:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cbc7a6e000 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:0.0:1784047626.414888:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc7a6e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1784047626.414902:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.414910:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000a37e291] to pc [ptlrpcd_rcv+-1] req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.414919:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.414924:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1784047626.414930:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.414939:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b865b37c] to pc [ptlrpcd_00_01+1] req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.414948:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.414959:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbcaee6800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1784047626.414978:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.414988:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cef9b245] to pc [ptlrpcd_00_02+2] req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.414995:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.415000:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1784047626.415008:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.415018:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000585ffafb] to pc [ptlrpcd_00_03+3] req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047626.415026:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047626.415029:0:52247:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784047626.415030:0:52247:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784047626.415035:0:52247:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3722 00000100:00080000:0.0:1784047626.415038:0:52247:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1784047626.415042:0:52247:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 55 to 0@lo 00000100:00000040:0.0:1784047626.415044:0:52247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000020:00000040:0.0:1784047626.415046:0:52247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b17 00000020:00000040:0.0:1784047626.415049:0:52247:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5c03000 refcount=4 00000100:00000040:0.0:1784047626.415052:0:52247:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 55 to 0@lo 00000100:00000040:0.0:1784047626.415055:0:52247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000020:00000040:0.0:1784047626.415058:0:52247:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5c03000 : new refcount 3 00000100:00080000:0.0:1784047626.415060:0:52247:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccf7599800 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:0.0:1784047626.415067:0:52247:0:(genops.c:1231:class_import_get()) import ffff99ccf7599800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1784047626.415076:0:52247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.415093:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000429faad8] to pc [ptlrpcd_rcv+-1] req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415101:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.415108:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047626.415116:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.415125:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009cc3bae9] to pc [ptlrpcd_00_00+0] req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415131:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784047626.415136:0:52247:0:(genops.c:1231:class_import_get()) import ffff99ccc5e52000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1784047626.415141:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.415148:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000376cf81f] to pc [ptlrpcd_00_01+1] req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415158:0:52247:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3729) 00000100:00000040:0.0:1784047626.415310:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415323:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709432576:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415349:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415356:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.415377:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd060fb80 x1870705709432576 msgsize 224 00000100:00100000:0.0:1784047626.415382:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.415398:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415417:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7730 usecs (8 jiffies) 00000100:00000040:0.0:1784047626.415427:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415437:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709433216:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415452:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415459:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.415475:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9ae9f80 x1870705709433216 msgsize 224 00000100:00100000:0.0:1784047626.415479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.415494:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415504:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5175 usecs (6 jiffies) 00000100:00100000:0.0:1784047626.415515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:0.0:1784047626.415520:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415530:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709432448:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415544:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415550:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.415563:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9ae8380 x1870705709432448 msgsize 224 00000100:00100000:0.0:1784047626.415568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.415582:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415590:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8153 usecs (9 jiffies) 00000100:00000040:0.0:1784047626.415596:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415635:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709433088:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415649:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415656:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.415669:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdd1dc00 x1870705709433088 msgsize 224 00000100:00100000:0.0:1784047626.415673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.415689:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415698:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 123740 usecs (124 jiffies) 00000100:00000040:0.0:1784047626.415714:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415723:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709432704:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415734:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415742:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.415753:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdd1d500 x1870705709432704 msgsize 224 00000100:00100000:0.0:1784047626.415758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.415777:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415788:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1604310 usecs (1605 jiffies) 00000100:00000040:0.0:1784047626.415795:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415805:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709433472:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415820:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415905:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.415925:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef51dc00 x1870705709433472 msgsize 224 00000100:00100000:0.0:1784047626.415929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.415942:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.415951:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8767 usecs (9 jiffies) 00000100:00100000:0.0:1784047626.415960:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1784047626.415964:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.415985:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709432960:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.415997:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.416004:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.416015:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc6d41180 x1870705709432960 msgsize 224 00000100:00100000:0.0:1784047626.416019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.416031:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.416038:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5648 usecs (6 jiffies) 00000100:00000040:0.0:1784047626.416043:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.416051:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709433600:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.416063:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.416069:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.416080:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc6d42680 x1870705709433600 msgsize 224 00000100:00100000:0.0:1784047626.416083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047626.416094:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.416109:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7715 usecs (8 jiffies) 00000100:00100000:0.0:1784047626.416137:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432576 00000100:00100000:0.0:1784047626.416144:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432576 00000020:00000040:0.0:1784047626.416146:0:66219:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76fa05 00000020:00000040:0.0:1784047626.416149:0:66219:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc6ea1800 refcount=5 00000020:00000040:0.0:1784047626.416161:0:66219:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00000040:0.0:1784047626.416320:0:66219:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784047626.416388:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432448 00000100:00100000:0.0:1784047626.416391:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432448 00000020:00000040:0.0:1784047626.416393:0:66219:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c52 00000020:00000040:0.0:1784047626.416396:0:66219:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897d800 refcount=5 00000020:00000040:0.0:1784047626.416403:0:66219:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 16 - evictor 00000100:00100000:1.0:1784047626.416449:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433088 00000100:00100000:1.0:1784047626.416459:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433088 00000020:00000040:1.0:1784047626.416461:0:66220:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c59 00000020:00000040:1.0:1784047626.416464:0:66220:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897e000 refcount=5 00000100:00100000:1.0:1784047626.416486:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433600 00000100:00100000:1.0:1784047626.416488:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433600 00000020:00000040:1.0:1784047626.416490:0:66220:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c60 00000020:00000040:1.0:1784047626.416492:0:66220:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5e57800 refcount=5 00000100:00100000:1.0:1784047626.416506:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00000040:1.0:1784047626.416510:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbc6ea1800 : new rpc_count 1 00000100:00000040:1.0:1784047626.416515:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd060fb80 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.416527:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd060fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709432576:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047626.416544:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709432576 00000100:00000040:1.0:1784047626.416553:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.416557:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.416576:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.416595:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:1.0:1784047626.416600:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060fb80 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.416628:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd060fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709432576:12345-0@lo:400:kworker.0 Request processed in 103us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.416636:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00000040:1.0:1784047626.416639:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbc6ea1800 : new rpc_count 0 00000020:00000040:1.0:1784047626.416647:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc6ea1800 : new refcount 4 00000100:00100000:1.0:1784047626.416656:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00000040:1.0:1784047626.416658:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897d800 : new rpc_count 1 00000100:00000040:1.0:1784047626.416662:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9ae8380 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.416683:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709432448:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047626.416695:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709432448 00000100:00000040:1.0:1784047626.416699:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.416702:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.416718:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.416730:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:1.0:1784047626.416734:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9ae8380 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.416742:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709432448:12345-0@lo:400:kworker.0 Request processed in 62us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.416748:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00000040:1.0:1784047626.416750:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897d800 : new rpc_count 0 00000020:00000040:1.0:1784047626.416756:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897d800 : new refcount 4 00000100:00100000:1.0:1784047626.416766:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00000040:1.0:1784047626.416768:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897e000 : new rpc_count 1 00000100:00000040:1.0:1784047626.416771:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdd1dc00 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.416781:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709433088:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047626.416790:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709433088 00000100:00000040:1.0:1784047626.416795:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.416799:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.416812:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.416825:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00100000:2.0:1784047626.416966:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1784047626.416982:0:3644:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1784047626.416990:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047626.417001:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000020:00000040:2.0:1784047626.417004:0:3644:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a75 00000020:00000040:2.0:1784047626.417007:0:3644:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cd0032c800 refcount=4 00000100:00080000:2.0:1784047626.417014:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1784047626.417017:0:3644:0:(genops.c:900:class_export_put()) PUTting export ffff99cd0032c800 : new refcount 3 00000100:00080000:2.0:1784047626.417029:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784047626.417033:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccd897f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1784047626.417040:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047636 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.417047:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870705709432320:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1784047626.417053:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd0c7e680 x1870705709432320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047636 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.417063:0:3644:0:(genops.c:1244:class_import_put()) import ffff99ccd897f800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1784047626.417077:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.417086:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709432832:0@lo:8:kworker.0 00000100:00000040:2.0:1784047626.417108:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.417115:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.417130:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee0380 x1870705709432832 msgsize 520 00000100:00100000:2.0:1784047626.417134:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.417151:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047651 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.417161:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5596 usecs (6 jiffies) 00000100:00000040:2.0:1784047626.417168:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.417392:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709433344:0@lo:8:kworker.0 00000100:00000040:2.0:1784047626.417407:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.417413:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.417428:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee0a80 x1870705709433344 msgsize 520 00000100:00100000:2.0:1784047626.417431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.417447:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047651 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.417456:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7542 usecs (8 jiffies) 00000100:00000040:1.0:1784047626.418511:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdd1dc00 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.418521:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709433088:12345-0@lo:400:kworker.0 Request processed in 1741us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.418529:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00000040:1.0:1784047626.418532:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897e000 : new rpc_count 0 00000020:00000040:1.0:1784047626.418543:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897e000 : new refcount 4 00000100:00100000:1.0:1784047626.418561:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00000040:1.0:1784047626.418565:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc5e57800 : new rpc_count 1 00000100:00000040:1.0:1784047626.418570:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc6d42680 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.418583:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709433600:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047626.418598:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709433600 00000100:00000040:1.0:1784047626.418631:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.418636:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.418666:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.418692:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:1.0:1784047626.418697:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc6d42680 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.418704:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870705709433600:12345-0@lo:400:kworker.0 Request processed in 126us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.418710:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00000040:1.0:1784047626.418713:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc5e57800 : new rpc_count 0 00000020:00000040:1.0:1784047626.418719:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5e57800 : new refcount 4 00000100:00100000:1.0:1784047626.418948:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433216 00000100:00100000:1.0:1784047626.418956:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433216 00000020:00000040:1.0:1784047626.418978:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:1.0:1784047626.418982:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=5 00000100:00000040:1.0:1784047626.418999:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1784047626.419018:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432704 00000100:00100000:1.0:1784047626.419093:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432704 00000020:00000040:1.0:1784047626.419095:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:1.0:1784047626.419097:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=7 00000100:00100000:1.0:1784047626.419121:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00000040:1.0:1784047626.419124:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00000100:00000040:1.0:1784047626.419128:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9ae9f80 x1870705709433216/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.419138:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709433216:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047626.419149:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709433216 00000100:00000040:1.0:1784047626.419154:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.419158:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.419241:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.419256:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:1.0:1784047626.419260:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9ae9f80 x1870705709433216/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.419267:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709433216:12345-0@lo:400:kworker.0 Request processed in 131us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.419273:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00000040:1.0:1784047626.419275:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:1.0:1784047626.419281:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 4 00000100:00100000:1.0:1784047626.419291:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00000040:1.0:1784047626.419293:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:1.0:1784047626.419297:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdd1d500 x1870705709432704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.419320:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709432704:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047626.419333:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709432704 00000100:00000040:1.0:1784047626.419338:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.419341:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.419358:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.419583:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:1.0:1784047626.419589:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdd1d500 x1870705709432704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.419596:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709432704:12345-0@lo:400:kworker.0 Request processed in 279us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.419602:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00000040:1.0:1784047626.419623:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:1.0:1784047626.419631:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 6 00000100:00100000:3.0:1784047626.419676:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433472 00000100:00100000:3.0:1784047626.419682:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433472 00000020:00000040:3.0:1784047626.419684:0:26180:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:3.0:1784047626.419687:0:26180:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000020:00000040:3.0:1784047626.419701:0:26180:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:3.0:1784047626.419715:0:26180:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1784047626.419735:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432960 00000100:00100000:3.0:1784047626.419738:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432960 00000020:00000040:3.0:1784047626.419740:0:26180:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:3.0:1784047626.419743:0:26180:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000100:00100000:3.0:1784047626.419773:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709432832 00000100:00100000:3.0:1784047626.419776:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709432832 00000020:00000040:3.0:1784047626.419777:0:26180:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f972 00000100:00100000:3.0:1784047626.419791:0:26180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433344 00000100:00100000:3.0:1784047626.419794:0:26180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433344 00000020:00000040:3.0:1784047626.419795:0:26180:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b1e 00000100:00100000:3.0:1784047626.419810:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00000040:3.0:1784047626.419813:0:26180:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:3.0:1784047626.419817:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef51dc00 x1870705709433472/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.419830:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709433472:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784047626.419841:0:26180:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709433472 00000100:00000040:3.0:1784047626.419846:0:26180:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:3.0:1784047626.419849:0:26180:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.419872:0:26180:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.419888:0:26180:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:3.0:1784047626.419893:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef51dc00 x1870705709433472/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.419900:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709433472:12345-0@lo:400:kworker.0 Request processed in 73us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047626.419906:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00000040:3.0:1784047626.419909:0:26180:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:3.0:1784047626.419918:0:26180:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00000100:00100000:3.0:1784047626.419926:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00000040:3.0:1784047626.419929:0:26180:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:3.0:1784047626.419933:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc6d41180 x1870705709432960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:2/0 lens 224/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.419956:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709432960:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784047626.419980:0:26180:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709432960 00000100:00000040:3.0:1784047626.419986:0:26180:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:3.0:1784047626.419990:0:26180:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.420009:0:26180:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.420334:0:26180:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:3.0:1784047626.420339:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc6d41180 x1870705709432960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.420348:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc6d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709432960:12345-0@lo:400:kworker.0 Request processed in 395us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047626.420355:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00000040:3.0:1784047626.420358:0:26180:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000020:00000040:3.0:1784047626.420366:0:26180:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00100000:3.0:1784047626.420376:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5089 00000100:00000040:3.0:1784047626.420380:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee0380 x1870705709432832/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.420388:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3644:x1870705709432832:12345-0@lo:8:kworker.0 00000020:00000040:3.0:1784047626.420406:0:26180:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 7 - find 00010000:00000040:3.0:1784047626.420411:0:26180:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1784047626.420414:0:26180:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99ccc4ac4d40) now 7 - find 00000100:00000040:3.0:1784047626.420425:0:26180:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:3.0:1784047626.420428:0:26180:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:3.0:1784047626.420431:0:26180:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.420452:0:26180:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.420492:0:26180:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:3.0:1784047626.420496:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0380 x1870705709432832/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047646 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.420505:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3644:x1870705709432832:12345-0@lo:8:kworker.0 Request processed in 115us (3373us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047626.420512:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5089 00000100:00100000:3.0:1784047626.420525:0:26180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5090 00000100:00000040:3.0:1784047626.420530:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee0a80 x1870705709433344/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.420538:0:26180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3644:x1870705709433344:12345-0@lo:8:kworker.0 00000020:00000040:3.0:1784047626.420546:0:26180:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 7 - find 00010000:00000040:3.0:1784047626.420549:0:26180:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1784047626.420551:0:26180:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99ccc4ac4d40) now 7 - find 00000100:00000040:3.0:1784047626.420559:0:26180:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:3.0:1784047626.420562:0:26180:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:3.0:1784047626.420565:0:26180:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.420581:0:26180:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.420594:0:26180:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 56 to 0@lo 00000100:00000040:3.0:1784047626.420597:0:26180:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0a80 x1870705709433344/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784047646 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.420950:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00080000:0.0:1784047626.422473:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784047626.422480:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00080000:0.0:1784047626.422486:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784047626.422490:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 16 - evictor 00000100:00080000:0.0:1784047626.422492:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1784047626.422494:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 10 - evictor 00000100:00000040:0.0:1784047626.422536:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1784047626.422647:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.422660:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.422666:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870705709433600:0@lo:400:kworker.0 00000100:00000040:2.0:1784047626.422684:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00000040:2.0:1784047626.422697:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.422704:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.422710:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709432704:0@lo:400:kworker.0 00000100:00000040:2.0:1784047626.422724:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:2.0:1784047626.422728:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.422735:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.422741:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709433472:0@lo:400:kworker.0 00000100:00000040:2.0:1784047626.422748:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060dc00 x1870705709433600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.422760:0:3645:0:(genops.c:1244:class_import_put()) import ffff99ccc5e52000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1784047626.422770:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce3d20380 x1870705709432704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.422777:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1784047626.422781:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccfdd30700 x1870705709433472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.422787:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1784047626.422801:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:2.0:1784047626.422821:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.422842:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.422860:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709432960:0@lo:400:kworker.0 00000100:00000040:2.0:1784047626.422866:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2c17480 x1870705709432960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047626.422874:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:3.0:1784047626.425069:0:26180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3644:x1870705709433344:12345-0@lo:8:kworker.0 Request processed in 67us (3176us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784047626.425083:0:26180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5090 00000100:00000040:3.0:1784047626.425165:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968756 00000100:00000040:3.0:1784047626.425185:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047651 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047626.425207:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047626.425211:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1784047626.425215:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047651 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.425223:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709432832:0@lo:8:kworker.0 00000100:00000040:3.0:1784047626.425238:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:3.0:1784047626.425243:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047651 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047626.425250:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784047626.425253:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1784047626.425257:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047651 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.425263:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709433344:0@lo:8:kworker.0 00000100:00000040:3.0:1784047626.425269:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2c16d80 x1870705709432832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047651 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.425279:0:3644:0:(genops.c:1244:class_import_put()) import ffff99cbc7a6e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784047626.425287:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2c17800 x1870705709433344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784047651 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.425294:0:3644:0:(genops.c:1244:class_import_put()) import ffff99ccf7599800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:1.0:1784047626.426198:0:96955:0:(genops.c:889:class_export_get()) GET export ffff99cd0032c800 refcount=4 00000020:00000040:1.0:1784047626.426215:0:96955:0:(genops.c:889:class_export_get()) GET export ffff99cd0032c800 refcount=5 00000100:00000040:1.0:1784047626.426296:0:96955:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.140@tcp 192.168.204.140@tcp cnt=1 00000020:01000004:1.0:1784047626.426322:0:96955:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784047626.426339:0:96955:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) 00000020:00000040:1.0:1784047626.426346:0:96955:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cd0032f800 with handle 0x4426598c0c776a83 to hash 00000020:00000040:1.0:1784047626.426354:0:96955:0:(genops.c:900:class_export_put()) PUTting export ffff99cd0032f800 : new refcount 1 00000020:00000040:1.0:1784047626.426370:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) now 2 - obd_device_list 00000020:00000080:1.0:1784047626.426377:0:96955:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1784047626.426520:0:96955:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cbc64c8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784047626.426525:0:96955:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cbc64c8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784047626.426528:0:96955:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cbc64c8800 3 00000020:00000040:1.0:1784047626.426545:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) now 3 - import 00000020:00000040:1.0:1784047626.426559:0:96955:0:(genops.c:1244:class_import_put()) import ffff99cbcaee1800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1784047626.426572:0:96955:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.426575:0:96955:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 57 to 0@lo 00000100:00000040:1.0:1784047626.426578:0:96955:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.140@tcp -> ffff99ccc8ec6fc0 00010000:00080000:1.0:1784047626.426583:0:96955:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbcaee1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.140@tcp at head 00000020:00000040:2.0:1784047626.427960:0:96956:0:(genops.c:889:class_export_get()) GET export ffff99cd0032c800 refcount=6 00000020:00000040:2.0:1784047626.427977:0:96956:0:(genops.c:889:class_export_get()) GET export ffff99cd0032c800 refcount=7 00000020:00000040:2.0:1784047626.427982:0:96956:0:(genops.c:900:class_export_put()) PUTting export ffff99cd0032c800 : new refcount 6 00010000:00010000:1.0:1784047626.432443:0:96955:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:1.0:1784047626.432553:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) now 4 - setup 00000020:00000080:1.0:1784047626.432558:0:96955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784047626.432602:0:96955:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1784047626.432625:0:96955:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cbc753f800 with handle 0x4426598c0c776a8a to hash 00000020:00000040:1.0:1784047626.432633:0:96955:0:(genops.c:889:class_export_get()) GET export ffff99cbc753f800 refcount=3 00000020:00000040:1.0:1784047626.432637:0:96955:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) now 5 - export 00000020:00000040:1.0:1784047626.432640:0:96955:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753f800 : new refcount 2 00000020:00000080:1.0:1784047626.432643:0:96955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4426598c0c776a8a 00000020:00000040:1.0:1784047626.432646:0:96955:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a8a 00000020:00000040:1.0:1784047626.432649:0:96955:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc753f800 refcount=3 00000100:00080000:1.0:1784047626.432658:0:96955:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1784047626.432662:0:96955:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 58 to 0@lo 00000020:00000040:1.0:1784047626.432664:0:96955:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a8a 00000020:00000040:1.0:1784047626.432666:0:96955:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc753f800 refcount=4 00000100:00000040:1.0:1784047626.432668:0:96955:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 59 to 0@lo 00000020:00000040:1.0:1784047626.432670:0:96955:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753f800 : new refcount 3 00000100:00080000:1.0:1784047626.432672:0:96955:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99cbcaee1800 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:1.0:1784047626.432687:0:96955:0:(genops.c:1231:class_import_get()) import ffff99cbcaee1800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:1.0:1784047626.432711:0:96955:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784047626.432726:0:96955:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006eedf27b] to pc [ptlrpcd_rcv+-1] req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784047626.432755:0:96955:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:1.0:1784047626.432765:0:96955:0:(genops.c:1231:class_import_get()) import ffff99cbcaee1800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1784047626.433465:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.433481:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.433489:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce4538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709432448:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.433510:0:52247:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3729) 00000100:00000040:0.0:1784047626.433557:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784047626.433561:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.433581:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.433587:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709433088:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.433603:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784047626.433623:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.433631:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.433637:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709432576:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.433649:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784047626.433653:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.433661:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.433668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709433216:0@lo:400:kworker.0 00000100:00000040:0.0:1784047626.433675:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce4538a80 x1870705709432448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.433687:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc753d000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1784047626.433695:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2c15f80 x1870705709433088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.433702:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbcaee6800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1784047626.433708:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce3d22300 x1870705709432576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.433727:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc753a800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1784047626.433734:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2c15c00 x1870705709433216/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.433741:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1784047626.434119:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.434132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870705709433728:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1784047626.434161:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784047636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.434169:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.434272:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cce4538a80 x1870705709433728 msgsize 520 00000100:00100000:0.0:1784047626.434277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:2.0:1784047626.434380:0:96955:0:(genops.c:889:class_export_get()) GET export ffff99cbc753f800 refcount=4 00000020:00000040:2.0:1784047626.434386:0:96955:0:(genops.c:889:class_export_get()) GET export ffff99cbc753f800 refcount=5 00000040:00080000:2.0:1784047626.434473:0:96955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:2.0:1784047626.434529:0:96944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1784047626.434567:0:96944:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:2.0:1784047626.434578:0:96944:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24b000 refcount=3 00010000:00010000:2.0:1784047626.434585:0:96944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a67 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047626.434596:0:96944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccec24b000/0x4426598c0c776a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776a67 expref: -99 pid: 96944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784047626.434665:0:96944:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784047626.434667:0:96944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047626.434668:0:96944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047626.434669:0:96944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047626.434670:0:96944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047626.434671:0:96944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047626.434672:0:96944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047626.434674:0:96944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047626.434675:0:96944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784047626.434678:0:96944:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1784047626.434681:0:96944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784047626.434682:0:96944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784047626.434686:0:96944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784047626.434687:0:96944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784047626.434688:0:96944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784047626.434689:0:96944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784047626.434690:0:96944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784047626.434691:0:96944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784047626.434691:0:96944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:2.0:1784047626.434695:0:96944:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 10000000:01000000:2.0:1784047626.434712:0:96944:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1784047626.434725:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.434734:0:96944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709433856:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1784047626.434749:0:96944:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047626.434756:0:96944:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047626.434777:0:96944:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc76b0850 x1870705709433856 msgsize 4848 00000100:00100000:2.0:1784047626.434781:0:96944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047626.434783:0:96944:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047626.434800:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.434823:0:96944:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc783b240 going to sleep for 11 seconds 00000100:00000040:0.0:1784047626.434923:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784047636 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.434935:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000020:00000040:2.0:1784047626.434997:0:96958:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753f800 : new refcount 4 00000100:00100000:1.0:1784047626.437347:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433728 00000100:00100000:1.0:1784047626.437359:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433728 00000020:00000040:1.0:1784047626.437362:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:1.0:1784047626.437471:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00000040:1.0:1784047626.437480:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cce4538a80 x1870705709433728/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1784047646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.437493:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870705709433728:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1784047626.437508:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 10 - find 00010000:00000040:1.0:1784047626.437521:0:67153:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1784047626.437528:0:67153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3724 last 0 00000020:00000040:1.0:1784047626.437537:0:67153:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cbc753c800 with handle 0x4426598c0c776a91 to hash 00000020:00000040:1.0:1784047626.437574:0:67153:0:(genops.c:889:class_export_get()) GET export ffff99cbc753c800 refcount=3 00000020:00000040:1.0:1784047626.437578:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 11 - export 00000020:00000040:1.0:1784047626.437581:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753c800 : new refcount 2 00000020:00000080:1.0:1784047626.437584:0:67153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4426598c0c776a91 00000020:00000040:1.0:1784047626.437586:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a91 00000020:00000040:1.0:1784047626.437588:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc753c800 refcount=3 00000001:00000040:1.0:1784047626.437599:0:67153:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.140@tcp 00000001:00000040:1.0:1784047626.437633:0:67153:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 18 00000020:00000040:1.0:1784047626.437638:0:67153:0:(genops.c:889:class_export_get()) GET export ffff99cbc753c800 refcount=4 00000001:00000040:1.0:1784047626.437640:0:67153:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 19 00000001:00000040:1.0:1784047626.437644:0:67153:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99ccecd71400) : new refcount 18 00000004:00100000:1.0:1784047626.437649:0:67153:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1784047626.437659:0:67153:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99ccd1cf2660 for nid 0@lo - ref 4 00000020:00000040:1.0:1784047626.437668:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 12 - import 00000020:00000040:1.0:1784047626.437674:0:67153:0:(genops.c:1244:class_import_put()) import ffff99ccf2d7e800 refcount=1 obd=lustre-MDT0001 00000020:00000040:1.0:1784047626.437680:0:67153:0:(genops.c:889:class_export_get()) GET export ffff99cbc753c800 refcount=5 00000100:00000040:1.0:1784047626.437683:0:67153:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99cbc753c800 : new rpc_count 1 00000100:00000040:1.0:1784047626.437699:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 60 to 0@lo 00000100:00000040:1.0:1784047626.437702:0:67153:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 60 to 0@lo 00000020:00000040:1.0:1784047626.437705:0:67153:0:(genops.c:889:class_export_get()) GET export ffff99cbc753c800 refcount=6 00000100:00000040:1.0:1784047626.437711:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00080000:1.0:1784047626.437720:0:67153:0:(import.c:65:import_set_state_nolock()) ffff99ccf2d7e800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1784047626.437724:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753c800 : new refcount 5 00000020:00000040:1.0:1784047626.437727:0:67153:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 12 - find 00010000:00000040:1.0:1784047626.437741:0:67153:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709433728 00000100:00000040:1.0:1784047626.437750:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:1.0:1784047626.437756:0:67153:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047626.437798:0:67153:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784047636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.437899:0:67153:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00000040:1.0:1784047626.437906:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce4538a80 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784047646 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.437915:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce4538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870705709433728:12345-0@lo:38:llog_process_th.0 Request processed in 423us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047626.437922:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00000040:1.0:1784047626.437926:0:67153:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbc753c800 : new rpc_count 0 00000020:00000040:1.0:1784047626.437935:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753c800 : new refcount 4 00000100:00100000:3.0:1784047626.438020:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:3.0:1784047626.438025:0:3644:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:3.0:1784047626.438031:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047626.438043:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:3.0:1784047626.438052:0:3644:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a8a 00000020:00000040:3.0:1784047626.438054:0:3644:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc753f800 refcount=5 00000100:00080000:3.0:1784047626.438062:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:3.0:1784047626.438064:0:3644:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753f800 : new refcount 4 00000100:00080000:3.0:1784047626.438068:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784047626.438070:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbcaee1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:3.0:1784047626.438077:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047636 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.438085:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd0c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870705709433728:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1784047626.438092:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd0c7e680 x1870705709433728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784047636 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.438102:0:3644:0:(genops.c:1244:class_import_put()) import ffff99cbcaee1800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1784047626.438197:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709433856 00000100:00100000:2.0:1784047626.438203:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709433856 00000020:00000040:2.0:1784047626.438205:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047626.438208:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:2.0:1784047626.438223:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047626.438253:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1784047626.438257:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047626.438261:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc76b0850 x1870705709433856/t0(0) o253->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 4848/0 e 0 to 0 dl 1784047637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047626.438273:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709433856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784047626.438304:0:94375:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784047626.438315:0:94375:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784047626.445406:0:94375:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784047626.445433:0:94375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:0.0:1784047626.446335:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709433856 00000100:00000040:0.0:1784047626.446352:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:0.0:1784047626.446361:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.446417:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.446460:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00000040:0.0:1784047626.446468:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc76b0850 x1870705709433856/t0(0) o253->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 4848/4768 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.446478:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc76b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:96944:x1870705709433856:12345-0@lo:253:mount.lustre.0 Request processed in 8206us (11698us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.446506:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:0.0:1784047626.446510:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.446537:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:1.0:1784047626.446722:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.446734:0:96944:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.446741:0:96944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e36843b-2016-43fe-8842-da5818d68597:96944:1870705709433856:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1784047626.446751:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784047626.446776:0:96944:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784047626.446780:0:96944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784047626.446781:0:96944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784047626.446782:0:96944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784047626.446784:0:96944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784047626.446785:0:96944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784047626.446786:0:96944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784047626.446787:0:96944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784047626.446789:0:96944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784047626.446791:0:96944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:1.0:1784047626.446794:0:96944:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee3b80 x1870705709433856/t0(0) o253->MGC192.168.204.140@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047626.446806:0:96944:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000020:02000000:1.0:1784047626.446818:0:96944:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:1.0:1784047626.446982:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:1.0:1784047626.447001:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:1.0:1784047626.447050:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:1.0:1784047626.447087:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:1.0:1784047626.447125:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:1.0:1784047626.447162:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:1.0:1784047626.447189:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:1.0:1784047626.447216:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:1.0:1784047626.447251:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:1.0:1784047626.447298:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 20000000:01000000:3.0:1784047626.447536:0:94377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784047626.447542:0:94377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:3.0:1784047626.447552:0:94377:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7200 count: 4 00000020:00000040:3.0:1784047626.447562:0:94377:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccec24ae00 with handle 0x4426598c0c776a98 to hash 00010000:00010000:3.0:1784047626.447569:0:94377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.447585:0:94377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b80 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.447621:0:94377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c775b9c expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.447631:0:94377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.447638:0:94377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.447653:0:94377:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccc34a7200) refcount = 4 00010000:00000040:3.0:1784047626.447655:0:94377:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784047626.447659:0:94377:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.447665:0:94377:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.447671:0:94377:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.447676:0:94377:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:3.0:1784047626.447678:0:94377:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784047626.447698:0:94377:0:(genops.c:1231:class_import_get()) import ffff99ccd001b000 refcount=2 obd=MGS 00010000:00010000:3.0:1784047626.447716:0:94377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 9 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.447730:0:94377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 9 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.447744:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.447757:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709433984:192.168.204.40@tcp:104: 00000100:00000040:3.0:1784047626.447779:0:94377:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047626.447788:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000020:00000040:3.0:1784047626.447853:0:94377:0:(genops.c:1231:class_import_get()) import ffff99ccc832a800 refcount=2 obd=MGS 00010000:00010000:3.0:1784047626.447869:0:94377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.447877:0:94377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 23 pid: 94375 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.447887:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.447895:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709434112:0@lo:104: 00000100:00000040:3.0:1784047626.447907:0:94377:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047626.447913:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.447934:0:94377:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef515180 x1870705709434112 msgsize 328 00000100:00100000:3.0:1784047626.447939:0:94377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.447958:0:94377:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1784047626.447983:0:94377:0:(genops.c:1231:class_import_get()) import ffff99ccc832a800 refcount=3 obd=MGS 00010000:00010000:3.0:1784047626.447992:0:94377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.448000:0:94377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 23 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.448013:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448022:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709434240:0@lo:104: 00000100:00000040:3.0:1784047626.448033:0:94377:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047626.448039:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.448058:0:94377:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef516a00 x1870705709434240 msgsize 328 00000100:00100000:3.0:1784047626.448062:0:94377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.448075:0:94377:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448087:0:94377:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cce3ba2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784047626.448108:0:95294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434112 00000100:00100000:3.0:1784047626.448115:0:95294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434112 00000020:00000040:3.0:1784047626.448118:0:95294:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c72f7a5 00000020:00000040:3.0:1784047626.448121:0:95294:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc48b9000 refcount=3 00000100:00000040:3.0:1784047626.448148:0:95294:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:3.0:1784047626.448173:0:95294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434240 00000100:00100000:3.0:1784047626.448177:0:95294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434240 00000020:00000040:3.0:1784047626.448179:0:95294:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c72f7a5 00000020:00000040:3.0:1784047626.448181:0:95294:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc48b9000 refcount=4 00000100:00100000:3.0:1784047626.448202:0:95294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00000040:3.0:1784047626.448207:0:95294:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc48b9000 : new rpc_count 1 00000100:00000040:3.0:1784047626.448212:0:95294:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef515180 x1870705709434112/t0(0) o104->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448225:0:95294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6e36843b-2016-43fe-8842-da5818d68597+4:94377:x1870705709434112:12345-0@lo:104: 00000020:00000040:3.0:1784047626.448234:0:95294:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccf6c47600 refcount=2 00010000:00010000:3.0:1784047626.448242:0:95294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.448260:0:95294:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:3.0:1784047626.448266:0:95294:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.448282:0:95294:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047626.448303:0:95294:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00010000:00010000:3.0:1784047626.448318:0:95294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:3.0:1784047626.448324:0:95294:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515180 x1870705709434112/t0(0) o104->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047626.448336:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448344:0:95294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6e36843b-2016-43fe-8842-da5818d68597+4:94377:x1870705709434112:12345-0@lo:104: Request processed in 118us (404us total) trans 0 rc 0/0 00000100:00000040:0.0:1784047626.448357:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448359:0:95294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00000040:3.0:1784047626.448365:0:95294:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc48b9000 : new rpc_count 0 00000100:00100000:0.0:1784047626.448373:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef514380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709434112:0@lo:104: 00000020:00000040:3.0:1784047626.448378:0:95294:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc48b9000 : new refcount 3 00000100:00100000:3.0:1784047626.448393:0:95294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00000040:3.0:1784047626.448396:0:95294:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc48b9000 : new rpc_count 1 00000100:00000040:3.0:1784047626.448401:0:95294:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef516a00 x1870705709434240/t0(0) o104->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448418:0:95294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6e36843b-2016-43fe-8842-da5818d68597+3:94377:x1870705709434240:12345-0@lo:104: 00000020:00000040:3.0:1784047626.448424:0:95294:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cd00600e00 refcount=2 00010000:00010000:3.0:1784047626.448429:0:95294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.448441:0:95294:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:3.0:1784047626.448445:0:95294:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.448460:0:95294:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047626.448486:0:95294:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00010000:00010000:3.0:1784047626.448495:0:95294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:3.0:1784047626.448499:0:95294:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef516a00 x1870705709434240/t0(0) o104->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448507:0:95294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:6e36843b-2016-43fe-8842-da5818d68597+3:94377:x1870705709434240:12345-0@lo:104: Request processed in 91us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047626.448513:0:95294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00000040:3.0:1784047626.448515:0:95294:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc48b9000 : new rpc_count 0 00000020:00000040:3.0:1784047626.448527:0:95294:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc48b9000 : new refcount 2 00010000:00010000:3.0:1784047626.448550:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784047626.448556:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.448564:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf6c47600 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:3.0:1784047626.448568:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784047626.448575:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccf6c47600 refcount=3 00010000:00010000:3.0:1784047626.448579:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784047626.448587:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784047626.448594:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1784047626.448598:0:6506:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:3.0:1784047626.448600:0:6506:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1784047626.448624:0:6506:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99cd00575800) refs 2 00000020:00000040:3.0:1784047626.448631:0:6506:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99ccf6c47600 with handle 0x4426598c0c775b9c from hash 00000020:00000040:3.0:1784047626.448641:0:6506:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00010000:00010000:3.0:1784047626.448651:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.448658:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1784047626.448668:0:6506:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003cca2fe8] to pc [ptlrpcd_00_02+2] req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047626.448669:0:16469:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784047626.448677:0:16469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.448687:0:16469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd00600e00 already unused, calling callback (ffffffffc1465c20) 10000000:00010000:0.0:1784047626.448690:0:16469:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.448695:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784047626.448699:0:16469:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cd00600e00 refcount=3 00010000:00010000:0.0:1784047626.448706:0:16469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784047626.448720:0:16469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.448725:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99ccf6c47600/0x4426598c0c775b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775ba3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784047626.448730:0:16469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:0.0:1784047626.448736:0:16469:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:0.0:1784047626.448740:0:16469:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1784047626.448743:0:16469:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99cceca8b600) refs 2 00010000:00010000:3.0:1784047626.448744:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047626.448748:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047626.448750:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1784047626.448750:0:16469:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99cd00600e00 with handle 0x4426598c0c775b80 from hash 00000100:00000040:3.0:1784047626.448762:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047626.448767:0:16469:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00100000:3.0:1784047626.448778:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709434368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047626.448781:0:16469:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.448789:0:16469:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1784047626.448794:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.448799:0:16469:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000d6ff6e3] to pc [ptlrpcd_00_03+3] req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.448813:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:0.0:1784047626.448823:0:16469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047626.448831:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cceca63b80 x1870705709434368 msgsize 328 00010000:00010000:0.0:1784047626.448831:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff99cd00600e00/0x4426598c0c775b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4426598c0c775b87 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047626.448841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000040:0.0:1784047626.448848:0:16469:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff99ccef591400 count: 0 00010000:00010000:0.0:1784047626.448861:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784047626.448863:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047626.448864:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047626.448867:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047626.448898:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1784047626.448903:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1784047626.448907:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.448927:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784047626.448928:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709434496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784047626.448943:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709434240:0@lo:104: 00000100:00000040:3.0:1784047626.448949:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.448957:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.448981:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cceca63100 x1870705709434496 msgsize 328 00000100:00100000:3.0:1784047626.448986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047626.449005:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.449037:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434368 00000100:00100000:3.0:1784047626.449040:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434368 00000020:00000040:3.0:1784047626.449042:0:26195:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047626.449045:0:26195:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:3.0:1784047626.449058:0:26195:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1784047626.449064:0:26195:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cd00600800 refcount=4 00010000:00010000:3.0:1784047626.449069:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 24 pid: 94375 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047626.449089:0:26195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434496 00000100:00100000:3.0:1784047626.449092:0:26195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434496 00000020:00000040:3.0:1784047626.449093:0:26195:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047626.449095:0:26195:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=25 00000020:00000040:3.0:1784047626.449103:0:26195:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccf6c47200 refcount=4 00010000:00010000:3.0:1784047626.449107:0:26195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 25 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047626.449122:0:26195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00000040:3.0:1784047626.449124:0:26195:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047626.449128:0:26195:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cceca63b80 x1870705709434368/t0(0) o103->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.449139:0:26195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709434368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784047626.449150:0:26195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784047626.449152:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000020:00000040:3.0:1784047626.449154:0:26195:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cd00600800 refcount=4 00000100:00000040:0.0:1784047626.449157:0:26194:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 2 00010000:00000040:3.0:1784047626.449158:0:26195:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7200 count: 5 00000100:00000040:0.0:1784047626.449165:0:26194:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cceca63100 x1870705709434496/t0(0) o103->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784047626.449166:0:26195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 25 pid: 94375 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.449188:0:26195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 25 pid: 94375 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047626.449193:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+25:3647:x1870705709434496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784047626.449209:0:26194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1784047626.449213:0:26195:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99cd00600800 with handle 0x4426598c0c775ba3 from hash 00010000:00010000:3.0:1784047626.449220:0:26195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600800/0x4426598c0c775ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775b9c expref: 25 pid: 94375 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784047626.449220:0:26194:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccf6c47200 refcount=4 00010000:00000040:0.0:1784047626.449225:0:26194:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7200 count: 7 00010000:00000040:3.0:1784047626.449233:0:26195:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff99ccc832d800 : new locks_count 17 00010000:00010000:0.0:1784047626.449234:0:26194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 25 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784047626.449239:0:26195:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 24 00010000:00010000:0.0:1784047626.449249:0:26194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 24 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784047626.449462:0:3640:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000040:1.0:1784047626.449561:0:96944:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:1.0:1784047626.449713:0:96944:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968778 00010000:00000040:3.0:1784047626.451064:0:26195:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff99ccec24ae00 00010000:00010000:3.0:1784047626.451073:0:26195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1784047626.451084:0:26195:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:3.0:1784047626.451090:0:26195:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047626.451134:0:26195:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.451164:0:26195:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00000040:3.0:1784047626.451170:0:26195:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca63b80 x1870705709434368/t0(0) o103->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.451180:0:26195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709434368:12345-0@lo:103:ldlm_bl.0 Request processed in 2042us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047626.451189:0:26195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00000040:3.0:1784047626.451192:0:26195:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 1 00000020:00000040:3.0:1784047626.451204:0:26195:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:1.0:1784047626.451495:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047626.451505:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047626.451528:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cceca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709434368:0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1784047626.451536:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cceca62300 x1870705709434368/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047626.451546:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:0.0:1784047626.453039:0:26194:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99ccf6c47200 with handle 0x4426598c0c775b87 from hash 00010000:00010000:0.0:1784047626.453054:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf6c47200/0x4426598c0c775b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4426598c0c775b80 expref: 23 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784047626.453065:0:26194:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff99ccc832d800 : new locks_count 16 00000020:00000040:0.0:1784047626.453068:0:26194:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00010000:00000040:0.0:1784047626.453075:0:26194:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff99ccec24ae00 00010000:00010000:0.0:1784047626.453079:0:26194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1784047626.453089:0:26194:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:0.0:1784047626.453095:0:26194:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047626.453136:0:26194:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047626.453163:0:26194:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00000040:0.0:1784047626.453168:0:26194:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca63100 x1870705709434496/t0(0) o103->6e36843b-2016-43fe-8842-da5818d68597@0@lo:2/0 lens 328/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.453179:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e36843b-2016-43fe-8842-da5818d68597+22:3647:x1870705709434496:12345-0@lo:103:ldlm_bl.0 Request processed in 3991us (4195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.453187:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00000040:0.0:1784047626.453191:0:26194:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:0.0:1784047626.453202:0:26194:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 21 00000100:00000040:1.0:1784047626.455506:0:3638:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784047626.455663:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbd0c7e680 x1870705689557888 msgsize 328 00000100:00100000:1.0:1784047626.455670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:3.0:1784047626.455838:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047626.455850:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047626.455858:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709434496:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1784047626.455865:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cd00416680 x1870705709434496/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047626.455886:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047626.456002:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047626.456014:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784047626.456021:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccef515c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94377:1870705709433984:192.168.204.40@tcp:104: 00000100:00000040:2.0:1784047626.456030:0:94377:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef514380 x1870705709434112/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1784047626.456038:0:94377:0:(genops.c:1244:class_import_put()) import ffff99ccc832a800 refcount=2 obd=MGS 00000100:00000040:2.0:1784047626.456046:0:94377:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef515f80 x1870705709434240/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1784047626.456053:0:94377:0:(genops.c:1244:class_import_put()) import ffff99ccc832a800 refcount=1 obd=MGS 00000100:00000040:2.0:1784047626.456057:0:94377:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccef515c00 x1870705709433984/t0(0) o104->MGS@192.168.204.40@tcp:15/16 lens 328/224 e 0 to 0 dl 1784047642 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1784047626.456064:0:94377:0:(genops.c:1244:class_import_put()) import ffff99ccd001b000 refcount=1 obd=MGS 00010000:00010000:2.0:1784047626.456076:0:94377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047626.456150:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689557888 00000100:00100000:0.0:1784047626.456159:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689557888 00000020:00000040:0.0:1784047626.456170:0:6504:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a45 00000020:00000040:0.0:1784047626.456175:0:6504:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001a800 refcount=10 00000100:00000040:0.0:1784047626.456193:0:6504:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:0.0:1784047626.456203:0:6504:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cd00600c00 refcount=4 00010000:00010000:0.0:1784047626.456209:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 10 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784047626.456252:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2600 00000100:00000040:0.0:1784047626.456257:0:6504:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001a800 : new rpc_count 1 00000100:00000040:0.0:1784047626.456262:0:6504:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbd0c7e680 x1870705689557888/t0(0) o103->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:2/0 lens 328/0 e 0 to 0 dl 1784047637 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.456275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2401:x1870705689557888:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784047626.456291:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1784047626.456294:0:6504:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cd00600c00 refcount=4 00010000:00000040:0.0:1784047626.456297:0:6504:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc34a7200 count: 3 00010000:00010000:0.0:1784047626.456302:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 10 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.456314:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 10 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784047626.456331:0:6504:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99cd00600c00 with handle 0x4426598c0c775c44 from hash 00010000:00010000:0.0:1784047626.456337:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd00600c00/0x4426598c0c775c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae507 expref: 10 pid: 94372 timeout: 3824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784047626.456344:0:6504:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff99ccd001a800 : new locks_count 3 00000020:00000040:0.0:1784047626.456346:0:6504:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 9 00010000:00000040:0.0:1784047626.456354:0:6504:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff99ccec24ae00 00010000:00010000:0.0:1784047626.456359:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1784047626.456373:0:6504:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccc34a7200) refcount = 2 00010000:00010000:0.0:1784047626.456378:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784047626.456397:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013845937s 00000020:00000040:0.0:1784047626.456401:0:6504:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24ae00 refcount=5 00010000:00010000:0.0:1784047626.456404:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.456412:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.456418:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.456425:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.456432:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccec24ae00 already unused, calling callback (ffffffffc0e4a230) 00010000:00010000:0.0:1784047626.456436:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1784047626.456442:0:6504:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccec24ae00 refcount=6 00010000:00010000:0.0:1784047626.456446:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784047626.456449:0:96960:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96960 00010000:02000000:2.0:1784047626.456461:0:96960:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1784047626.456466:0:96960:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1784047626.456469:0:96960:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:0.0:1784047626.456473:0:6504:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff99ccec24ae00 with handle 0x4426598c0c776a98 from hash 00010000:00010000:0.0:1784047626.456480:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784047626.456500:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1784047626.456510:0:6504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00010000:00010000:3.0:1784047626.456514:0:94377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784047626.456518:0:6504:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00010000:00010000:3.0:1784047626.456527:0:94377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047626.456535:0:94377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccec24ae00/0x4426598c0c776a98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047626.456542:0:94377:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff99ccc34a7200 count: 0 00000100:00000040:0.0:1784047626.456562:0:6504:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047626.456568:0:6504:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd0c7e680 x1870705689557888/t0(0) o103->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:2/0 lens 328/224 e 0 to 0 dl 1784047637 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047626.456579:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:2401:x1870705689557888:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 305us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047626.456588:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2600 00000100:00000040:0.0:1784047626.456591:0:6504:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001a800 : new rpc_count 0 00000020:00000040:0.0:1784047626.456601:0:6504:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 8 00000020:01000004:0.0:1784047626.456694:0:96944:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:0.0:1784047626.456701:0:96944:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff99cbc79ef600 : new refcount 2 00000040:00000040:0.0:1784047626.456705:0:96944:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff99cbc79ef600 : new refcount 1 00000020:00000040:0.0:1784047626.456737:0:96944:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc64c8000 : new refcount 1 00000020:00000040:0.0:1784047626.456749:0:96944:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.140@tcp (ffff99ccc5e4b380) now 6 - mgc_fs 10000000:01000000:0.0:1784047626.456752:0:96944:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784047626.456778:0:96944:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784047626.456801:0:96944:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1784047626.457746:0:96944:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784047626.457991:0:96944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047626.519836:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784047627.271224:0:97009:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784047627.271435:0:97009:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784047627.548033:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:00000040:3.0:1784047628.017424:0:97057:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 10000000:00000040:2.0:1784047628.115052:0:6515:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99cceca8b600) refs 2 10000000:01000000:2.0:1784047628.115062:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784047628.115065:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cbc79c6800 from 130 10000000:01000000:2.0:1784047628.115077:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1784047628.115085:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:2.0:1784047628.115119:0:6515:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccebdbcc00 with handle 0x4426598c0c776a9f to hash 00010000:00010000:2.0:1784047628.115129:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047628.115141:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047628.115152:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784047628.115178:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.115192:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709434624:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1784047628.115218:0:6515:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.115227:0:6515:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047628.115270:0:6515:0:(events.c:337:request_in_callback()) incoming req@ffff99ccd2facc50 x1870705709434624 msgsize 328 00000100:00100000:2.0:1784047628.115275:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047628.115277:0:6515:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047628.115307:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.115335:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cbc79ef600 going to sleep for 11 seconds 00000100:00100000:3.0:1784047628.115475:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434624 00000100:00100000:3.0:1784047628.115483:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434624 00000020:00000040:3.0:1784047628.115485:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047628.115489:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=22 00000100:00000040:3.0:1784047628.115513:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047628.115545:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:3.0:1784047628.115551:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047628.115556:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccd2facc50 x1870705709434624/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.115569:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+22:6515:x1870705709434624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784047628.115581:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:3.0:1784047628.115592:0:94374:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccec24b600 with handle 0x4426598c0c776aa6 to hash 00010000:00010000:3.0:1784047628.115597:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccec24b600/0x4426598c0c776aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776a9f expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784047628.116049:0:94374:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99ccc832d800 : new locks_count 17 00000020:00000040:3.0:1784047628.116054:0:94374:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=23 00010000:00000040:3.0:1784047628.116078:0:94374:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccfa64fb00) refcount = 1 00010000:00010000:3.0:1784047628.116084:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccec24b600/0x4426598c0c776aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776a9f expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047628.116097:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccec24b600/0x4426598c0c776aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a9f expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784047628.116107:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccec24b600, rc 0) 00010000:00000040:3.0:1784047628.116110:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709434624 00000100:00000040:3.0:1784047628.116120:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:3.0:1784047628.116126:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047628.116150:0:94374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047628.117822:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00000040:3.0:1784047628.117835:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccd2facc50 x1870705709434624/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 328/344 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.117849:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccd2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709434624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2281us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047628.117859:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:3.0:1784047628.117862:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:3.0:1784047628.117879:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:1.0:1784047628.120502:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.120519:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.120528:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc8ee1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709434624:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.120538:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047628.120552:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebdbcc00 refcount=4 00010000:00000040:1.0:1784047628.120561:0:6515:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99ccebdbcc00, remote cookie: 0x4426598c0c776aa6, flags: 0x0 00010000:00000040:1.0:1784047628.120571:0:6515:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccc3e94000) refcount = 1 00010000:00010000:1.0:1784047628.120576:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776aa6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.120588:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776aa6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784047628.120598:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc8ee1f80 x1870705709434624/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047628.120631:0:6515:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:00000040:1.0:1784047628.120642:0:6515:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99cceca8b600) refs 3 00000020:00000040:1.0:1784047628.120646:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebdbcc00 refcount=3 00000020:00000040:1.0:1784047628.120834:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:1.0:1784047628.120857:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:1.0:1784047628.120949:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.120964:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc44f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709434752:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.120996:0:6515:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.121003:0:6515:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047628.121045:0:6515:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef859c50 x1870705709434752 msgsize 304 00000100:00100000:1.0:1784047628.121050:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047628.121052:0:6515:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784047628.121138:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.121179:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047628.121281:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434752 00000100:00100000:2.0:1784047628.121287:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434752 00000020:00000040:2.0:1784047628.121290:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047628.121294:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:2.0:1784047628.121314:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047628.121426:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1784047628.121436:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047628.121442:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef859c50 x1870705709434752/t0(0) o256->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 304/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.121455:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709434752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784047628.121478:0:94375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1784047628.121489:0:94375:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1784047628.121496:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784047628.121499:0:94375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000020:00000040:2.0:1784047628.121505:0:94375:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=24 00000020:00000040:2.0:1784047628.121775:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00010000:00000040:2.0:1784047628.121792:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709434752 00000100:00000040:2.0:1784047628.121802:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:2.0:1784047628.121808:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047628.121825:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.121889:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00000040:2.0:1784047628.121895:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef859c50 x1870705709434752/t0(0) o256->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 304/240 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.121903:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709434752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 451us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047628.121911:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1784047628.121914:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047628.121924:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 22 00000100:00000040:1.0:1784047628.122053:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.122062:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.122070:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.122078:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc44f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709434752:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.122085:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784047628.122099:0:6515:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 130, more 0. 10000000:00000040:1.0:1784047628.122111:0:6515:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784047628.122125:0:6515:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.140@tcp has 192.168.204.140@tcp. 10000000:00000040:1.0:1784047628.122208:0:6515:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1784047628.122213:0:6515:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99ccf7599800 already not connected (conn 5, was 0): DISCONN 00000100:00000040:1.0:1784047628.122224:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:1.0:1784047628.122227:0:6515:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:1.0:1784047628.122229:0:6515:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.140@tcp -> ffff99ccc8ec6fc0 00010000:00080000:1.0:1784047628.122232:0:6515:0:(ldlm_lib.c:85:import_set_conn()) imp ffff99ccf7599800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.140@tcp, moved to head 00010000:00000040:1.0:1784047628.122236:0:6515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000100:00080000:1.0:1784047628.122240:0:6515:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1784047628.122245:0:6515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 60 to 0@lo 00000100:00000040:1.0:1784047628.122247:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000020:00000040:1.0:1784047628.122249:0:6515:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b17 00000020:00000040:1.0:1784047628.122252:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5c03000 refcount=4 00000100:00000040:1.0:1784047628.122255:0:6515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 60 to 0@lo 00000100:00000040:1.0:1784047628.122257:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 61 to 0@lo 00000020:00000040:1.0:1784047628.122259:0:6515:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5c03000 : new refcount 3 00000100:00080000:1.0:1784047628.122261:0:6515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccf7599800 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:1.0:1784047628.122275:0:6515:0:(genops.c:1231:class_import_get()) import ffff99ccf7599800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1784047628.122291:0:6515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784047628.122304:0:6515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000128e47c6] to pc [ptlrpcd_rcv+-1] req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784047628.122397:0:6515:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 130/130 for lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784047628.122407:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccc44f2d80 x1870705709434752/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047628.122426:0:6515:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:1.0:1784047628.122429:0:6515:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:01000000:1.0:1784047628.122449:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1784047628.122454:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99ccebdbcc00 refcount=3 00010000:00010000:1.0:1784047628.122460:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776aa6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.122468:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776aa6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047628.122474:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784047628.122477:0:6515:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99cd00575800) refs 2 10000000:00000040:1.0:1784047628.122480:0:6515:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99cceca8b600) refs 3 10000000:01000000:1.0:1784047628.122482:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 00000100:00100000:3.0:1784047628.122485:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709434880:0@lo:8:ll_cfg_requeue.0 10000000:01000000:1.0:1784047628.122485:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ccc355c000 from 130 10000000:01000000:1.0:1784047628.122487:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:1.0:1784047628.122492:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:3.0:1784047628.122503:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047653 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1784047628.122503:0:6515:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccc3e94000 count: 2 00000100:00000040:3.0:1784047628.122510:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1784047628.122510:0:6515:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cce3b88400 with handle 0x4426598c0c776aad to hash 00010000:00010000:1.0:1784047628.122516:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.122523:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784047628.122528:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cceca60e00 x1870705709434880 msgsize 520 00010000:00010000:1.0:1784047628.122532:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784047628.122537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047628.122546:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.122554:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709435008:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.122571:0:6515:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.122577:0:6515:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047628.122594:0:6515:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef859850 x1870705709435008 msgsize 328 00000100:00100000:1.0:1784047628.122598:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047628.122600:0:6515:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784047628.122696:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.122717:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00000040:3.0:1784047628.126966:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047653 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047628.126997:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7731 usecs (8 jiffies) 00000100:00100000:2.0:1784047628.127129:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709434880 00000100:00100000:2.0:1784047628.127139:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709434880 00000020:00000040:2.0:1784047628.127143:0:26189:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b1e 00000100:00100000:2.0:1784047628.127203:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5091 00000100:00000040:2.0:1784047628.127211:0:26189:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cceca60e00 x1870705709434880/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.127229:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3644:x1870705709434880:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1784047628.127250:0:26189:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 7 - find 00010000:00000040:2.0:1784047628.127262:0:26189:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1784047628.127270:0:26189:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff99ccfe6b8800, cookie 0x4426598c0c776a44 00010000:00080000:2.0:1784047628.127274:0:26189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294968774 exp ffff99ccfe6b8800 cur 3726 last 1784047626 00010000:02000400:2.0:1784047628.127284:0:26189:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:2.0:1784047628.127290:0:26189:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:2.0:1784047628.127313:0:26189:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.140@tcp 00000001:00000040:2.0:1784047628.127318:0:26189:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 19 00000020:00000040:2.0:1784047628.127322:0:26189:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6b8800 refcount=4 00000001:00000040:2.0:1784047628.127324:0:26189:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 20 00000001:00000040:2.0:1784047628.127328:0:26189:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99ccecd71400) : new refcount 19 00002000:00100000:2.0:1784047628.127331:0:26189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ccfe6b8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784047628.127336:0:26189:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784047628.127339:0:26189:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:2.0:1784047628.127349:0:26189:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99cce4b4d7e0 for nid 0@lo - ref 2 00000020:00000040:2.0:1784047628.127440:0:26189:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 8 - import 00000020:00000040:2.0:1784047628.127447:0:26189:0:(genops.c:1244:class_import_put()) import ffff99ccfddd5000 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1784047628.127454:0:26189:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6b8800 refcount=5 00000100:00000040:2.0:1784047628.127456:0:26189:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99ccfe6b8800 : new rpc_count 1 00000100:00000040:2.0:1784047628.127460:0:26189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:2.0:1784047628.127463:0:26189:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000020:00000040:2.0:1784047628.127466:0:26189:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6b8800 refcount=6 00000100:00000040:2.0:1784047628.127471:0:26189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00000100:00080000:2.0:1784047628.127479:0:26189:0:(import.c:65:import_set_state_nolock()) ffff99ccfddd5000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1784047628.127484:0:26189:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6b8800 : new refcount 5 00000020:00000040:2.0:1784047628.127492:0:26189:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99ccc4ac4d40) now 8 - find 00010000:00000040:2.0:1784047628.127506:0:26189:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968774, transno 0, xid 1870705709434880 00000100:00000040:2.0:1784047628.127515:0:26189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000100:00000040:2.0:1784047628.127520:0:26189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047628.127558:0:26189:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047653 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.127577:0:26189:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00000100:00000040:2.0:1784047628.127582:0:26189:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca60e00 x1870705709434880/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784047648 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.127591:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709434880:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 363us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047628.127598:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5091 00000100:00000040:2.0:1784047628.127601:0:26189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6b8800 : new rpc_count 0 00000020:00000040:2.0:1784047628.127640:0:26189:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6b8800 : new refcount 4 00000100:00100000:2.0:1784047628.127659:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435008 00000100:00100000:2.0:1784047628.127663:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435008 00000020:00000040:2.0:1784047628.127665:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047628.127668:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=23 00000100:00000040:2.0:1784047628.127680:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047628.127698:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:2.0:1784047628.127700:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:2.0:1784047628.127705:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef859850 x1870705709435008/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.127716:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+23:6515:x1870705709435008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784047628.127725:0:94372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1784047628.127736:0:94372:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccfa64fb00 count: 2 00000020:00000040:2.0:1784047628.127743:0:94372:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99ccebdbd800 with handle 0x4426598c0c776ab4 to hash 00010000:00010000:2.0:1784047628.127749:0:94372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccebdbd800/0x4426598c0c776ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4426598c0c776aad expref: -99 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784047628.128116:0:94372:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99ccc832d800 : new locks_count 18 00000020:00000040:2.0:1784047628.128119:0:94372:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=24 00010000:00000040:2.0:1784047628.128137:0:94372:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccfa64fb00) refcount = 2 00010000:00000040:2.0:1784047628.128140:0:94372:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784047628.128144:0:94372:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccec24b600/0x4426598c0c776aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a9f expref: 24 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047628.128151:0:94372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccebdbd800/0x4426598c0c776ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4426598c0c776aad expref: 24 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047628.128162:0:94372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccebdbd800/0x4426598c0c776ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776aad expref: 24 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784047628.128172:0:94372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccebdbd800, rc 0) 00010000:00000040:2.0:1784047628.128175:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709435008 00000100:00000040:2.0:1784047628.128180:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000100:00000040:2.0:1784047628.128184:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047628.128207:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.128228:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00000100:00000040:2.0:1784047628.128233:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef859850 x1870705709435008/t0(0) o101->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 328/344 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.128242:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709435008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 527us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047628.128248:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:2.0:1784047628.128250:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047628.128256:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00010000:00080000:3.0:1784047628.128450:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.128460:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968774 gen 2 00000100:00000040:3.0:1784047628.128467:0:3644:0:(client.c:3168:ptlrpc_free_committed()) @@@ commit (last_committed 4294968774) req@ffff99ccfde0c380 x1870705709416192/t4294968774(4294968774) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784047613 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047628.128476:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccfde0c380 x1870705709416192/t4294968774(4294968774) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784047613 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047628.128487:0:3644:0:(genops.c:1244:class_import_put()) import ffff99ccf7599800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1784047628.128494:0:3644:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:3.0:1784047628.128500:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047628.128511:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:3.0:1784047628.128513:0:3644:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b17 00000020:00000040:3.0:1784047628.128517:0:3644:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5c03000 refcount=4 00000020:00000040:3.0:1784047628.128522:0:3644:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5c03000 : new refcount 3 00000100:00080000:3.0:1784047628.128528:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784047628.128532:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1784047628.128535:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968774 gen 2 00000100:00000040:3.0:1784047628.128537:0:3644:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1784047628.128539:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99ccf7599800 from lustre-OST0000_UUID committed 4294968774 last 0 00000100:00080000:3.0:1784047628.128543:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1784047628.128546:0:3644:0:(genops.c:1231:class_import_get()) import ffff99ccf7599800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1784047628.129103:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.129120:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709434880:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1784047628.129127:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5a25880 x1870705709434880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047628.129136:0:3644:0:(genops.c:1244:class_import_put()) import ffff99ccf7599800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:3.0:1784047628.129189:0:97068:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1784047628.129197:0:97068:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1784047628.129203:0:97068:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1784047628.129240:0:97068:0:(import.c:65:import_set_state_nolock()) ffff99ccf7599800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1784047628.129247:0:97068:0:(genops.c:1231:class_import_get()) import ffff99ccf7599800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1784047628.129269:0:97068:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000079da5045] to pc [ptlrpcd_rcv+-1] req@ffff99cceca60a80 x1870705709435136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047628.129281:0:97068:0:(genops.c:1244:class_import_put()) import ffff99ccf7599800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784047628.129292:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.129301:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.129308:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709435008:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.129316:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047628.129328:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cce3b88400 refcount=4 00010000:00000040:1.0:1784047628.129334:0:6515:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff99cce3b88400, remote cookie: 0x4426598c0c776ab4, flags: 0x0 00010000:00000040:1.0:1784047628.129341:0:6515:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccc3e94000) refcount = 2 00010000:00000040:1.0:1784047628.129344:0:6515:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784047628.129347:0:6515:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.140@tcp lock: ffff99ccebdbcc00/0x4426598c0c776a9f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776aa6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.129355:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776ab4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.129365:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4426598c0c776ab4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784047628.129381:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5a27b80 x1870705709435008/t0(0) o101->MGC192.168.204.140@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784047644 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047628.129389:0:6515:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:00000040:1.0:1784047628.129396:0:6515:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff99cd00575800) refs 3 00000020:00000040:1.0:1784047628.129399:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cce3b88400 refcount=3 00000020:00000040:1.0:1784047628.129415:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:1.0:1784047628.129427:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=5 obd=MGC192.168.204.140@tcp 00000100:00000040:1.0:1784047628.129441:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.129451:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709435264:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.129480:0:6515:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.129487:0:6515:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047628.129522:0:6515:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef85b450 x1870705709435264 msgsize 304 00000100:00100000:1.0:1784047628.129527:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047628.129528:0:6515:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784047628.129555:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.129580:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cceca60a80 x1870705709435136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.129582:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccd085e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784047628.129590:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cceca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870705709435136:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1784047628.129628:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff99cceca60a80 x1870705709435136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047644 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.129646:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047628.129667:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee1c00 x1870705709435136 msgsize 224 00000100:00100000:2.0:1784047628.129671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047628.129692:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cceca60a80 x1870705709435136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047644 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.129703:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7728 usecs (8 jiffies) 00000100:00100000:3.0:1784047628.130104:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435264 00000100:00100000:3.0:1784047628.130111:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435264 00000020:00000040:3.0:1784047628.130114:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:3.0:1784047628.130117:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00000040:3.0:1784047628.130136:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047628.130163:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:3.0:1784047628.130168:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00000040:3.0:1784047628.130173:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef85b450 x1870705709435264/t0(0) o256->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 304/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.130185:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709435264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784047628.130206:0:94375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:3.0:1784047628.130221:0:94375:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1784047628.130228:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784047628.130230:0:94375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000020:00000040:3.0:1784047628.130236:0:94375:0:(genops.c:889:class_export_get()) GET export ffff99ccc832d800 refcount=25 00000020:00000040:3.0:1784047628.130285:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 24 00010000:00000040:3.0:1784047628.130312:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709435264 00000100:00000040:3.0:1784047628.130322:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000100:00000040:3.0:1784047628.130327:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1784047628.130330:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435136 00000100:00100000:1.0:1784047628.130334:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435136 00000020:00000040:1.0:1784047628.130335:0:26182:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a44 00000020:00000040:1.0:1784047628.130338:0:26182:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6b8800 refcount=5 00000100:00000040:3.0:1784047628.130342:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.130355:0:26182:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:3.0:1784047628.130368:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00000100:00100000:1.0:1784047628.130371:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00000040:3.0:1784047628.130373:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef85b450 x1870705709435264/t0(0) o256->6e36843b-2016-43fe-8842-da5818d68597@0@lo:4/0 lens 304/240 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.130374:0:26182:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6b8800 : new rpc_count 1 00000100:00000040:1.0:1784047628.130378:0:26182:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee1c00 x1870705709435136/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.130393:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:6515:x1870705709435264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047628.130401:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784047628.130401:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709435136:12345-0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1784047628.130404:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:1.0:1784047628.130409:0:26182:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc8ee1c00 x1870705709435136/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047628.130414:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00010000:00000040:1.0:1784047628.130417:0:26182:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6b8800 : new rpc_count 2 00010000:00080000:1.0:1784047628.130420:0:26182:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cbc8ee1c00 x1870705709435136/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.130432:0:26182:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee1c00 x1870705709435136/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.130440:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1870705709435136:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (771us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.130445:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00000040:1.0:1784047628.130448:0:26182:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6b8800 : new rpc_count 1 00000100:00000040:1.0:1784047628.130477:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.130486:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.130494:0:6515:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.130501:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e36843b-2016-43fe-8842-da5818d68597:6515:1870705709435264:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1784047628.130508:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784047628.130519:0:6515:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 130, more 0. 10000000:00000040:1.0:1784047628.130531:0:6515:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1784047628.130547:0:6515:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.140@tcp has 192.168.204.140@tcp. 10000000:00000040:1.0:1784047628.130561:0:6515:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1784047628.130566:0:6515:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff99cbc7a6e000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:1.0:1784047628.130576:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000100:00000040:1.0:1784047628.130579:0:6515:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000100:00000040:1.0:1784047628.130581:0:6515:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.140@tcp -> ffff99ccc8ec6fc0 00010000:00080000:1.0:1784047628.130585:0:6515:0:(ldlm_lib.c:85:import_set_conn()) imp ffff99cbc7a6e000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.140@tcp, moved to head 00010000:00000040:1.0:1784047628.130589:0:6515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00000100:00080000:1.0:1784047628.130593:0:6515:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1784047628.130597:0:6515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:1.0:1784047628.130599:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00010000:00080000:2.0:1784047628.130600:0:96960:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:1.0:1784047628.130602:0:6515:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f95d 00000020:00000040:1.0:1784047628.130620:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccec31f000 refcount=4 00000100:00000040:1.0:1784047628.130623:0:6515:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 62 to 0@lo 00000100:00000040:1.0:1784047628.130625:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 63 to 0@lo 00000020:00000040:1.0:1784047628.130627:0:6515:0:(genops.c:900:class_export_put()) PUTting export ffff99ccec31f000 : new refcount 3 00000100:00080000:1.0:1784047628.130630:0:6515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99cbc7a6e000 using connection 192.168.204.140@tcp/0@lo 00000020:00000040:1.0:1784047628.130643:0:6515:0:(genops.c:1231:class_import_get()) import ffff99cbc7a6e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1784047628.130668:0:6515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784047628.130688:0:6515:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000128e47c6] to pc [ptlrpcd_rcv+-1] req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784047628.130707:0:6515:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 130/130 for lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1784047628.130714:0:6515:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5a27b80 x1870705709435264/t0(0) o256->MGC192.168.204.140@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784047644 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047628.130723:0:6515:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000020:00000040:1.0:1784047628.130726:0:6515:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 10000000:01000000:1.0:1784047628.130744:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1784047628.130753:0:6515:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff99cce3b88400 refcount=3 00010000:00010000:1.0:1784047628.130759:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776ab4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.130768:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff99cce3b88400/0x4426598c0c776aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4426598c0c776ab4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784047628.130772:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784047628.130778:0:6515:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff99cd00575800) refs 3 00000100:00100000:2.0:1784047628.130781:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709435392:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1784047628.130798:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047653 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.130806:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047628.130822:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee1f80 x1870705709435392 msgsize 520 00000100:00100000:2.0:1784047628.130827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047628.130847:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047653 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.130865:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5617 usecs (6 jiffies) 00000100:00100000:1.0:1784047628.131404:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435392 00000100:00100000:1.0:1784047628.131411:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435392 00000020:00000040:1.0:1784047628.131413:0:26185:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f972 00000100:00100000:1.0:1784047628.131452:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5092 00000100:00000040:1.0:1784047628.131458:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee1f80 x1870705709435392/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.131467:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3644:x1870705709435392:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1784047628.131482:0:26185:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 8 - find 00010000:00000040:1.0:1784047628.131491:0:26185:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1784047628.131498:0:26185:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99ccfdd8d800, cookie 0x4426598c0c776a3d 00010000:00080000:1.0:1784047628.131503:0:26185:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99ccfdd8d800 cur 3726 last 1784047626 00000001:00000040:1.0:1784047628.131515:0:26185:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.140@tcp 00000001:00000040:1.0:1784047628.131520:0:26185:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 20 00000020:00000040:1.0:1784047628.131524:0:26185:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd8d800 refcount=4 00000001:00000040:1.0:1784047628.131526:0:26185:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 21 00000001:00000040:1.0:1784047628.131529:0:26185:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99ccecd71400) : new refcount 20 00002000:00100000:1.0:1784047628.131532:0:26185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99ccfdd8d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1784047628.131536:0:26185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1784047628.131539:0:26185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1784047628.131548:0:26185:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99cce4b4d7e0 for nid 0@lo - ref 3 00000020:00000040:1.0:1784047628.131563:0:26185:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 9 - import 00000020:00000040:1.0:1784047628.131571:0:26185:0:(genops.c:1244:class_import_put()) import ffff99ccd8416800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1784047628.131577:0:26185:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd8d800 refcount=5 00000100:00000040:1.0:1784047628.131579:0:26185:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99ccfdd8d800 : new rpc_count 1 00000100:00000040:1.0:1784047628.131583:0:26185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000100:00000040:1.0:1784047628.131585:0:26185:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc8ec6fc0 refcount 64 to 0@lo 00000020:00000040:1.0:1784047628.131587:0:26185:0:(genops.c:889:class_export_get()) GET export ffff99ccfdd8d800 refcount=6 00000100:00000040:1.0:1784047628.131592:0:26185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00080000:1.0:1784047628.131600:0:26185:0:(import.c:65:import_set_state_nolock()) ffff99ccd8416800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1784047628.131626:0:26185:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd8d800 : new refcount 5 00000020:00000040:1.0:1784047628.131630:0:26185:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99ccc4ac4d40) now 9 - find 00010000:00000040:1.0:1784047628.131640:0:26185:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968756, transno 0, xid 1870705709435392 00000100:00000040:1.0:1784047628.131647:0:26185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047628.131650:0:26185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047628.132002:0:26185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784047653 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047628.132028:0:26185:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047628.132034:0:26185:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee1f80 x1870705709435392/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784047648 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.132042:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1870705709435392:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 575us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047628.132049:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5092 00000100:00000040:1.0:1784047628.132052:0:26185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfdd8d800 : new rpc_count 0 00000020:00000040:1.0:1784047628.132060:0:26185:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd8d800 : new refcount 4 00010000:00080000:3.0:1784047628.132313:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047628.132322:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968756 00000100:00000040:3.0:1784047628.132325:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784047628.132335:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:3.0:1784047628.132337:0:3644:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f95d 00000020:00000040:3.0:1784047628.132340:0:3644:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccec31f000 refcount=4 00000020:00000040:3.0:1784047628.132347:0:3644:0:(genops.c:900:class_export_put()) PUTting export ffff99ccec31f000 : new refcount 3 00000100:00080000:3.0:1784047628.132351:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784047628.132354:0:3644:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1784047628.132357:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968756 gen 2 00000100:00000040:3.0:1784047628.132359:0:3644:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1784047628.132363:0:3644:0:(recover.c:53:ptlrpc_replay_next()) import ffff99cbc7a6e000 from lustre-OST0000_UUID committed 4294968756 last 0 00000100:00080000:3.0:1784047628.132365:0:3644:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1784047628.132368:0:3644:0:(genops.c:1231:class_import_get()) import ffff99cbc7a6e000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784047628.133213:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.133231:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709435392:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1784047628.133239:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5a25880 x1870705709435392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784047653 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047628.133250:0:3644:0:(genops.c:1244:class_import_put()) import ffff99cbc7a6e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:2.0:1784047628.133314:0:97069:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1784047628.133318:0:97069:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1784047628.133323:0:97069:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1784047628.133361:0:97069:0:(import.c:65:import_set_state_nolock()) ffff99cbc7a6e000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1784047628.133368:0:97069:0:(genops.c:1231:class_import_get()) import ffff99cbc7a6e000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1784047628.133387:0:97069:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db8eb0ee] to pc [ptlrpcd_rcv+-1] req@ffff99cbc8ee3b80 x1870705709435520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047628.133406:0:97069:0:(genops.c:1244:class_import_put()) import ffff99cbc7a6e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784047628.133540:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc8ee3b80 x1870705709435520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047628.133551:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc8ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870705709435520:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1784047628.133577:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff99cbc8ee3b80 x1870705709435520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047644 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047628.133586:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047628.133906:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff99cceca61f80 x1870705709435520 msgsize 224 00000100:00100000:3.0:1784047628.133912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784047628.133952:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc8ee3b80 x1870705709435520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047644 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047628.133965:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5607 usecs (6 jiffies) 00000100:00100000:2.0:1784047628.134550:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435520 00000100:00100000:2.0:1784047628.134558:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435520 00000020:00000040:2.0:1784047628.134561:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a3d 00000020:00000040:2.0:1784047628.134564:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfdd8d800 refcount=5 00000100:00100000:2.0:1784047628.134698:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00000040:2.0:1784047628.134704:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfdd8d800 : new rpc_count 1 00000100:00000040:2.0:1784047628.134710:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cceca61f80 x1870705709435520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.134724:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1870705709435520:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1784047628.134736:0:8431:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cceca61f80 x1870705709435520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1784047628.134745:0:8431:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfdd8d800 : new rpc_count 2 00010000:00080000:2.0:1784047628.134749:0:8431:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff99cceca61f80 x1870705709435520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047628.134768:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca61f80 x1870705709435520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:4/0 lens 224/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784047628.134788:0:96960:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1784047628.134789:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1870705709435520:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 68us (881us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.135048:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00000040:2.0:1784047628.135052:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfdd8d800 : new rpc_count 1 00000100:00000040:2.0:1784047628.167269:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef85a850 x1870705689558016 msgsize 328 00000100:00100000:2.0:1784047628.167285:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:2.0:1784047628.167287:0:3640:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1784047628.167405:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558016 00000100:00100000:1.0:1784047628.167415:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558016 00000020:00000040:1.0:1784047628.167419:0:94374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a45 00000020:00000040:1.0:1784047628.167424:0:94374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001a800 refcount=9 00000100:00000040:1.0:1784047628.167446:0:94374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784047628.167481:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 211 00000100:00000040:1.0:1784047628.167485:0:94374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001a800 : new rpc_count 1 00000100:00000040:1.0:1784047628.167493:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef85a850 x1870705689558016/t0(0) o101->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.167506:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+9:70965:x1870705689558016:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784047628.167522:0:94374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1784047628.167532:0:94374:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff99ccfa64fb00 count: 3 00000020:00000040:1.0:1784047628.167539:0:94374:0:(lustre_handles.c:93:class_handle_hash()) added object ffff99cce3b89400 with handle 0x4426598c0c776abb to hash 00010000:00010000:1.0:1784047628.167544:0:94374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cce3b89400/0x4426598c0c776abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x374e4d8882fae872 expref: -99 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784047628.167553:0:94374:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff99ccd001a800 : new locks_count 4 00000020:00000040:1.0:1784047628.167555:0:94374:0:(genops.c:889:class_export_get()) GET export ffff99ccd001a800 refcount=10 00010000:00000040:1.0:1784047628.167573:0:94374:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff99ccfa64fb00) refcount = 3 00010000:00000040:1.0:1784047628.167576:0:94374:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784047628.167581:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccebdbd800/0x4426598c0c776ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776aad expref: 23 pid: 94372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784047628.167588:0:94374:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff99ccec24b600/0x4426598c0c776aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4426598c0c776a9f expref: 23 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.167595:0:94374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cce3b89400/0x4426598c0c776abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae872 expref: 10 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.167623:0:94374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cce3b89400/0x4426598c0c776abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0x374e4d8882fae872 expref: 10 pid: 94374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784047628.168387:0:94374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cce3b89400, rc 0) 00010000:00000040:1.0:1784047628.168394:0:94374:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689558016 00000100:00000040:1.0:1784047628.168413:0:94374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.168421:0:94374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.168465:0:94374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.168474:0:94374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef85a850 x1870705689558016/t0(0) o101->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:4/0 lens 328/344 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.168483:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689558016:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 979us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047628.168491:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 211 00000100:00000040:1.0:1784047628.168494:0:94374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001a800 : new rpc_count 0 00000020:00000040:1.0:1784047628.168506:0:94374:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 9 00000100:00000040:2.0:1784047628.180819:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef858050 x1870705689558144 msgsize 304 00000100:00100000:2.0:1784047628.180834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:2.0:1784047628.180836:0:3639:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1784047628.181114:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558144 00000100:00100000:2.0:1784047628.181123:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558144 00000020:00000040:2.0:1784047628.181126:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a45 00000020:00000040:2.0:1784047628.181131:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001a800 refcount=10 00000100:00000040:2.0:1784047628.181154:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784047628.181184:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 212 00000100:00000040:2.0:1784047628.181189:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001a800 : new rpc_count 1 00000100:00000040:2.0:1784047628.181197:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef858050 x1870705689558144/t0(0) o256->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:4/0 lens 304/0 e 0 to 0 dl 1784047639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.181211:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689558144:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784047628.181237:0:94372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:2.0:1784047628.181253:0:94372:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1784047628.181260:0:94372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784047628.181262:0:94372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000020:00000040:2.0:1784047628.181270:0:94372:0:(genops.c:889:class_export_get()) GET export ffff99ccd001a800 refcount=11 00000020:00000040:2.0:1784047628.200453:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 10 00010000:00000040:2.0:1784047628.200477:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689558144 00000100:00000040:2.0:1784047628.200494:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.200510:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.200562:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 8 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.200573:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef858050 x1870705689558144/t0(0) o256->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:4/0 lens 304/240 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047628.200585:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:70965:x1870705689558144:12345-192.168.204.40@tcp:256:ll_cfg_requeue.0 Request processed in 19375us (19765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047628.200597:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 212 00000100:00000040:2.0:1784047628.200601:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001a800 : new rpc_count 0 00000020:00000040:2.0:1784047628.200645:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 9 00000100:00000040:3.0:1784047628.204003:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cceca62300 x1870705689558272 msgsize 520 00000100:00100000:3.0:1784047628.204018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.204086:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558272 00000100:00100000:1.0:1784047628.204098:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558272 00000020:00000040:1.0:1784047628.204102:0:26184:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775e5f 00000100:00100000:1.0:1784047628.204153:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5093 00000100:00000040:1.0:1784047628.204163:0:26184:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cceca62300 x1870705689558272/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784047648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047628.204176:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2398:x1870705689558272:12345-192.168.204.40@tcp:8:ll_cfg_requeue.0 00000020:00000040:1.0:1784047628.204197:0:26184:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 9 - find 00010000:00000040:1.0:1784047628.204211:0:26184:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1784047628.204219:0:26184:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '0c846d7a-6357-4e9c-a620-e35737ede709' at ffff99ccfe6bc800, cookie 0x4426598c0c776a4b 00010000:00080000:1.0:1784047628.204224:0:26184:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp recovering/t4294968758 exp ffff99ccfe6bc800 cur 3726 last 1784047626 00000001:00000040:1.0:1784047628.204238:0:26184:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 21 00000020:00000040:1.0:1784047628.204242:0:26184:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=4 00000001:00000040:1.0:1784047628.204244:0:26184:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff99ccecd71400) : new refcount 22 00000001:00000040:1.0:1784047628.204249:0:26184:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff99ccecd71400) : new refcount 21 00002000:00100000:1.0:1784047628.204253:0:26184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccfe6bc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784047628.204286:0:26184:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:1.0:1784047628.204602:0:26184:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff99cbc74edc60 for nid 192.168.204.40@tcp - ref 2 00000020:00000040:1.0:1784047628.204709:0:26184:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 10 - import 00000020:00000040:1.0:1784047628.204716:0:26184:0:(genops.c:1244:class_import_put()) import ffff99ccd8410800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1784047628.206206:0:26184:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=5 00000100:00000040:1.0:1784047628.206213:0:26184:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.206229:0:26184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.206232:0:26184:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff99ccc7f9ee80 refcount 9 to 192.168.204.40@tcp 00000020:00000040:1.0:1784047628.206235:0:26184:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=6 00000100:00000040:1.0:1784047628.206243:0:26184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00080000:1.0:1784047628.206253:0:26184:0:(import.c:65:import_set_state_nolock()) ffff99ccd8410800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1784047628.206273:0:26184:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 5 00000020:00000040:1.0:1784047628.206277:0:26184:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99ccc4ac4d40) now 10 - find 00010000:00000040:1.0:1784047628.206293:0:26184:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 0, xid 1870705689558272 00000100:00000040:1.0:1784047628.206303:0:26184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.206310:0:26184:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.206359:0:26184:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.206369:0:26184:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cceca62300 x1870705689558272/t0(0) o8->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:0/0 lens 520/416 e 0 to 0 dl 1784047648 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784047628.206372:0:96960:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:0.0:1784047628.206381:0:96960:0:(ldlm_lib.c:2874:target_recovery_thread()) 1: request replay stage - 1 clients from t4294968779 00000100:00100000:1.0:1784047628.206387:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cceca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689558272:12345-192.168.204.40@tcp:8:ll_cfg_requeue.0 Request processed in 2209us (2382us total) trans 0 rc 0/0 00010000:00080000:0.0:1784047628.206387:0:96960:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 4294968779 00010000:00080000:0.0:1784047628.206394:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968779 00010000:00080000:0.0:1784047628.206400:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968779 00000100:00100000:1.0:1784047628.206402:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5093 00000100:00000040:1.0:1784047628.206407:0:26184:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.206422:0:26184:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 4 00000100:00000040:2.0:1784047628.218692:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc8ee0700 x1870705689528448 msgsize 440 00000100:00100000:2.0:1784047628.218706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.218741:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689528448 00000100:00100000:0.0:1784047628.218751:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689528448 00000020:00000040:0.0:1784047628.218754:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.218767:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=5 00000100:00000040:0.0:1784047628.218795:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.218846:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 646 00000100:00000040:0.0:1784047628.218851:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.218858:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc8ee0700 x1870705689528448/t0(4294968779) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.218872:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689528448:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.218885:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc8ee0700 x1870705689528448/t0(4294968779) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.218895:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968779, current: 4294968779, replaying 00010000:00000040:0.0:1784047628.218898:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.218913:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc8ee0700 x1870705689528448/t0(4294968779) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.218921:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689528448:12345-192.168.204.40@tcp:10:dd.0 Request processed in 52us (230us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.218928:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 646 00000100:00000040:0.0:1784047628.218941:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.219460:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968779, next_transno: 4294968779 00010000:00080000:1.0:1784047628.219468:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968779) 00010000:00080000:1.0:1784047628.219480:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689528448 t4294968779 from 192.168.204.40@tcp req@ffff99cbc8ee0700 x1870705689528448/t0(4294968779) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.219514:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc8ee0700 x1870705689528448/t0(4294968779) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784047628.219546:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x783:0x0] 00000001:00000040:2.0:1784047628.220536:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 1 00000020:00000040:2.0:1784047628.220542:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=6 00010000:00000040:2.0:1784047628.220602:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968779, xid 1870705689528448 00000100:00000040:2.0:1784047628.220675:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.220682:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.220739:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.220754:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.220766:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.220779:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 5 00010000:00080000:2.0:1784047628.220784:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968780 00010000:00080000:2.0:1784047628.220789:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968780 00000100:00000040:0.0:1784047628.229394:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cd00416680 x1870705689530240 msgsize 440 00000100:00100000:0.0:1784047628.229411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.229561:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530240 00000100:00100000:1.0:1784047628.229571:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530240 00000020:00000040:1.0:1784047628.229575:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.229580:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=6 00000100:00000040:1.0:1784047628.229650:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.229712:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 647 00000100:00000040:1.0:1784047628.229717:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.229726:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd00416680 x1870705689530240/t0(4294968780) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.229742:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689530240:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:1.0:1784047628.229755:0:8436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd00416680 x1870705689530240/t0(4294968780) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.229764:0:8436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968780, current: 4294968780, replaying 00010000:00000040:1.0:1784047628.229768:0:8436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.229790:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00416680 x1870705689530240/t0(4294968780) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.229798:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689530240:12345-192.168.204.40@tcp:10:dd.0 Request processed in 61us (406us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.229806:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 647 00000100:00000040:1.0:1784047628.229809:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.229874:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968780, next_transno: 4294968780 00010000:00080000:0.0:1784047628.229879:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968780) 00010000:00080000:0.0:1784047628.229887:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689530240 t4294968780 from 192.168.204.40@tcp req@ffff99cd00416680 x1870705689530240/t0(4294968780) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.229923:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd00416680 x1870705689530240/t0(4294968780) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784047628.229965:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x782:0x0] 00000001:00000040:0.0:1784047628.230161:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 2 00000020:00000040:0.0:1784047628.230165:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=7 00010000:00000040:0.0:1784047628.230206:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968780, xid 1870705689530240 00000100:00000040:0.0:1784047628.230217:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.230223:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.230273:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.230282:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.230289:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.230302:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 6 00010000:00080000:0.0:1784047628.230308:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968781 00010000:00080000:0.0:1784047628.230312:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968781 00000100:00000040:1.0:1784047628.234246:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5a27b80 x1870705689530496 msgsize 440 00000100:00100000:1.0:1784047628.234263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.234657:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689530496 00000100:00100000:0.0:1784047628.234668:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689530496 00000020:00000040:0.0:1784047628.234672:0:24868:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.234676:0:24868:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=7 00000100:00000040:0.0:1784047628.234700:0:24868:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.234748:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 648 00000100:00000040:0.0:1784047628.234753:0:24868:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.234771:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5a27b80 x1870705689530496/t0(4294968781) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.234786:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+7:2398:x1870705689530496:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.234797:0:24868:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc5a27b80 x1870705689530496/t0(4294968781) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.234817:0:24868:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968781, current: 4294968781, replaying 00010000:00000040:0.0:1784047628.234820:0:24868:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.234843:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5a27b80 x1870705689530496/t0(4294968781) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.234852:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+7:2398:x1870705689530496:12345-192.168.204.40@tcp:10:dd.0 Request processed in 69us (607us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.234859:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 648 00000100:00000040:0.0:1784047628.234862:0:24868:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.235016:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968781, next_transno: 4294968781 00010000:00080000:1.0:1784047628.235021:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968781) 00010000:00080000:1.0:1784047628.235031:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689530496 t4294968781 from 192.168.204.40@tcp req@ffff99cbc5a27b80 x1870705689530496/t0(4294968781) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.235051:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc5a27b80 x1870705689530496/t0(4294968781) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784047628.235093:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x785:0x0] 00000001:00000040:1.0:1784047628.235276:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 3 00000020:00000040:1.0:1784047628.235280:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=8 00010000:00000040:1.0:1784047628.235336:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968781, xid 1870705689530496 00000100:00000040:1.0:1784047628.235346:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.235352:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.235398:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.235407:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.235412:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.235421:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 7 00010000:00080000:1.0:1784047628.235425:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968782 00010000:00080000:1.0:1784047628.235429:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968782 00000100:00000040:3.0:1784047628.239310:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdcf9180 x1870705689532928 msgsize 440 00000100:00100000:3.0:1784047628.239332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.241347:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689532928 00000100:00100000:1.0:1784047628.241363:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689532928 00000020:00000040:1.0:1784047628.241366:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.241371:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=8 00000100:00000040:1.0:1784047628.241402:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.241459:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 649 00000100:00000040:1.0:1784047628.241463:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.241470:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdcf9180 x1870705689532928/t0(4294968782) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.241484:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+8:2398:x1870705689532928:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:1.0:1784047628.241511:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcf9180 x1870705689532928/t0(4294968782) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.241521:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968782, current: 4294968782, replaying 00010000:00000040:1.0:1784047628.241524:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.241543:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcf9180 x1870705689532928/t0(4294968782) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.241552:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+8:2398:x1870705689532928:12345-192.168.204.40@tcp:10:dd.0 Request processed in 70us (2245us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.241560:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 649 00000100:00000040:1.0:1784047628.241563:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.241630:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968782, next_transno: 4294968782 00010000:00080000:0.0:1784047628.241636:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968782) 00010000:00080000:0.0:1784047628.241648:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689532928 t4294968782 from 192.168.204.40@tcp req@ffff99ccfdcf9180 x1870705689532928/t0(4294968782) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.241676:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcf9180 x1870705689532928/t0(4294968782) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784047628.241708:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x786:0x0] 00000001:00000040:0.0:1784047628.241879:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 4 00000020:00000040:0.0:1784047628.241883:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=9 00010000:00000040:0.0:1784047628.241915:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968782, xid 1870705689532928 00000100:00000040:0.0:1784047628.241924:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.241930:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.241991:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.242001:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.242006:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.242016:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 8 00010000:00080000:0.0:1784047628.242020:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968783 00010000:00080000:0.0:1784047628.242024:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968783 00000100:00000040:1.0:1784047628.252243:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5a25880 x1870705689533568 msgsize 440 00000100:00100000:1.0:1784047628.252260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.252355:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689533568 00000100:00100000:0.0:1784047628.252365:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689533568 00000020:00000040:0.0:1784047628.252369:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.252374:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=9 00000100:00000040:0.0:1784047628.252399:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.252451:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 650 00000100:00000040:0.0:1784047628.252456:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.252464:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5a25880 x1870705689533568/t0(4294968783) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.252478:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:2398:x1870705689533568:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.252490:0:8437:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc5a25880 x1870705689533568/t0(4294968783) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.252500:0:8437:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968783, current: 4294968783, replaying 00010000:00000040:0.0:1784047628.252503:0:8437:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.252522:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5a25880 x1870705689533568/t0(4294968783) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.252532:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+9:2398:x1870705689533568:12345-192.168.204.40@tcp:10:dd.0 Request processed in 55us (290us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.252539:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 650 00000100:00000040:0.0:1784047628.252542:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.252679:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968783, next_transno: 4294968783 00010000:00080000:3.0:1784047628.252689:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968783) 00010000:00080000:3.0:1784047628.252706:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689533568 t4294968783 from 192.168.204.40@tcp req@ffff99cbc5a25880 x1870705689533568/t0(4294968783) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.252739:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc5a25880 x1870705689533568/t0(4294968783) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.252807:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x784:0x0] 00000001:00000040:3.0:1784047628.253095:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 5 00000020:00000040:3.0:1784047628.253099:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=10 00010000:00000040:3.0:1784047628.253383:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968783, xid 1870705689533568 00000100:00000040:3.0:1784047628.253398:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.253407:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.253483:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.253502:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:3.0:1784047628.253512:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.253527:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 9 00010000:00080000:3.0:1784047628.253533:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968784 00010000:00080000:3.0:1784047628.253538:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968784 00000100:00000040:0.0:1784047628.274503:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfde0c380 x1870705689534592 msgsize 440 00000100:00100000:0.0:1784047628.274518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.274596:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689534592 00000100:00100000:3.0:1784047628.274619:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689534592 00000020:00000040:3.0:1784047628.274622:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.274627:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=10 00000100:00000040:3.0:1784047628.274653:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.274703:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 651 00000100:00000040:3.0:1784047628.274707:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.274715:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfde0c380 x1870705689534592/t0(4294968784) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.274729:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+10:2398:x1870705689534592:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:3.0:1784047628.274742:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfde0c380 x1870705689534592/t0(4294968784) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.274751:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968784, current: 4294968784, replaying 00010000:00000040:3.0:1784047628.274754:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.274777:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfde0c380 x1870705689534592/t0(4294968784) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.274785:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+10:2398:x1870705689534592:12345-192.168.204.40@tcp:10:dd.0 Request processed in 58us (284us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.274792:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 651 00000100:00000040:3.0:1784047628.274795:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.274812:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968784, next_transno: 4294968784 00010000:00080000:3.0:1784047628.274815:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968784) 00010000:00080000:3.0:1784047628.274822:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689534592 t4294968784 from 192.168.204.40@tcp req@ffff99ccfde0c380 x1870705689534592/t0(4294968784) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.274836:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfde0c380 x1870705689534592/t0(4294968784) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.274868:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x787:0x0] 00000001:00000040:3.0:1784047628.275049:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 6 00000020:00000040:3.0:1784047628.275053:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=11 00010000:00000040:2.0:1784047628.275117:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968784, xid 1870705689534592 00000100:00000040:2.0:1784047628.275130:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.275137:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.275196:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.275205:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.275211:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.275230:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 10 00010000:00080000:2.0:1784047628.275234:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968785 00010000:00080000:2.0:1784047628.275238:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968785 00000100:00000040:0.0:1784047628.279508:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfde0ca80 x1870705689536128 msgsize 440 00000100:00100000:0.0:1784047628.279524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.280154:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536128 00000100:00100000:2.0:1784047628.280166:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536128 00000020:00000040:2.0:1784047628.280170:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.280176:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=11 00000100:00000040:2.0:1784047628.280204:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.280258:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 652 00000100:00000040:2.0:1784047628.280269:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.280278:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfde0ca80 x1870705689536128/t0(4294968785) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.280294:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689536128:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:2.0:1784047628.280307:0:8436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfde0ca80 x1870705689536128/t0(4294968785) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.280318:0:8436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968785, current: 4294968785, replaying 00010000:00000040:2.0:1784047628.280322:0:8436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00010000:00080000:3.0:1784047628.280383:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968785, next_transno: 4294968785 00010000:00080000:3.0:1784047628.280388:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968785) 00010000:00080000:3.0:1784047628.280399:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689536128 t4294968785 from 192.168.204.40@tcp req@ffff99ccfde0ca80 x1870705689536128/t0(4294968785) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.280416:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfde0ca80 x1870705689536128/t0(4294968785) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.280447:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x788:0x0] 00000001:00000040:3.0:1784047628.280655:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 7 00000020:00000040:3.0:1784047628.280659:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=12 00010000:00000040:3.0:1784047628.280694:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968785, xid 1870705689536128 00000100:00000040:3.0:1784047628.280704:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.280723:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.280760:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.280769:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.280774:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.280778:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968786 00010000:00080000:3.0:1784047628.280782:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968786 00000100:00000040:2.0:1784047628.281455:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfde0ca80 x1870705689536128/t4294968785(4294968785) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.281470:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfde0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+12:2398:x1870705689536128:12345-192.168.204.40@tcp:10:dd.0 Request processed in 1179us (1962us total) trans 4294968785 rc 0/0 00000100:00100000:2.0:1784047628.281480:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 652 00000100:00000040:2.0:1784047628.281483:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.281494:0:8436:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 11 00000100:00000040:3.0:1784047628.287890:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdcf8700 x1870705689536384 msgsize 440 00000100:00100000:3.0:1784047628.287914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.288097:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689536384 00000100:00100000:0.0:1784047628.288113:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689536384 00000020:00000040:0.0:1784047628.288116:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.288147:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=12 00000100:00000040:0.0:1784047628.288177:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.288235:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 653 00000100:00000040:0.0:1784047628.288240:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.288249:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdcf8700 x1870705689536384/t0(4294968786) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.288263:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+12:2398:x1870705689536384:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.288275:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcf8700 x1870705689536384/t0(4294968786) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.288284:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968786, current: 4294968786, replaying 00010000:00000040:0.0:1784047628.288288:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.288298:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcf8700 x1870705689536384/t0(4294968786) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.288307:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+12:2398:x1870705689536384:12345-192.168.204.40@tcp:10:dd.0 Request processed in 46us (420us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.288314:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 653 00000100:00000040:0.0:1784047628.288317:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.288677:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968786, next_transno: 4294968786 00010000:00080000:3.0:1784047628.288684:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968786) 00010000:00080000:3.0:1784047628.288698:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689536384 t4294968786 from 192.168.204.40@tcp req@ffff99ccfdcf8700 x1870705689536384/t0(4294968786) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.288738:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcf8700 x1870705689536384/t0(4294968786) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.288782:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x789:0x0] 00000001:00000040:2.0:1784047628.290024:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 8 00000020:00000040:2.0:1784047628.290038:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=13 00010000:00000040:2.0:1784047628.290101:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968786, xid 1870705689536384 00000100:00000040:2.0:1784047628.290115:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.290122:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.290183:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.290194:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.290203:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.290214:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 12 00010000:00080000:2.0:1784047628.290219:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968787 00010000:00080000:2.0:1784047628.290223:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968787 00000100:00000040:0.0:1784047628.312763:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2ea8380 x1870705689538688 msgsize 440 00000100:00100000:0.0:1784047628.312781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.313074:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538688 00000100:00100000:3.0:1784047628.313084:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538688 00000020:00000040:3.0:1784047628.313087:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.313092:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=13 00000100:00000040:3.0:1784047628.313119:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.313175:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 654 00000100:00000040:3.0:1784047628.313180:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.313188:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2ea8380 x1870705689538688/t0(4294968787) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.313201:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+13:2398:x1870705689538688:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:3.0:1784047628.313211:0:8438:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccf2ea8380 x1870705689538688/t0(4294968787) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.313232:0:8438:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968787, current: 4294968787, replaying 00010000:00000040:3.0:1784047628.313236:0:8438:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.313253:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2ea8380 x1870705689538688/t0(4294968787) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.313261:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+13:2398:x1870705689538688:12345-192.168.204.40@tcp:10:dd.0 Request processed in 63us (499us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.313268:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 654 00000100:00000040:3.0:1784047628.313271:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.313286:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968787, next_transno: 4294968787 00010000:00080000:3.0:1784047628.313290:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968787) 00010000:00080000:3.0:1784047628.313299:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689538688 t4294968787 from 192.168.204.40@tcp req@ffff99ccf2ea8380 x1870705689538688/t0(4294968787) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.313314:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccf2ea8380 x1870705689538688/t0(4294968787) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.313340:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78a:0x0] 00000001:00000040:3.0:1784047628.313508:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 9 00000020:00000040:3.0:1784047628.313512:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=14 00010000:00000040:3.0:1784047628.313547:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968787, xid 1870705689538688 00000100:00000040:3.0:1784047628.313557:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.313563:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.313644:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.313653:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.313661:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.313673:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 13 00010000:00080000:3.0:1784047628.313678:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968788 00010000:00080000:3.0:1784047628.313681:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968788 00000100:00000040:3.0:1784047628.317917:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdcfaa00 x1870705689538944 msgsize 440 00000100:00100000:3.0:1784047628.317944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.318037:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689538944 00000100:00100000:2.0:1784047628.318047:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689538944 00000020:00000040:2.0:1784047628.318050:0:24867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.318055:0:24867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=14 00000100:00000040:2.0:1784047628.318079:0:24867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.318143:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 655 00000100:00000040:2.0:1784047628.318149:0:24867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.318157:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdcfaa00 x1870705689538944/t0(4294968788) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.318170:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+14:2398:x1870705689538944:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:2.0:1784047628.318181:0:24867:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcfaa00 x1870705689538944/t0(4294968788) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.318189:0:24867:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968788, current: 4294968788, replaying 00010000:00000040:2.0:1784047628.318193:0:24867:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.318216:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcfaa00 x1870705689538944/t0(4294968788) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.318225:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+14:2398:x1870705689538944:12345-192.168.204.40@tcp:10:dd.0 Request processed in 57us (309us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.318244:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 655 00000100:00000040:2.0:1784047628.318247:0:24867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.318295:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968788, next_transno: 4294968788 00010000:00080000:0.0:1784047628.318300:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968788) 00010000:00080000:0.0:1784047628.318309:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689538944 t4294968788 from 192.168.204.40@tcp req@ffff99ccfdcfaa00 x1870705689538944/t0(4294968788) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.318326:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcfaa00 x1870705689538944/t0(4294968788) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784047628.318491:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78b:0x0] 00000001:00000040:0.0:1784047628.319067:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 10 00000020:00000040:0.0:1784047628.319072:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=15 00010000:00000040:0.0:1784047628.319108:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968788, xid 1870705689538944 00000100:00000040:0.0:1784047628.319119:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.319125:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.319180:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.319190:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.319197:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.319208:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 14 00010000:00080000:0.0:1784047628.319212:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968789 00010000:00080000:0.0:1784047628.319216:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968789 00000100:00000040:2.0:1784047628.321325:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef515c00 x1870705689540608 msgsize 440 00000100:00100000:2.0:1784047628.321341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.321887:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689540608 00000100:00100000:0.0:1784047628.321896:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689540608 00000020:00000040:0.0:1784047628.321899:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.321904:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=15 00000100:00000040:0.0:1784047628.321930:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.321988:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 656 00000100:00000040:0.0:1784047628.321993:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.322001:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef515c00 x1870705689540608/t0(4294968789) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.322017:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+15:2398:x1870705689540608:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.322028:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef515c00 x1870705689540608/t0(4294968789) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.322037:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968789, current: 4294968789, replaying 00010000:00000040:0.0:1784047628.322040:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.322074:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515c00 x1870705689540608/t0(4294968789) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.322083:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+15:2398:x1870705689540608:12345-192.168.204.40@tcp:10:dd.0 Request processed in 70us (758us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.322093:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 656 00000100:00000040:0.0:1784047628.322097:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.322098:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968789, next_transno: 4294968789 00010000:00080000:3.0:1784047628.322104:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968789) 00010000:00080000:3.0:1784047628.322115:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689540608 t4294968789 from 192.168.204.40@tcp req@ffff99ccef515c00 x1870705689540608/t0(4294968789) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.322132:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef515c00 x1870705689540608/t0(4294968789) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.322170:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78c:0x0] 00000001:00000040:3.0:1784047628.322432:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 11 00000020:00000040:3.0:1784047628.322436:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=16 00010000:00000040:3.0:1784047628.322473:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968789, xid 1870705689540608 00000100:00000040:3.0:1784047628.322482:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.322489:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.322542:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.322552:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.322557:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.322566:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 15 00010000:00080000:3.0:1784047628.322570:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968790 00010000:00080000:3.0:1784047628.322574:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968790 00000100:00000040:2.0:1784047628.330266:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef515f80 x1870705689541248 msgsize 440 00000100:00100000:2.0:1784047628.330283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.330375:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689541248 00000100:00100000:3.0:1784047628.330385:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689541248 00000020:00000040:3.0:1784047628.330388:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.330392:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=16 00000100:00000040:3.0:1784047628.330418:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.330454:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 657 00000100:00000040:3.0:1784047628.330458:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.330466:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef515f80 x1870705689541248/t0(4294968790) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.330486:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+16:2398:x1870705689541248:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:3.0:1784047628.330498:0:8436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef515f80 x1870705689541248/t0(4294968790) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.330507:0:8436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968790, current: 4294968790, replaying 00010000:00000040:3.0:1784047628.330510:0:8436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.330569:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef515f80 x1870705689541248/t0(4294968790) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.330580:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+16:2398:x1870705689541248:12345-192.168.204.40@tcp:10:dd.0 Request processed in 96us (315us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.330588:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 657 00000100:00000040:3.0:1784047628.330591:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.330676:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968790, next_transno: 4294968790 00010000:00080000:2.0:1784047628.330680:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968790) 00010000:00080000:2.0:1784047628.330689:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689541248 t4294968790 from 192.168.204.40@tcp req@ffff99ccef515f80 x1870705689541248/t0(4294968790) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.330783:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef515f80 x1870705689541248/t0(4294968790) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.330821:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78d:0x0] 00000001:00000040:3.0:1784047628.331253:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 12 00000020:00000040:3.0:1784047628.331258:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=17 00010000:00000040:3.0:1784047628.331291:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968790, xid 1870705689541248 00000100:00000040:3.0:1784047628.331302:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.331308:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.331497:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.331507:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.331515:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.331527:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 16 00010000:00080000:3.0:1784047628.331531:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968791 00010000:00080000:3.0:1784047628.331534:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968791 00000100:00000040:0.0:1784047628.335002:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2ea8700 x1870705689542656 msgsize 440 00000100:00100000:0.0:1784047628.335018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.335085:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689542656 00000100:00100000:3.0:1784047628.335094:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689542656 00000020:00000040:3.0:1784047628.335097:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.335102:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=17 00000100:00000040:3.0:1784047628.335127:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.335214:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 658 00000100:00000040:3.0:1784047628.335219:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.335227:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2ea8700 x1870705689542656/t0(4294968791) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.335243:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+17:2398:x1870705689542656:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:3.0:1784047628.335255:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccf2ea8700 x1870705689542656/t0(4294968791) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.335263:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968791, current: 4294968791, replaying 00010000:00000040:3.0:1784047628.335267:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.335285:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2ea8700 x1870705689542656/t0(4294968791) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.335294:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+17:2398:x1870705689542656:12345-192.168.204.40@tcp:10:dd.0 Request processed in 54us (293us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.335301:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 658 00000100:00000040:3.0:1784047628.335304:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.335366:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968791, next_transno: 4294968791 00010000:00080000:2.0:1784047628.335371:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968791) 00010000:00080000:2.0:1784047628.335380:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689542656 t4294968791 from 192.168.204.40@tcp req@ffff99ccf2ea8700 x1870705689542656/t0(4294968791) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.335398:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccf2ea8700 x1870705689542656/t0(4294968791) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784047628.335426:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78e:0x0] 00000001:00000040:2.0:1784047628.335583:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 13 00000020:00000040:2.0:1784047628.335586:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=18 00010000:00000040:2.0:1784047628.335697:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968791, xid 1870705689542656 00000100:00000040:2.0:1784047628.335706:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.335712:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.335765:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.335773:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.335777:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.335786:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 17 00010000:00080000:2.0:1784047628.335798:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968792 00010000:00080000:2.0:1784047628.335802:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968792 00000100:00000040:3.0:1784047628.341440:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdcfb480 x1870705689543168 msgsize 440 00000100:00100000:3.0:1784047628.341455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.341588:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689543168 00000100:00100000:0.0:1784047628.341599:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689543168 00000020:00000040:0.0:1784047628.341602:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.342829:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=18 00000100:00000040:0.0:1784047628.342862:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.342906:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 659 00000100:00000040:0.0:1784047628.342911:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.342919:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdcfb480 x1870705689543168/t0(4294968792) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.342947:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+18:2398:x1870705689543168:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.342959:0:8437:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcfb480 x1870705689543168/t0(4294968792) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.342969:0:8437:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968792, current: 4294968792, replaying 00010000:00000040:0.0:1784047628.342972:0:8437:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.342994:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcfb480 x1870705689543168/t0(4294968792) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.343003:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+18:2398:x1870705689543168:12345-192.168.204.40@tcp:10:dd.0 Request processed in 73us (1565us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.343027:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 659 00000100:00000040:0.0:1784047628.343030:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.343097:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968792, next_transno: 4294968792 00010000:00080000:3.0:1784047628.343102:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968792) 00010000:00080000:3.0:1784047628.343110:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689543168 t4294968792 from 192.168.204.40@tcp req@ffff99ccfdcfb480 x1870705689543168/t0(4294968792) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.343150:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcfb480 x1870705689543168/t0(4294968792) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784047628.343178:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78f:0x0] 00000001:00000040:3.0:1784047628.343342:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 14 00000020:00000040:3.0:1784047628.343347:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=19 00010000:00000040:3.0:1784047628.343384:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968792, xid 1870705689543168 00000100:00000040:3.0:1784047628.343395:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.343401:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.343456:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.343465:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.343472:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.343484:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 18 00010000:00080000:3.0:1784047628.343489:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968793 00010000:00080000:3.0:1784047628.343493:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968793 00000100:00000040:0.0:1784047628.348129:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99ccec86c380 x1870705689545216 msgsize 440 00000100:00100000:0.0:1784047628.348144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.348325:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689545216 00000100:00100000:3.0:1784047628.348335:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689545216 00000020:00000040:3.0:1784047628.348339:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.348343:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=19 00000100:00000040:3.0:1784047628.348368:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.348417:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 660 00000100:00000040:3.0:1784047628.348422:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.348429:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccec86c380 x1870705689545216/t0(4294968793) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.348443:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+19:2398:x1870705689545216:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:3.0:1784047628.348455:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccec86c380 x1870705689545216/t0(4294968793) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.348478:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968793, current: 4294968793, replaying 00010000:00000040:3.0:1784047628.348481:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.348502:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccec86c380 x1870705689545216/t0(4294968793) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.348512:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+19:2398:x1870705689545216:12345-192.168.204.40@tcp:10:dd.0 Request processed in 71us (383us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.348520:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 660 00000100:00000040:3.0:1784047628.348523:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.348731:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968793, next_transno: 4294968793 00010000:00080000:2.0:1784047628.348736:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968793) 00010000:00080000:2.0:1784047628.348745:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689545216 t4294968793 from 192.168.204.40@tcp req@ffff99ccec86c380 x1870705689545216/t0(4294968793) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.348772:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccec86c380 x1870705689545216/t0(4294968793) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784047628.348802:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x790:0x0] 00000001:00000040:2.0:1784047628.348993:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 15 00000020:00000040:2.0:1784047628.348997:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=20 00010000:00000040:2.0:1784047628.349028:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968793, xid 1870705689545216 00000100:00000040:2.0:1784047628.349038:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.349043:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.349095:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.349103:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.349107:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.349117:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 19 00010000:00080000:2.0:1784047628.349121:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968794 00010000:00080000:2.0:1784047628.349125:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968794 00000100:00000040:0.0:1784047628.361222:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9be6300 x1870705689546112 msgsize 1512 00000100:00100000:0.0:1784047628.361240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.361384:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546112 00000100:00100000:3.0:1784047628.361404:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546112 00000020:00000040:3.0:1784047628.361407:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.361412:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=20 00000100:00000040:3.0:1784047628.361437:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.361493:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 661 00000100:00000040:3.0:1784047628.361500:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.361508:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9be6300 x1870705689546112/t0(4294968794) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.361524:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+20:2398:x1870705689546112:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:3.0:1784047628.361536:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc9be6300 x1870705689546112/t0(4294968794) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.361545:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968794, current: 4294968794, replaying 00010000:00000040:3.0:1784047628.361549:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.361575:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9be6300 x1870705689546112/t0(4294968794) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.361585:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+20:2398:x1870705689546112:12345-192.168.204.40@tcp:4:dd.0 Request processed in 64us (364us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.361602:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 661 00000100:00000040:3.0:1784047628.361626:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.362528:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968794, next_transno: 4294968794 00010000:00080000:1.0:1784047628.362534:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968794) 00010000:00080000:1.0:1784047628.362546:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689546112 t4294968794 from 192.168.204.40@tcp req@ffff99cbc9be6300 x1870705689546112/t0(4294968794) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.362567:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc9be6300 x1870705689546112/t0(4294968794) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784047628.362702:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:0.0:1784047628.362818:0:96960:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:0.0:1784047628.362886:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784047628.362937:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:0.0:1784047628.362941:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784047628.363235:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 16 00000020:00000040:0.0:1784047628.363241:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=21 00010000:00000040:0.0:1784047628.363651:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968794, xid 1870705689546112 00000100:00000040:0.0:1784047628.363664:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.363672:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.363725:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.363737:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.363746:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.363758:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 20 00010000:00080000:0.0:1784047628.363763:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968795 00010000:00080000:0.0:1784047628.363767:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968795 00000100:00000040:3.0:1784047628.368748:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccfdcf9880 x1870705689546880 msgsize 1512 00000100:00100000:3.0:1784047628.368766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.369970:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689546880 00000100:00100000:2.0:1784047628.369982:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689546880 00000020:00000040:2.0:1784047628.369986:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.369991:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=21 00000100:00000040:2.0:1784047628.370018:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.370075:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 662 00000100:00000040:2.0:1784047628.370080:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.370088:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccfdcf9880 x1870705689546880/t0(4294968795) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.370109:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+21:2398:x1870705689546880:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:2.0:1784047628.370121:0:8436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcf9880 x1870705689546880/t0(4294968795) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.370130:0:8436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968795, current: 4294968795, replaying 00010000:00000040:2.0:1784047628.370133:0:8436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.370154:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdcf9880 x1870705689546880/t0(4294968795) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.370163:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfdcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+21:2398:x1870705689546880:12345-192.168.204.40@tcp:4:dd.0 Request processed in 56us (1627us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.370172:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 662 00000100:00000040:2.0:1784047628.370174:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.370296:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968795, next_transno: 4294968795 00010000:00080000:1.0:1784047628.370302:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968795) 00010000:00080000:1.0:1784047628.370311:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689546880 t4294968795 from 192.168.204.40@tcp req@ffff99ccfdcf9880 x1870705689546880/t0(4294968795) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.370327:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccfdcf9880 x1870705689546880/t0(4294968795) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.370464:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.370492:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.370495:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.370807:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 17 00000020:00000040:1.0:1784047628.370812:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=22 00010000:00000040:1.0:1784047628.371198:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968795, xid 1870705689546880 00000100:00000040:1.0:1784047628.371210:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.371217:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.371264:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.371275:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.371281:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.371291:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 21 00010000:00080000:1.0:1784047628.371296:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968796 00010000:00080000:1.0:1784047628.371300:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968796 00000100:00000040:1.0:1784047628.382282:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccc44f2d80 x1870705689547904 msgsize 1512 00000100:00100000:1.0:1784047628.382303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.382388:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547904 00000100:00100000:3.0:1784047628.382397:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547904 00000020:00000040:3.0:1784047628.382401:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.382406:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=22 00000100:00000040:3.0:1784047628.382432:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.382487:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 663 00000100:00000040:3.0:1784047628.382492:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.382500:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccc44f2d80 x1870705689547904/t0(4294968796) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.382513:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+22:2398:x1870705689547904:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:3.0:1784047628.382525:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccc44f2d80 x1870705689547904/t0(4294968796) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.382534:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968796, current: 4294968796, replaying 00010000:00000040:3.0:1784047628.382538:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.382550:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccc44f2d80 x1870705689547904/t0(4294968796) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.382560:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc44f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+22:2398:x1870705689547904:12345-192.168.204.40@tcp:4:dd.0 Request processed in 49us (279us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.382566:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 663 00000100:00000040:3.0:1784047628.382569:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.382860:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968796, next_transno: 4294968796 00010000:00080000:1.0:1784047628.382864:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968796) 00010000:00080000:1.0:1784047628.382871:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689547904 t4294968796 from 192.168.204.40@tcp req@ffff99ccc44f2d80 x1870705689547904/t0(4294968796) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.382886:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccc44f2d80 x1870705689547904/t0(4294968796) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.382996:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.383025:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.383028:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.383263:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 18 00000020:00000040:1.0:1784047628.383268:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=23 00010000:00000040:1.0:1784047628.384586:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968796, xid 1870705689547904 00000100:00000040:1.0:1784047628.384602:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.384677:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.384770:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.384783:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.384792:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.384807:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 22 00010000:00080000:1.0:1784047628.384812:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968797 00010000:00080000:1.0:1784047628.384816:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968797 00000100:00000040:3.0:1784047628.388733:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaa16300 x1870705689547776 msgsize 440 00000100:00100000:3.0:1784047628.388762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.389719:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689547776 00000100:00100000:2.0:1784047628.389731:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689547776 00000020:00000040:2.0:1784047628.389734:0:24867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.389739:0:24867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=23 00000100:00000040:2.0:1784047628.389765:0:24867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.389814:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 664 00000100:00000040:2.0:1784047628.389820:0:24867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.389828:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaa16300 x1870705689547776/t0(4294968797) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.389842:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+23:2398:x1870705689547776:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:2.0:1784047628.389854:0:24867:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa16300 x1870705689547776/t0(4294968797) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.389863:0:24867:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968797, current: 4294968797, replaying 00010000:00000040:2.0:1784047628.389875:0:24867:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.389886:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaa16300 x1870705689547776/t0(4294968797) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.389894:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+23:2398:x1870705689547776:12345-192.168.204.40@tcp:10:dd.0 Request processed in 55us (1163us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.389902:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 664 00000100:00000040:2.0:1784047628.389906:0:24867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.389980:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968797, next_transno: 4294968797 00010000:00080000:1.0:1784047628.389985:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968797) 00010000:00080000:1.0:1784047628.389995:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689547776 t4294968797 from 192.168.204.40@tcp req@ffff99cbcaa16300 x1870705689547776/t0(4294968797) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.390011:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa16300 x1870705689547776/t0(4294968797) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784047628.390046:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x792:0x0] 00000001:00000040:1.0:1784047628.390234:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 19 00000020:00000040:1.0:1784047628.390239:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=24 00010000:00000040:1.0:1784047628.390271:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968797, xid 1870705689547776 00000100:00000040:1.0:1784047628.390282:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.390290:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.390366:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.390375:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.390380:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.390401:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 23 00010000:00080000:1.0:1784047628.390405:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968798 00010000:00080000:1.0:1784047628.390409:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968798 00000100:00000040:3.0:1784047628.396815:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaa15c00 x1870705689548416 msgsize 440 00000100:00100000:3.0:1784047628.396834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.396919:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548416 00000100:00100000:1.0:1784047628.396953:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548416 00000020:00000040:1.0:1784047628.396957:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.396961:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=24 00000100:00000040:1.0:1784047628.396985:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.397034:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 665 00000100:00000040:1.0:1784047628.397040:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.397048:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaa15c00 x1870705689548416/t0(4294968798) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.397064:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+24:2398:x1870705689548416:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:1.0:1784047628.397076:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa15c00 x1870705689548416/t0(4294968798) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.397085:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968798, current: 4294968798, replaying 00010000:00000040:1.0:1784047628.397089:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.397105:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaa15c00 x1870705689548416/t0(4294968798) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.397115:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+24:2398:x1870705689548416:12345-192.168.204.40@tcp:10:dd.0 Request processed in 54us (301us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.397122:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 665 00000100:00000040:1.0:1784047628.397125:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.398487:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968798, next_transno: 4294968798 00010000:00080000:2.0:1784047628.398494:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968798) 00010000:00080000:2.0:1784047628.398505:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689548416 t4294968798 from 192.168.204.40@tcp req@ffff99cbcaa15c00 x1870705689548416/t0(4294968798) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.398526:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa15c00 x1870705689548416/t0(4294968798) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784047628.398560:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x791:0x0] 00000001:00000040:2.0:1784047628.398759:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 20 00000020:00000040:2.0:1784047628.398764:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=25 00010000:00000040:2.0:1784047628.398802:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968798, xid 1870705689548416 00000100:00000040:2.0:1784047628.398812:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.398820:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.398875:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.398885:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.398892:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.398904:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 24 00010000:00080000:2.0:1784047628.398908:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968799 00010000:00080000:2.0:1784047628.398911:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968799 00000100:00000040:2.0:1784047628.403780:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef514380 x1870705689548672 msgsize 440 00000100:00100000:2.0:1784047628.403797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.403970:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689548672 00000100:00100000:0.0:1784047628.403990:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689548672 00000020:00000040:0.0:1784047628.403994:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.403999:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=25 00000100:00000040:0.0:1784047628.404025:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.404073:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 666 00000100:00000040:0.0:1784047628.404078:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.404092:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef514380 x1870705689548672/t0(4294968799) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.404106:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+25:2398:x1870705689548672:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:0.0:1784047628.404118:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef514380 x1870705689548672/t0(4294968799) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.404128:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968799, current: 4294968799, replaying 00010000:00000040:0.0:1784047628.404131:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.404157:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef514380 x1870705689548672/t0(4294968799) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.404166:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+25:2398:x1870705689548672:12345-192.168.204.40@tcp:10:dd.0 Request processed in 63us (387us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.404174:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 666 00000100:00000040:0.0:1784047628.404177:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.404286:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968799, next_transno: 4294968799 00010000:00080000:1.0:1784047628.404290:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968799) 00010000:00080000:1.0:1784047628.404298:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689548672 t4294968799 from 192.168.204.40@tcp req@ffff99ccef514380 x1870705689548672/t0(4294968799) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.404313:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef514380 x1870705689548672/t0(4294968799) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1784047628.404346:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x793:0x0] 00000001:00000040:1.0:1784047628.404530:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 21 00000020:00000040:1.0:1784047628.404534:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=26 00010000:00000040:1.0:1784047628.404568:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968799, xid 1870705689548672 00000100:00000040:1.0:1784047628.404578:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.404584:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.404668:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.404677:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.404682:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.404692:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 25 00010000:00080000:1.0:1784047628.404696:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968800 00010000:00080000:1.0:1784047628.404700:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968800 00000100:00000040:3.0:1784047628.406740:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaa14700 x1870705689549056 msgsize 1512 00000100:00100000:3.0:1784047628.406754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.407037:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689549056 00000100:00100000:0.0:1784047628.407047:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689549056 00000020:00000040:0.0:1784047628.407050:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.407055:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=26 00000100:00000040:0.0:1784047628.407077:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.407122:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 667 00000100:00000040:0.0:1784047628.407126:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.407140:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaa14700 x1870705689549056/t0(4294968800) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.407153:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+26:2398:x1870705689549056:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.407164:0:8438:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa14700 x1870705689549056/t0(4294968800) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.407192:0:8438:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968800, current: 4294968800, replaying 00010000:00000040:0.0:1784047628.407195:0:8438:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.407212:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaa14700 x1870705689549056/t0(4294968800) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.407221:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+26:2398:x1870705689549056:12345-192.168.204.40@tcp:4:dd.0 Request processed in 69us (481us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.407228:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 667 00000100:00000040:0.0:1784047628.407231:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.407527:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968800, next_transno: 4294968800 00010000:00080000:1.0:1784047628.407532:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968800) 00010000:00080000:1.0:1784047628.407540:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689549056 t4294968800 from 192.168.204.40@tcp req@ffff99cbcaa14700 x1870705689549056/t0(4294968800) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.407555:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa14700 x1870705689549056/t0(4294968800) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.407681:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.407708:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.407711:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.408216:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 22 00000020:00000040:1.0:1784047628.408221:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=27 00010000:00000040:1.0:1784047628.408251:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968800, xid 1870705689549056 00000100:00000040:1.0:1784047628.408264:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.408271:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.408319:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.408327:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.408332:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.408347:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 26 00010000:00080000:1.0:1784047628.408351:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968801 00010000:00080000:1.0:1784047628.408355:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968801 00000100:00000040:3.0:1784047628.410999:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaa15f80 x1870705689550208 msgsize 440 00000100:00100000:3.0:1784047628.411013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.411171:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550208 00000100:00100000:1.0:1784047628.411181:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550208 00000020:00000040:1.0:1784047628.411184:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.411188:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=27 00000100:00000040:1.0:1784047628.411211:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.411261:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 668 00000100:00000040:1.0:1784047628.411266:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.411274:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaa15f80 x1870705689550208/t0(4294968801) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.411286:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+27:2398:x1870705689550208:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:1.0:1784047628.411297:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa15f80 x1870705689550208/t0(4294968801) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.411305:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968801, current: 4294968801, replaying 00010000:00000040:1.0:1784047628.411308:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.411371:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaa15f80 x1870705689550208/t0(4294968801) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.411381:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c846d7a-6357-4e9c-a620-e35737ede709+27:2398:x1870705689550208:12345-192.168.204.40@tcp:10:dd.0 Request processed in 96us (382us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.411388:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 668 00000100:00000040:1.0:1784047628.411391:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.411723:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968801, next_transno: 4294968801 00010000:00080000:3.0:1784047628.411728:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968801) 00010000:00080000:3.0:1784047628.411736:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689550208 t4294968801 from 192.168.204.40@tcp req@ffff99cbcaa15f80 x1870705689550208/t0(4294968801) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.411827:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa15f80 x1870705689550208/t0(4294968801) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784047628.411865:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x794:0x0] 00000001:00000040:2.0:1784047628.412112:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 23 00000020:00000040:2.0:1784047628.412117:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=28 00010000:00000040:2.0:1784047628.412217:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968801, xid 1870705689550208 00000100:00000040:2.0:1784047628.412227:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.412233:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.412331:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.412346:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.412353:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.412366:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 27 00010000:00080000:2.0:1784047628.412370:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968802 00010000:00080000:2.0:1784047628.412374:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968802 00000100:00000040:2.0:1784047628.415361:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2c15c00 x1870705689550464 msgsize 1512 00000100:00100000:2.0:1784047628.415378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.415507:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550464 00000100:00100000:3.0:1784047628.415517:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550464 00000020:00000040:3.0:1784047628.415519:0:24868:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.415525:0:24868:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=28 00000100:00000040:3.0:1784047628.415550:0:24868:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.415604:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 669 00000100:00000040:3.0:1784047628.415636:0:24868:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.415643:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2c15c00 x1870705689550464/t0(4294968802) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.415657:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+28:2398:x1870705689550464:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:3.0:1784047628.415668:0:24868:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccf2c15c00 x1870705689550464/t0(4294968802) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.415676:0:24868:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968802, current: 4294968802, replaying 00010000:00000040:3.0:1784047628.415679:0:24868:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.415696:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c15c00 x1870705689550464/t0(4294968802) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.415723:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+28:2398:x1870705689550464:12345-192.168.204.40@tcp:4:dd.0 Request processed in 68us (362us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.415730:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 669 00000100:00000040:3.0:1784047628.415733:0:24868:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.415791:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968802, next_transno: 4294968802 00010000:00080000:2.0:1784047628.415795:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968802) 00010000:00080000:2.0:1784047628.415803:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689550464 t4294968802 from 192.168.204.40@tcp req@ffff99ccf2c15c00 x1870705689550464/t0(4294968802) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.415819:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccf2c15c00 x1870705689550464/t0(4294968802) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.415919:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784047628.415961:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:2.0:1784047628.415965:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784047628.416233:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 24 00000020:00000040:2.0:1784047628.416237:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=29 00010000:00000040:2.0:1784047628.416824:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968802, xid 1870705689550464 00000100:00000040:2.0:1784047628.416846:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.416853:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.416909:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.416920:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.416927:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.416951:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 28 00010000:00080000:2.0:1784047628.416956:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968803 00010000:00080000:2.0:1784047628.416959:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968803 00000100:00000040:3.0:1784047628.419108:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbcaa15500 x1870705689550720 msgsize 440 00000100:00100000:3.0:1784047628.419122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.419318:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689550720 00000100:00100000:1.0:1784047628.419329:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689550720 00000020:00000040:1.0:1784047628.419332:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.419338:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=29 00000100:00000040:1.0:1784047628.419384:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.419454:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 670 00000100:00000040:1.0:1784047628.419459:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.419467:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbcaa15500 x1870705689550720/t0(4294968803) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.419481:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+29:2398:x1870705689550720:12345-192.168.204.40@tcp:10:dd.0 00000020:00000040:1.0:1784047628.419495:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa15500 x1870705689550720/t0(4294968803) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.419505:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968803, current: 4294968803, replaying 00010000:00000040:1.0:1784047628.419509:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.419530:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbcaa15500 x1870705689550720/t0(4294968803) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.419539:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbcaa15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+29:2398:x1870705689550720:12345-192.168.204.40@tcp:10:dd.0 Request processed in 62us (431us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.419546:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 670 00000100:00000040:1.0:1784047628.419550:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.419958:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968803, next_transno: 4294968803 00010000:00080000:2.0:1784047628.419963:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968803) 00010000:00080000:2.0:1784047628.419983:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689550720 t4294968803 from 192.168.204.40@tcp req@ffff99cbcaa15500 x1870705689550720/t0(4294968803) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.419999:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbcaa15500 x1870705689550720/t0(4294968803) o10->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 440/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1784047628.420034:0:96960:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x795:0x0] 00000001:00000040:2.0:1784047628.420463:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 25 00000020:00000040:2.0:1784047628.420468:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=30 00010000:00000040:2.0:1784047628.420502:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968803, xid 1870705689550720 00000100:00000040:2.0:1784047628.420513:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.420519:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.420796:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.420807:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.420814:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.420825:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 29 00010000:00080000:2.0:1784047628.420829:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968804 00010000:00080000:2.0:1784047628.420833:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968804 00000100:00000040:0.0:1784047628.424521:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9be5180 x1870705689551360 msgsize 1512 00000100:00100000:0.0:1784047628.424535:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.424639:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551360 00000100:00100000:3.0:1784047628.424649:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551360 00000020:00000040:3.0:1784047628.424653:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.424658:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=30 00000100:00000040:3.0:1784047628.424684:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.424726:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 671 00000100:00000040:3.0:1784047628.424731:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.424738:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9be5180 x1870705689551360/t0(4294968804) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.424752:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+30:2398:x1870705689551360:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:3.0:1784047628.424765:0:8436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc9be5180 x1870705689551360/t0(4294968804) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.424773:0:8436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968804, current: 4294968804, replaying 00010000:00000040:3.0:1784047628.424777:0:8436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.424796:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9be5180 x1870705689551360/t0(4294968804) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.424805:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+30:2398:x1870705689551360:12345-192.168.204.40@tcp:4:dd.0 Request processed in 56us (285us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047628.424813:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 671 00000100:00000040:3.0:1784047628.424830:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.424945:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968804, next_transno: 4294968804 00010000:00080000:1.0:1784047628.424950:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968804) 00010000:00080000:1.0:1784047628.424959:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689551360 t4294968804 from 192.168.204.40@tcp req@ffff99cbc9be5180 x1870705689551360/t0(4294968804) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.424976:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc9be5180 x1870705689551360/t0(4294968804) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.425080:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.425111:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.425114:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.425382:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 26 00000020:00000040:1.0:1784047628.425386:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=31 00010000:00000040:1.0:1784047628.425749:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968804, xid 1870705689551360 00000100:00000040:1.0:1784047628.425761:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.425769:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.425864:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.425875:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.425883:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.425897:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 30 00010000:00080000:1.0:1784047628.425901:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968805 00010000:00080000:1.0:1784047628.425905:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968805 00000100:00000040:1.0:1784047628.435746:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccec978380 x1870705689551616 msgsize 1512 00000100:00100000:1.0:1784047628.435763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.435924:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551616 00000100:00100000:2.0:1784047628.435952:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551616 00000020:00000040:2.0:1784047628.435956:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.435960:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=31 00000100:00000040:2.0:1784047628.435982:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.436057:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 672 00000100:00000040:2.0:1784047628.436062:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.436070:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccec978380 x1870705689551616/t0(4294968805) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.436084:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+31:2398:x1870705689551616:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:2.0:1784047628.436096:0:8437:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccec978380 x1870705689551616/t0(4294968805) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.436104:0:8437:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968805, current: 4294968805, replaying 00010000:00000040:2.0:1784047628.436107:0:8437:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.436174:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccec978380 x1870705689551616/t0(4294968805) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.436183:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccec978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+31:2398:x1870705689551616:12345-192.168.204.40@tcp:4:dd.0 Request processed in 102us (438us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.436189:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 672 00000100:00000040:2.0:1784047628.436193:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.436237:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968805, next_transno: 4294968805 00010000:00080000:3.0:1784047628.436241:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968805) 00010000:00080000:3.0:1784047628.436249:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689551616 t4294968805 from 192.168.204.40@tcp req@ffff99ccec978380 x1870705689551616/t0(4294968805) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.436264:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccec978380 x1870705689551616/t0(4294968805) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.436359:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784047628.436387:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:3.0:1784047628.436390:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784047628.437004:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 27 00000020:00000040:3.0:1784047628.437009:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=32 00010000:00000040:3.0:1784047628.437076:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968805, xid 1870705689551616 00000100:00000040:3.0:1784047628.437087:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.437094:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.437206:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.437217:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.437224:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.437233:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 31 00010000:00080000:3.0:1784047628.437238:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968806 00010000:00080000:3.0:1784047628.437242:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968806 00000100:00000040:3.0:1784047628.439867:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cce495b480 x1870705689551872 msgsize 1512 00000100:00100000:3.0:1784047628.439882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.439960:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689551872 00000100:00100000:2.0:1784047628.439971:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689551872 00000020:00000040:2.0:1784047628.439974:0:24867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.439980:0:24867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=32 00000100:00000040:2.0:1784047628.440004:0:24867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.440056:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 673 00000100:00000040:2.0:1784047628.440062:0:24867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.440069:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cce495b480 x1870705689551872/t0(4294968806) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.440102:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+32:2398:x1870705689551872:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:2.0:1784047628.440115:0:24867:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cce495b480 x1870705689551872/t0(4294968806) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.440123:0:24867:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968806, current: 4294968806, replaying 00010000:00000040:2.0:1784047628.440126:0:24867:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.440155:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce495b480 x1870705689551872/t0(4294968806) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.440163:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce495b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+32:2398:x1870705689551872:12345-192.168.204.40@tcp:4:dd.0 Request processed in 65us (296us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.440170:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 673 00000100:00000040:2.0:1784047628.440172:0:24867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.440218:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968806, next_transno: 4294968806 00010000:00080000:1.0:1784047628.440223:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968806) 00010000:00080000:1.0:1784047628.440231:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689551872 t4294968806 from 192.168.204.40@tcp req@ffff99cce495b480 x1870705689551872/t0(4294968806) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.440250:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cce495b480 x1870705689551872/t0(4294968806) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.440347:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.440376:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.440379:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.440646:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 28 00000020:00000040:1.0:1784047628.440651:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=33 00010000:00000040:1.0:1784047628.442663:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968806, xid 1870705689551872 00000100:00000040:1.0:1784047628.442683:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.442692:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.442745:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.442769:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.442778:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.442790:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 32 00010000:00080000:1.0:1784047628.442795:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968807 00010000:00080000:1.0:1784047628.442799:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968807 00000100:00000040:0.0:1784047628.447719:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9be5500 x1870705689552128 msgsize 1512 00000100:00100000:0.0:1784047628.447734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.447868:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552128 00000100:00100000:1.0:1784047628.447877:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552128 00000020:00000040:1.0:1784047628.447881:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.447885:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=33 00000100:00000040:1.0:1784047628.447909:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.447973:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 674 00000100:00000040:1.0:1784047628.447979:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.447986:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9be5500 x1870705689552128/t0(4294968807) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.448001:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+33:2398:x1870705689552128:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:1.0:1784047628.448012:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc9be5500 x1870705689552128/t0(4294968807) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.448020:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968807, current: 4294968807, replaying 00010000:00000040:1.0:1784047628.448024:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.448034:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9be5500 x1870705689552128/t0(4294968807) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.448042:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c846d7a-6357-4e9c-a620-e35737ede709+33:2398:x1870705689552128:12345-192.168.204.40@tcp:4:dd.0 Request processed in 45us (325us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.448049:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 674 00000100:00000040:1.0:1784047628.448052:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.448183:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968807, next_transno: 4294968807 00010000:00080000:0.0:1784047628.448190:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968807) 00010000:00080000:0.0:1784047628.448201:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689552128 t4294968807 from 192.168.204.40@tcp req@ffff99cbc9be5500 x1870705689552128/t0(4294968807) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.448221:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc9be5500 x1870705689552128/t0(4294968807) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.448320:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784047628.448348:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:0.0:1784047628.448351:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784047628.448591:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 29 00000020:00000040:0.0:1784047628.448595:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=34 00010000:00000040:0.0:1784047628.448794:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968807, xid 1870705689552128 00000100:00000040:0.0:1784047628.448805:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.448819:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.448910:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.448921:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.448927:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.448947:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 33 00010000:00080000:0.0:1784047628.448952:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968808 00010000:00080000:0.0:1784047628.448955:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968808 00000100:00000040:3.0:1784047628.454437:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccc482fb80 x1870705689552384 msgsize 1512 00000100:00100000:3.0:1784047628.454453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.454577:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552384 00000100:00100000:0.0:1784047628.456472:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552384 00000020:00000040:0.0:1784047628.456479:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.456486:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=34 00000100:00000040:0.0:1784047628.456523:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.456650:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 675 00000100:00000040:0.0:1784047628.456656:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.456665:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccc482fb80 x1870705689552384/t0(4294968808) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.456680:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:2398:x1870705689552384:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.456695:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccc482fb80 x1870705689552384/t0(4294968808) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.456705:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968808, current: 4294968808, replaying 00010000:00000040:0.0:1784047628.456708:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.456721:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccc482fb80 x1870705689552384/t0(4294968808) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.456729:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+34:2398:x1870705689552384:12345-192.168.204.40@tcp:4:dd.0 Request processed in 52us (2294us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.456736:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 675 00000100:00000040:0.0:1784047628.456738:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.457088:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968808, next_transno: 4294968808 00010000:00080000:0.0:1784047628.457093:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968808) 00010000:00080000:0.0:1784047628.457102:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689552384 t4294968808 from 192.168.204.40@tcp req@ffff99ccc482fb80 x1870705689552384/t0(4294968808) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.457120:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccc482fb80 x1870705689552384/t0(4294968808) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.457229:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784047628.457258:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:0.0:1784047628.457262:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784047628.460161:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 30 00000020:00000040:0.0:1784047628.460172:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=35 00010000:00000040:0.0:1784047628.460220:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968808, xid 1870705689552384 00000100:00000040:0.0:1784047628.460235:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.460244:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.460317:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.460331:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.460342:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.460354:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 34 00010000:00080000:0.0:1784047628.460360:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968809 00010000:00080000:0.0:1784047628.460365:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968809 00000100:00000040:3.0:1784047628.465119:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccc482ce00 x1870705689552640 msgsize 1512 00000100:00100000:3.0:1784047628.465138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.466859:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552640 00000100:00100000:0.0:1784047628.466875:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552640 00000020:00000040:0.0:1784047628.466878:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.466884:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=35 00000100:00000040:0.0:1784047628.466912:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.468236:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 676 00000100:00000040:0.0:1784047628.468243:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.468251:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccc482ce00 x1870705689552640/t0(4294968809) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.468279:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+35:2398:x1870705689552640:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.468292:0:8438:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccc482ce00 x1870705689552640/t0(4294968809) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.468300:0:8438:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968809, current: 4294968809, replaying 00010000:00000040:0.0:1784047628.468304:0:8438:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.468315:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccc482ce00 x1870705689552640/t0(4294968809) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.468324:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc482ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+35:2398:x1870705689552640:12345-192.168.204.40@tcp:4:dd.0 Request processed in 49us (3206us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.468331:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 676 00000100:00000040:0.0:1784047628.468334:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.468829:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968809, next_transno: 4294968809 00010000:00080000:1.0:1784047628.468840:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968809) 00010000:00080000:1.0:1784047628.468848:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689552640 t4294968809 from 192.168.204.40@tcp req@ffff99ccc482ce00 x1870705689552640/t0(4294968809) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.468863:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccc482ce00 x1870705689552640/t0(4294968809) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.468968:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.469006:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.469009:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.469588:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 31 00000020:00000040:1.0:1784047628.469593:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=36 00010000:00000040:1.0:1784047628.469804:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968809, xid 1870705689552640 00000100:00000040:1.0:1784047628.469816:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.469823:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.469876:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.469887:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.470089:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.470103:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 35 00010000:00080000:1.0:1784047628.470107:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968810 00010000:00080000:1.0:1784047628.470112:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968810 00000100:00000040:0.0:1784047628.472710:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0045a680 x1870705689552896 msgsize 1512 00000100:00100000:0.0:1784047628.472724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.473069:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689552896 00000100:00100000:2.0:1784047628.473080:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689552896 00000020:00000040:2.0:1784047628.473083:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.473088:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=36 00000100:00000040:2.0:1784047628.473112:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.473171:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 677 00000100:00000040:2.0:1784047628.473176:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.473185:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0045a680 x1870705689552896/t0(4294968810) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.473200:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+36:2398:x1870705689552896:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:2.0:1784047628.473210:0:8437:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd0045a680 x1870705689552896/t0(4294968810) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.473220:0:8437:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968810, current: 4294968810, replaying 00010000:00000040:2.0:1784047628.473233:0:8437:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.473256:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0045a680 x1870705689552896/t0(4294968810) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.473265:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c846d7a-6357-4e9c-a620-e35737ede709+36:2398:x1870705689552896:12345-192.168.204.40@tcp:4:dd.0 Request processed in 68us (555us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.473273:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 677 00000100:00000040:2.0:1784047628.473276:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.473410:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968810, next_transno: 4294968810 00010000:00080000:0.0:1784047628.473415:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968810) 00010000:00080000:0.0:1784047628.473423:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689552896 t4294968810 from 192.168.204.40@tcp req@ffff99cd0045a680 x1870705689552896/t0(4294968810) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.473440:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd0045a680 x1870705689552896/t0(4294968810) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.473542:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784047628.473573:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:0.0:1784047628.473577:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.474121:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 32 00000020:00000040:1.0:1784047628.474130:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=37 00010000:00000040:1.0:1784047628.474520:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968810, xid 1870705689552896 00000100:00000040:1.0:1784047628.474536:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.474543:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.474600:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.474630:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.474641:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.474651:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 36 00010000:00080000:1.0:1784047628.474665:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968811 00010000:00080000:1.0:1784047628.474669:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968811 00000100:00000040:1.0:1784047628.484601:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef505f80 x1870705689553152 msgsize 1512 00000100:00100000:1.0:1784047628.484635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.485268:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553152 00000100:00100000:0.0:1784047628.485279:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553152 00000020:00000040:0.0:1784047628.485306:0:24868:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.485312:0:24868:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=37 00000100:00000040:0.0:1784047628.485344:0:24868:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.485398:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 678 00000100:00000040:0.0:1784047628.485403:0:24868:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.485410:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef505f80 x1870705689553152/t0(4294968811) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.485423:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+37:2398:x1870705689553152:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.485434:0:24868:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef505f80 x1870705689553152/t0(4294968811) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.485443:0:24868:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968811, current: 4294968811, replaying 00010000:00000040:0.0:1784047628.485830:0:24868:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.485881:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef505f80 x1870705689553152/t0(4294968811) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.485893:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+37:2398:x1870705689553152:12345-192.168.204.40@tcp:4:dd.0 Request processed in 472us (1447us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.485901:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 678 00000100:00000040:0.0:1784047628.485905:0:24868:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.485950:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968811, next_transno: 4294968811 00010000:00080000:1.0:1784047628.485954:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968811) 00010000:00080000:1.0:1784047628.485962:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689553152 t4294968811 from 192.168.204.40@tcp req@ffff99ccef505f80 x1870705689553152/t0(4294968811) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.485979:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef505f80 x1870705689553152/t0(4294968811) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.486072:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.486269:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.486273:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.486763:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 33 00000020:00000040:1.0:1784047628.486769:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=38 00010000:00000040:1.0:1784047628.488414:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968811, xid 1870705689553152 00000100:00000040:1.0:1784047628.488434:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.488442:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.488558:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.488571:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.488581:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.488594:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 37 00010000:00080000:1.0:1784047628.488600:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968812 00010000:00080000:1.0:1784047628.488635:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968812 00000100:00000040:1.0:1784047628.497299:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef507100 x1870705689553408 msgsize 1512 00000100:00100000:1.0:1784047628.497313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.497397:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553408 00000100:00100000:2.0:1784047628.497407:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553408 00000020:00000040:2.0:1784047628.497411:0:24851:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.497416:0:24851:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=38 00000100:00000040:2.0:1784047628.497442:0:24851:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.497496:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 679 00000100:00000040:2.0:1784047628.497500:0:24851:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.497507:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef507100 x1870705689553408/t0(4294968812) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.497521:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+38:2398:x1870705689553408:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:2.0:1784047628.497532:0:24851:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef507100 x1870705689553408/t0(4294968812) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.497541:0:24851:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968812, current: 4294968812, replaying 00010000:00000040:2.0:1784047628.497544:0:24851:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.497564:0:24851:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef507100 x1870705689553408/t0(4294968812) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.497573:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c846d7a-6357-4e9c-a620-e35737ede709+38:2398:x1870705689553408:12345-192.168.204.40@tcp:4:dd.0 Request processed in 54us (275us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.497580:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 679 00000100:00000040:2.0:1784047628.497591:0:24851:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:1.0:1784047628.497646:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968812, next_transno: 4294968812 00010000:00080000:1.0:1784047628.497657:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968812) 00010000:00080000:1.0:1784047628.497667:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689553408 t4294968812 from 192.168.204.40@tcp req@ffff99ccef507100 x1870705689553408/t0(4294968812) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.497684:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef507100 x1870705689553408/t0(4294968812) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.497773:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.497801:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.497804:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.498084:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 34 00000020:00000040:1.0:1784047628.498089:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=39 00010000:00000040:1.0:1784047628.499324:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968812, xid 1870705689553408 00000100:00000040:1.0:1784047628.499342:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.499349:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.499416:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.499428:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.499436:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.499447:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 38 00010000:00080000:1.0:1784047628.499451:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968813 00010000:00080000:1.0:1784047628.499455:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968813 00000100:00000040:3.0:1784047628.503894:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc79f3800 x1870705689553664 msgsize 1512 00000100:00100000:3.0:1784047628.503917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.504017:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553664 00000100:00100000:0.0:1784047628.504027:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553664 00000020:00000040:0.0:1784047628.504030:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.504035:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=39 00000100:00000040:0.0:1784047628.504060:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.504111:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 680 00000100:00000040:0.0:1784047628.504116:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.504124:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc79f3800 x1870705689553664/t0(4294968813) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.504161:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+39:2398:x1870705689553664:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.504175:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f3800 x1870705689553664/t0(4294968813) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.504184:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968813, current: 4294968813, replaying 00010000:00000040:0.0:1784047628.504188:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.504208:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc79f3800 x1870705689553664/t0(4294968813) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.504217:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+39:2398:x1870705689553664:12345-192.168.204.40@tcp:4:dd.0 Request processed in 60us (323us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.504225:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 680 00000100:00000040:0.0:1784047628.504229:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.504232:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968813, next_transno: 4294968813 00010000:00080000:2.0:1784047628.504238:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968813) 00010000:00080000:2.0:1784047628.504249:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689553664 t4294968813 from 192.168.204.40@tcp req@ffff99cbc79f3800 x1870705689553664/t0(4294968813) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.504266:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f3800 x1870705689553664/t0(4294968813) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.504355:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784047628.504382:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:2.0:1784047628.504385:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784047628.504658:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 35 00000020:00000040:2.0:1784047628.504662:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=40 00010000:00000040:2.0:1784047628.504839:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968813, xid 1870705689553664 00000100:00000040:2.0:1784047628.504850:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.504857:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.504910:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.504920:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.504937:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.504948:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 39 00010000:00080000:2.0:1784047628.504953:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968814 00010000:00080000:2.0:1784047628.504957:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968814 00000100:00000040:3.0:1784047628.510389:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc79f2d80 x1870705689553920 msgsize 1512 00000100:00100000:3.0:1784047628.510406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.510465:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689553920 00000100:00100000:0.0:1784047628.510476:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689553920 00000020:00000040:0.0:1784047628.510479:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.510485:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=40 00000100:00000040:0.0:1784047628.510509:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.510561:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 681 00000100:00000040:0.0:1784047628.510567:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.510574:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc79f2d80 x1870705689553920/t0(4294968814) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.510588:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+40:2398:x1870705689553920:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.510600:0:8438:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f2d80 x1870705689553920/t0(4294968814) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.510628:0:8438:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968814, current: 4294968814, replaying 00010000:00000040:0.0:1784047628.510640:0:8438:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.510659:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc79f2d80 x1870705689553920/t0(4294968814) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.510669:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c846d7a-6357-4e9c-a620-e35737ede709+40:2398:x1870705689553920:12345-192.168.204.40@tcp:4:dd.0 Request processed in 83us (281us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.510677:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 681 00000100:00000040:0.0:1784047628.510681:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.511462:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968814, next_transno: 4294968814 00010000:00080000:3.0:1784047628.511468:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968814) 00010000:00080000:3.0:1784047628.511478:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689553920 t4294968814 from 192.168.204.40@tcp req@ffff99cbc79f2d80 x1870705689553920/t0(4294968814) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.511497:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f2d80 x1870705689553920/t0(4294968814) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.511597:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784047628.511646:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:3.0:1784047628.511650:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784047628.511949:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 36 00000020:00000040:3.0:1784047628.511954:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=41 00010000:00000040:2.0:1784047628.513237:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968814, xid 1870705689553920 00000100:00000040:2.0:1784047628.513251:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.513260:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.513323:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.513335:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.513344:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.513356:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 40 00010000:00080000:2.0:1784047628.513369:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968815 00010000:00080000:2.0:1784047628.513373:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968815 00000100:00000040:3.0:1784047628.520797:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc79f2a00 x1870705689554176 msgsize 1512 00000100:00100000:3.0:1784047628.520814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047628.521093:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554176 00000100:00100000:1.0:1784047628.521104:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554176 00000020:00000040:1.0:1784047628.521107:0:24867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:1.0:1784047628.521112:0:24867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=41 00000100:00000040:1.0:1784047628.521150:0:24867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784047628.521208:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 682 00000100:00000040:1.0:1784047628.521213:0:24867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:1.0:1784047628.521222:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc79f2a00 x1870705689554176/t0(4294968815) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.521255:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+41:2398:x1870705689554176:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:1.0:1784047628.521267:0:24867:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f2a00 x1870705689554176/t0(4294968815) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784047628.521275:0:24867:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968815, current: 4294968815, replaying 00010000:00000040:1.0:1784047628.521279:0:24867:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:1.0:1784047628.521300:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc79f2a00 x1870705689554176/t0(4294968815) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784047628.521309:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c846d7a-6357-4e9c-a620-e35737ede709+41:2398:x1870705689554176:12345-192.168.204.40@tcp:4:dd.0 Request processed in 57us (524us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784047628.521316:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 682 00000100:00000040:1.0:1784047628.521319:0:24867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:0.0:1784047628.521367:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968815, next_transno: 4294968815 00010000:00080000:0.0:1784047628.521372:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968815) 00010000:00080000:0.0:1784047628.521380:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689554176 t4294968815 from 192.168.204.40@tcp req@ffff99cbc79f2a00 x1870705689554176/t0(4294968815) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.521396:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f2a00 x1870705689554176/t0(4294968815) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784047628.521494:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784047628.521527:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:0.0:1784047628.521530:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784047628.522327:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 37 00000020:00000040:0.0:1784047628.522331:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=42 00010000:00000040:0.0:1784047628.522524:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968815, xid 1870705689554176 00000100:00000040:0.0:1784047628.522537:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047628.522543:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047628.522759:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:0.0:1784047628.522770:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784047628.522777:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:0.0:1784047628.522800:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 41 00010000:00080000:0.0:1784047628.522805:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968816 00010000:00080000:0.0:1784047628.522809:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968816 00000100:00000040:1.0:1784047628.532519:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef504a80 x1870705689554432 msgsize 1512 00000100:00100000:1.0:1784047628.532536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.534516:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554432 00000100:00100000:0.0:1784047628.534532:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554432 00000020:00000040:0.0:1784047628.534536:0:24868:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.534541:0:24868:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=42 00000100:00000040:0.0:1784047628.534569:0:24868:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784047628.534635:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 683 00000100:00000040:0.0:1784047628.534640:0:24868:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.534649:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef504a80 x1870705689554432/t0(4294968816) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.534665:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+42:2398:x1870705689554432:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:0.0:1784047628.534678:0:24868:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef504a80 x1870705689554432/t0(4294968816) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784047628.534688:0:24868:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968816, current: 4294968816, replaying 00010000:00000040:0.0:1784047628.534692:0:24868:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.534712:0:24868:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef504a80 x1870705689554432/t0(4294968816) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784047628.534722:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c846d7a-6357-4e9c-a620-e35737ede709+42:2398:x1870705689554432:12345-192.168.204.40@tcp:4:dd.0 Request processed in 61us (2204us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.534730:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 683 00000100:00000040:0.0:1784047628.534734:0:24868:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:2.0:1784047628.534776:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968816, next_transno: 4294968816 00010000:00080000:2.0:1784047628.534782:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968816) 00010000:00080000:2.0:1784047628.534792:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689554432 t4294968816 from 192.168.204.40@tcp req@ffff99ccef504a80 x1870705689554432/t0(4294968816) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.534810:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef504a80 x1870705689554432/t0(4294968816) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1784047628.534926:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1784047628.534966:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:2.0:1784047628.535043:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1784047628.535661:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 38 00000020:00000040:2.0:1784047628.535667:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=43 00010000:00000040:2.0:1784047628.536046:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968816, xid 1870705689554432 00000100:00000040:2.0:1784047628.536060:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:2.0:1784047628.536067:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:2.0:1784047628.536242:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:2.0:1784047628.536256:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1784047628.536265:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:2.0:1784047628.536276:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 42 00010000:00080000:2.0:1784047628.536281:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968817 00010000:00080000:2.0:1784047628.536286:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968817 00000100:00000040:3.0:1784047628.542274:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc79f1180 x1870705689554688 msgsize 1512 00000100:00100000:3.0:1784047628.542291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047628.542473:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554688 00000100:00100000:2.0:1784047628.542483:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554688 00000020:00000040:2.0:1784047628.542486:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:2.0:1784047628.542492:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=43 00000100:00000040:2.0:1784047628.542518:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784047628.542574:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 684 00000100:00000040:2.0:1784047628.542586:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:2.0:1784047628.542595:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc79f1180 x1870705689554688/t0(4294968817) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.542637:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+43:2398:x1870705689554688:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:2.0:1784047628.542650:0:8436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f1180 x1870705689554688/t0(4294968817) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784047628.542658:0:8436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968817, current: 4294968817, replaying 00010000:00000040:2.0:1784047628.542661:0:8436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:2.0:1784047628.542676:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc79f1180 x1870705689554688/t0(4294968817) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784047628.542683:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c846d7a-6357-4e9c-a620-e35737ede709+43:2398:x1870705689554688:12345-192.168.204.40@tcp:4:dd.0 Request processed in 77us (410us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784047628.542689:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 684 00000100:00000040:2.0:1784047628.542692:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00010000:00080000:3.0:1784047628.542717:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968817, next_transno: 4294968817 00010000:00080000:3.0:1784047628.542723:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968817) 00010000:00080000:3.0:1784047628.542732:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689554688 t4294968817 from 192.168.204.40@tcp req@ffff99cbc79f1180 x1870705689554688/t0(4294968817) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.542749:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cbc79f1180 x1870705689554688/t0(4294968817) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784047628.542841:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784047628.542869:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:3.0:1784047628.542872:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784047628.543150:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 39 00000020:00000040:3.0:1784047628.543155:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=44 00010000:00000040:3.0:1784047628.543967:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968817, xid 1870705689554688 00000100:00000040:3.0:1784047628.544114:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047628.544217:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047628.544321:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:3.0:1784047628.544334:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784047628.544342:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:3.0:1784047628.544353:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 43 00010000:00080000:3.0:1784047628.544357:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968818 00010000:00080000:3.0:1784047628.544361:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968818 00000100:00000040:1.0:1784047628.549754:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99ccef507800 x1870705689554944 msgsize 1512 00000100:00100000:1.0:1784047628.549770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047628.549869:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689554944 00000100:00100000:3.0:1784047628.549879:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689554944 00000020:00000040:3.0:1784047628.549882:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:3.0:1784047628.549888:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=44 00000100:00000040:3.0:1784047628.549915:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784047628.549979:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 685 00000100:00000040:3.0:1784047628.549985:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:3.0:1784047628.549994:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccef507800 x1870705689554944/t0(4294968818) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.550009:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccef507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+44:2398:x1870705689554944:12345-192.168.204.40@tcp:4:dd.0 00000020:00000040:3.0:1784047628.550023:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef507800 x1870705689554944/t0(4294968818) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784047628.550031:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968818, current: 4294968818, replaying 00010000:00000040:3.0:1784047628.550035:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:3.0:1784047628.550055:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccef507800 x1870705689554944/t0(4294968818) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.550064:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccef507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c846d7a-6357-4e9c-a620-e35737ede709+44:2398:x1870705689554944:12345-192.168.204.40@tcp:4:dd.0 Request processed in 60us (312us total) trans 0 rc 0/-999 00010000:00080000:1.0:1784047628.550075:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968818, next_transno: 4294968818 00010000:00080000:1.0:1784047628.550081:0:96960:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968818) 00010000:00080000:1.0:1784047628.550093:0:96960:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870705689554944 t4294968818 from 192.168.204.40@tcp req@ffff99ccef507800 x1870705689554944/t0(4294968818) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784047628.550095:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 685 00000100:00000040:3.0:1784047628.550102:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00000020:00000040:1.0:1784047628.550119:0:96960:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99ccef507800 x1870705689554944/t0(4294968818) o4->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 1512/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784047628.550215:0:96960:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784047628.550258:0:96960:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3991 MB/s 00000020:00000040:1.0:1784047628.550262:0:96960:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784047628.551644:0:96960:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff99ccfe6bc800 : new cb_count 40 00000020:00000040:1.0:1784047628.551652:0:96960:0:(genops.c:889:class_export_get()) GET export ffff99ccfe6bc800 refcount=45 00010000:00000040:1.0:1784047628.551712:0:96960:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968778, transno 4294968818, xid 1870705689554944 00000100:00000040:1.0:1784047628.551724:0:96960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047628.551731:0:96960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047628.551784:0:96960:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00010000:00080000:1.0:1784047628.551795:0:96960:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784047628.551804:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.551816:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 44 00010000:00080000:1.0:1784047628.551821:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968819 00010000:00080000:1.0:1784047628.551826:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968819 00010000:00010000:3.0:1784047628.563778:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1784047628.563872:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0045b800 x1870705689558400 msgsize 328 00000100:00100000:0.0:1784047628.563884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.563920:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0062df80 x1870705689558528 msgsize 328 00000100:00100000:0.0:1784047628.563934:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.563956:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0062ce00 x1870705689558656 msgsize 328 00000100:00100000:0.0:1784047628.563960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.563974:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0062c700 x1870705689558784 msgsize 328 00000100:00100000:0.0:1784047628.563995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.564027:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd00d9ed80 x1870705689558912 msgsize 328 00000100:00100000:0.0:1784047628.564032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.564049:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd00d9e300 x1870705689559040 msgsize 328 00000100:00100000:0.0:1784047628.564053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.564069:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd00fc2a00 x1870705689559168 msgsize 328 00000100:00100000:0.0:1784047628.564073:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047628.564094:0:3640:0:(events.c:337:request_in_callback()) incoming req@ffff99cd00fc2680 x1870705689559296 msgsize 328 00000100:00100000:0.0:1784047628.564098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047628.564128:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558400 00000100:00100000:0.0:1784047628.564137:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558400 00000020:00000040:0.0:1784047628.564140:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564145:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=45 00000100:00100000:0.0:1784047628.564186:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558528 00000100:00100000:0.0:1784047628.564189:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558528 00000020:00000040:0.0:1784047628.564191:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564193:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=46 00000100:00100000:0.0:1784047628.564210:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558656 00000100:00100000:0.0:1784047628.564213:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558656 00000020:00000040:0.0:1784047628.564215:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564216:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=47 00000100:00100000:0.0:1784047628.564228:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558784 00000100:00100000:0.0:1784047628.564230:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558784 00000020:00000040:0.0:1784047628.564232:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564233:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=48 00000100:00100000:0.0:1784047628.564247:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689558912 00000100:00100000:0.0:1784047628.564249:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689558912 00000020:00000040:0.0:1784047628.564251:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564253:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=49 00000100:00100000:0.0:1784047628.564267:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559040 00000100:00100000:0.0:1784047628.564270:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559040 00000020:00000040:0.0:1784047628.564271:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564279:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=50 00000100:00100000:0.0:1784047628.564296:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559168 00000100:00100000:0.0:1784047628.564299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559168 00000020:00000040:0.0:1784047628.564300:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564302:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=51 00000100:00100000:0.0:1784047628.564317:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559296 00000100:00100000:0.0:1784047628.564319:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559296 00000020:00000040:0.0:1784047628.564320:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a4b 00000020:00000040:0.0:1784047628.564322:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe6bc800 refcount=52 00000100:00100000:0.0:1784047628.564341:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5094 00000100:00000040:0.0:1784047628.564346:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00000040:0.0:1784047628.564354:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0045b800 x1870705689558400/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564366:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558400:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564379:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd0045b800 x1870705689558400/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564389:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00010000:00080000:0.0:1784047628.564394:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd0045b800 x1870705689558400/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564408:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0045b800 x1870705689558400/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564418:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0045b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558400:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 52us (544us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564425:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5094 00000100:00000040:0.0:1784047628.564428:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00000100:00100000:0.0:1784047628.564437:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5095 00000100:00000040:0.0:1784047628.564446:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00000040:0.0:1784047628.564451:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0062df80 x1870705689558528/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564460:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558528:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564467:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd0062df80 x1870705689558528/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564473:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 3 00010000:00080000:0.0:1784047628.564476:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd0062df80 x1870705689558528/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564483:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0062df80 x1870705689558528/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564490:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558528:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 32us (568us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564496:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5095 00000100:00000040:0.0:1784047628.564498:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 2 00000100:00100000:0.0:1784047628.564507:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5096 00000100:00000040:0.0:1784047628.564509:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 3 00000100:00000040:0.0:1784047628.564513:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0062ce00 x1870705689558656/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564523:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558656:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564529:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd0062ce00 x1870705689558656/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564535:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 4 00010000:00080000:0.0:1784047628.564544:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd0062ce00 x1870705689558656/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564553:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0062ce00 x1870705689558656/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564562:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558656:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 40us (604us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564568:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5096 00000100:00000040:0.0:1784047628.564570:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 3 00000100:00100000:0.0:1784047628.564577:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5097 00000100:00000040:0.0:1784047628.564580:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 4 00000100:00000040:0.0:1784047628.564583:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0062c700 x1870705689558784/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564593:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558784:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564599:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd0062c700 x1870705689558784/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564630:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 5 00010000:00080000:0.0:1784047628.564634:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd0062c700 x1870705689558784/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564643:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0062c700 x1870705689558784/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564652:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0062c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558784:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 60us (675us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564658:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5097 00000100:00000040:0.0:1784047628.564665:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 4 00000100:00100000:0.0:1784047628.564674:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5098 00000100:00000040:0.0:1784047628.564677:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 5 00000100:00000040:0.0:1784047628.564681:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd00d9ed80 x1870705689558912/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564692:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558912:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564699:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd00d9ed80 x1870705689558912/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564705:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 6 00010000:00080000:0.0:1784047628.564708:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd00d9ed80 x1870705689558912/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564716:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00d9ed80 x1870705689558912/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564724:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689558912:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 34us (695us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564730:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5098 00000100:00000040:0.0:1784047628.564732:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 5 00000100:00100000:0.0:1784047628.564739:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5099 00000100:00000040:0.0:1784047628.564742:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 6 00000100:00000040:0.0:1784047628.564745:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd00d9e300 x1870705689559040/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564753:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689559040:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564759:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd00d9e300 x1870705689559040/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564771:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 7 00010000:00080000:0.0:1784047628.564774:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd00d9e300 x1870705689559040/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564782:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00d9e300 x1870705689559040/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564789:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689559040:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 38us (739us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564795:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5099 00000100:00000040:0.0:1784047628.564797:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 6 00000100:00100000:0.0:1784047628.564806:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5100 00000100:00000040:0.0:1784047628.564808:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 7 00000100:00000040:0.0:1784047628.564812:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd00fc2a00 x1870705689559168/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564822:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689559168:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564828:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd00fc2a00 x1870705689559168/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564835:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 8 00010000:00080000:0.0:1784047628.564838:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd00fc2a00 x1870705689559168/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564846:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00fc2a00 x1870705689559168/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564854:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689559168:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 33us (783us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564866:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5100 00000100:00000040:0.0:1784047628.564868:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 7 00000100:00100000:0.0:1784047628.564877:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5101 00000100:00000040:0.0:1784047628.564879:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 8 00000100:00000040:0.0:1784047628.564882:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd00fc2680 x1870705689559296/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564892:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689559296:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1784047628.564899:0:8433:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff99cd00fc2680 x1870705689559296/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784047628.564906:0:8433:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff99ccfe6bc800 : new rpc_count 9 00010000:00080000:0.0:1784047628.564909:0:8433:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cd00fc2680 x1870705689559296/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047628.564917:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00fc2680 x1870705689559296/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047628.564924:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c846d7a-6357-4e9c-a620-e35737ede709+52:2398:x1870705689559296:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 34us (829us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047628.564940:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5101 00000100:00000040:0.0:1784047628.564942:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 8 00010000:00080000:1.0:1784047628.565789:0:96960:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968819 00010000:00080000:1.0:1784047628.565795:0:96960:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00000040:1.0:1784047628.565802:0:96960:0:(ldlm_lib.c:2881:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:1.0:1784047628.565804:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.565806:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.565815:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd0045b800 x1870705689558400/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.565823:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571238:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 7 00000020:00000040:1.0:1784047628.571260:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 51 00010000:00080000:1.0:1784047628.571265:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571357:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571374:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd0062df80 x1870705689558528/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571385:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571387:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 6 00000020:00000040:1.0:1784047628.571397:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 50 00010000:00080000:1.0:1784047628.571401:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571411:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571418:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd0062ce00 x1870705689558656/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571426:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571428:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 5 00000020:00000040:1.0:1784047628.571437:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 49 00010000:00080000:1.0:1784047628.571440:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571442:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571449:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd0062c700 x1870705689558784/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571456:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571458:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 4 00000020:00000040:1.0:1784047628.571466:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 48 00010000:00080000:1.0:1784047628.571468:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571470:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571475:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd00d9ed80 x1870705689558912/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571481:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571483:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 3 00000020:00000040:1.0:1784047628.571489:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 47 00010000:00080000:1.0:1784047628.571491:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571493:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571499:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd00d9e300 x1870705689559040/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571506:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571508:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 2 00000020:00000040:1.0:1784047628.571514:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 46 00010000:00080000:1.0:1784047628.571517:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571519:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571524:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd00fc2a00 x1870705689559168/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571536:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571538:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 1 00000020:00000040:1.0:1784047628.571546:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 45 00010000:00080000:1.0:1784047628.571548:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047628.571550:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047628.571555:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cd00fc2680 x1870705689559296/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:4/0 lens 328/0 e 0 to 0 dl 1784047639 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047628.571562:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1784047628.571564:0:96960:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff99ccfe6bc800 : new rpc_count 0 00000020:00000040:1.0:1784047628.571570:0:96960:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 44 00010000:00080000:1.0:1784047628.571572:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000020:00000040:2.0:1784047628.842909:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff99cbc6e93380) now 10 - health_check_show 00000020:00000040:2.0:1784047628.842934:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff99cbc6e93380) now 10 - health_check_show 00000020:00000040:2.0:1784047628.842938:0:97108:0:(obd_config.c:994:class_incref()) incref MDS (ffff99ccfebb0000) now 4 - health_check_show 00000020:00000040:2.0:1784047628.842947:0:97108:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff99ccfebb0000) now 4 - health_check_show 00000020:00000040:2.0:1784047628.842949:0:97108:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.140@tcp (ffff99ccc5e4b380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842951:0:97108:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.140@tcp (ffff99ccc5e4b380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842953:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff99cceff38000) now 12 - health_check_show 00000020:00000040:2.0:1784047628.842956:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff99cceff38000) now 12 - health_check_show 00000020:00000040:2.0:1784047628.842958:0:97108:0:(obd_config.c:994:class_incref()) incref MGS (ffff99ccc5e4cd40) now 8 - health_check_show 00000020:00000040:2.0:1784047628.842961:0:97108:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff99ccc5e4cd40) now 8 - health_check_show 00000020:00000040:2.0:1784047628.842963:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff99cd00c8b380) now 5 - health_check_show 00000020:00000040:2.0:1784047628.842966:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff99cd00c8b380) now 5 - health_check_show 00000020:00000040:2.0:1784047628.842973:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 12 - health_check_show 00000020:00000040:2.0:1784047628.842975:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 12 - health_check_show 00000020:00000040:2.0:1784047628.842977:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff99cd00c8cd40) now 5 - health_check_show 00000020:00000040:2.0:1784047628.842980:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff99cd00c8cd40) now 5 - health_check_show 00000020:00000040:2.0:1784047628.842982:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff99cbc98999c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842984:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff99cbc98999c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842986:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff99cbc6e919c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842988:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff99cbc6e919c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842990:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff99cbc989b380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842992:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff99cbc989b380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842994:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff99ccfebb3380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842997:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff99ccfebb3380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.842999:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff99cd001019c0) now 5 - health_check_show 00000020:00000040:2.0:1784047628.843001:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff99cd001019c0) now 5 - health_check_show 00000020:00000040:2.0:1784047628.843003:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 16 - health_check_show 00000020:00000040:2.0:1784047628.843005:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 16 - health_check_show 00000020:00000040:2.0:1784047628.843007:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff99cd00103380) now 5 - health_check_show 00000020:00000040:2.0:1784047628.843008:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff99cd00103380) now 5 - health_check_show 00000020:00000040:2.0:1784047628.843011:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff99cceff3cd40) now 5 - health_check_show 00000020:00000040:2.0:1784047628.843013:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff99cceff3cd40) now 5 - health_check_show 00000020:00000040:2.0:1784047628.843015:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff99ccc5e499c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843018:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff99ccc5e499c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843020:0:97108:0:(obd_config.c:994:class_incref()) incref OSS (ffff99cd00f03380) now 4 - health_check_show 00000020:00000040:2.0:1784047628.843027:0:97108:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff99cd00f03380) now 4 - health_check_show 00000020:00000040:2.0:1784047628.843029:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff99ccc4ac4d40) now 10 - health_check_show 00000020:00000040:2.0:1784047628.843091:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff99ccc4ac4d40) now 10 - health_check_show 00000020:00000040:2.0:1784047628.843094:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843096:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff99cd00104d40) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843106:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843108:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff99cbc76c8000) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843110:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff99ccc4ac3380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843112:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff99ccc4ac3380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843115:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff99ccc4ac19c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843117:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff99ccc4ac19c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843120:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff99cd00d7cd40) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843124:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff99cd00d7cd40) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843126:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - health_check_show 00000020:00000040:2.0:1784047628.843151:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - health_check_show 00000020:00000040:2.0:1784047628.843154:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff99cd00d7b380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843156:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff99cd00d7b380) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843159:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff99cbc76c99c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843161:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff99cbc76c99c0) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843163:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff99ccc4ac0000) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843165:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff99ccc4ac0000) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843167:0:97108:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff99ccc5e48000) now 6 - health_check_show 00000020:00000040:2.0:1784047628.843169:0:97108:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff99ccc5e48000) now 6 - health_check_show 00000020:00000040:1.0:1784047629.076502:0:75669:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1784047629.076557:0:75669:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006ccfc605] to pc [ptlrpcd_00_00+0] req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047629.076601:0:94384:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1784047629.076633:0:94384:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000aab87fea] to pc [ptlrpcd_00_01+1] req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047629.076670:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047629.076684:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709435648:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1784047629.076715:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047629.076723:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047629.076823:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2c15f80 x1870705709435648 msgsize 224 00000100:00100000:2.0:1784047629.076829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047629.076914:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047629.076938:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1599551 usecs (1600 jiffies) 00000100:00100000:2.0:1784047629.076957:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1784047629.076962:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047629.076971:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709435776:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1784047629.076985:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047629.076992:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047629.077005:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2c17800 x1870705709435776 msgsize 224 00000100:00100000:2.0:1784047629.077009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047629.077223:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047629.077234:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5821 usecs (6 jiffies) 00000100:00100000:1.0:1784047629.077512:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435648 00000100:00100000:1.0:1784047629.077522:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435648 00000020:00000040:1.0:1784047629.077524:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:1.0:1784047629.077529:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=7 00000100:00000040:1.0:1784047629.077556:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1784047629.077598:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435776 00000100:00100000:1.0:1784047629.077601:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435776 00000020:00000040:1.0:1784047629.077603:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:1.0:1784047629.077628:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=5 00000100:00100000:1.0:1784047629.077661:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00000040:1.0:1784047629.077666:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:1.0:1784047629.077673:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2c15f80 x1870705709435648/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047629.077696:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709435648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047629.077737:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00010000:00000040:1.0:1784047629.077750:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709435648 00000100:00000040:1.0:1784047629.077772:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047629.077779:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047629.077803:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047629.077822:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047629.077826:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c15f80 x1870705709435648/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:5/0 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047629.077834:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709435648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047629.077840:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00000040:1.0:1784047629.077843:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:1.0:1784047629.077854:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 6 00000100:00100000:1.0:1784047629.077863:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00000040:1.0:1784047629.077865:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00000100:00000040:1.0:1784047629.077869:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2c17800 x1870705709435776/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047629.077878:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709435776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784047629.077895:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00010000:00000040:1.0:1784047629.077903:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709435776 00000100:00000040:1.0:1784047629.077908:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047629.077911:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047629.077940:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047629.077961:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047629.077965:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c17800 x1870705709435776/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:5/0 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047629.077973:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709435776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047629.077979:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00000040:1.0:1784047629.077981:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:1.0:1784047629.077987:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 4 00000100:00000040:2.0:1784047629.078101:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1784047629.078108:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1784047629.078119:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352912 avail=317209 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023684 state=0: rc = 0 00000100:00000040:2.0:1784047629.078127:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047629.078134:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709435776:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1784047629.078146:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00000040:2.0:1784047629.078150:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1784047629.078157:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352773 avail=317070 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023573 state=0: rc = 0 00000100:00000040:2.0:1784047629.078171:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047629.078177:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709435648:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1784047629.078184:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc9c3f480 x1870705709435776/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047629.078194:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1784047629.078224:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc9c3fb80 x1870705709435648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047629.078232:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00010000:00010000:0.0:1784047629.591424:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1784047629.597469:0:94388:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784047629.597525:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004b3f55ef] to pc [ptlrpcd_00_02+2] req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.597572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1784047629.597823:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.597842:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709435904:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784047629.597884:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047645 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047629.597893:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047629.597969:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9b94e00 x1870705709435904 msgsize 224 00000100:00100000:0.0:1784047629.597974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047629.597998:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047645 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047629.598013:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8791 usecs (9 jiffies) 00000100:00100000:0.0:1784047629.598047:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709435904 00000100:00100000:0.0:1784047629.598056:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709435904 00000020:00000040:0.0:1784047629.598060:0:39444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:0.0:1784047629.598066:0:39444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000020:00000040:0.0:1784047629.598088:0:39444:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:0.0:1784047629.598120:0:39444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1784047629.598254:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00000040:0.0:1784047629.598261:0:39444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:0.0:1784047629.598268:0:39444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9b94e00 x1870705709435904/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.598282:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709435904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047629.598327:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1784047629.598341:0:39444:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709435904 00000100:00000040:0.0:1784047629.598355:0:39444:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:0.0:1784047629.598361:0:39444:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047629.598383:0:39444:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047629.598421:0:39444:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:0.0:1784047629.598426:0:39444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9b94e00 x1870705709435904/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:5/0 lens 224/368 e 0 to 0 dl 1784047640 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.598434:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709435904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047629.598441:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00000040:0.0:1784047629.598445:0:39444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:0.0:1784047629.598456:0:39444:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00000100:00080000:0.0:1784047629.598470:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784047629.598475:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:0.0:1784047629.598510:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:0.0:1784047629.598517:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784047629.598527:0:3648:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1784047629.598531:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1784047629.598539:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.598546:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd00fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709435904:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784047629.598552:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cd00fc2300 x1870705709435904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047645 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784047629.598565:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1784047629.972236:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9c3ce00 x1870705689559552 msgsize 224 00000100:00100000:1.0:1784047629.972254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047629.972385:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559552 00000100:00100000:0.0:1784047629.972404:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559552 00000020:00000040:0.0:1784047629.972408:0:66219:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775ad1 00000020:00000040:0.0:1784047629.972415:0:66219:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001c000 refcount=51 00000020:00000040:0.0:1784047629.972459:0:66219:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 16 - evictor 00000100:00000040:1.0:1784047629.972483:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9c3fb80 x1870705689559808 msgsize 224 00000100:00100000:1.0:1784047629.972492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:0.0:1784047629.972510:0:66219:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1784047629.972543:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc7543850 x1870705689559424 msgsize 224 00000100:00100000:1.0:1784047629.972554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00000040:1.0:1784047629.972558:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1784047629.972569:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1486 00000100:00000040:0.0:1784047629.972578:0:66219:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001c000 : new rpc_count 1 00000100:00000040:0.0:1784047629.972590:0:66219:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9c3ce00 x1870705689559552/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047629.972598:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc9c3f480 x1870705689559680 msgsize 224 00000100:00100000:1.0:1784047629.972650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047629.972651:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+51:2400:x1870705689559552:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:0.0:1784047629.972695:0:66219:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051732, transno 0, xid 1870705689559552 00000100:00000040:0.0:1784047629.972711:0:66219:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047629.972720:0:66219:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00100000:1.0:1784047629.972761:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559808 00000100:00100000:1.0:1784047629.972774:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559808 00000020:00000040:1.0:1784047629.972779:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775e66 00000020:00000040:1.0:1784047629.972784:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd8435000 refcount=7 00000100:00000040:0.0:1784047629.972794:0:66219:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047629.972802:0:66219:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9c3ce00 x1870705689559552/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:5/0 lens 224/224 e 0 to 0 dl 1784047640 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.972812:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+51:2400:x1870705689559552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 209us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047629.972820:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1486 00000100:00000040:0.0:1784047629.972825:0:66219:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001c000 : new rpc_count 0 00000020:00000040:0.0:1784047629.972838:0:66219:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001c000 : new refcount 50 00000100:00100000:0.0:1784047629.972848:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559680 00000100:00100000:0.0:1784047629.972852:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559680 00000020:00000040:0.0:1784047629.972854:0:66219:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c7750c1 00000020:00000040:0.0:1784047629.972857:0:66219:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff387000 refcount=11 00000020:00000040:0.0:1784047629.972866:0:66219:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 12 - evictor 00000100:00000040:0.0:1784047629.972873:0:66219:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784047629.972890:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1487 00000100:00000040:0.0:1784047629.972893:0:66219:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff387000 : new rpc_count 1 00000100:00000040:0.0:1784047629.972897:0:66219:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9c3f480 x1870705689559680/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.972936:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689559680:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:0.0:1784047629.972950:0:66219:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411472, transno 0, xid 1870705689559680 00000100:00000040:0.0:1784047629.972956:0:66219:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047629.972960:0:66219:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:0.0:1784047629.972981:0:66219:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:0.0:1784047629.972987:0:66219:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9c3f480 x1870705689559680/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:5/0 lens 224/224 e 0 to 0 dl 1784047640 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047629.972996:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c846d7a-6357-4e9c-a620-e35737ede709+11:2400:x1870705689559680:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 63us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047629.973002:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1487 00000100:00000040:0.0:1784047629.973005:0:66219:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff387000 : new rpc_count 0 00000020:00000040:0.0:1784047629.973010:0:66219:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff387000 : new refcount 10 00000100:00080000:0.0:1784047629.973029:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1784047629.973034:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 12 - evictor 00000100:00080000:0.0:1784047629.973038:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784047629.973039:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 16 - evictor 00000100:00100000:3.0:1784047629.974249:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559424 00000020:00000040:1.0:1784047629.974714:0:8431:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00100000:1.0:1784047629.975483:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2709 00000100:00000040:1.0:1784047629.975492:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd8435000 : new rpc_count 1 00000100:00000040:1.0:1784047629.975502:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc9c3fb80 x1870705689559808/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047629.975523:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689559808:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:1.0:1784047629.975564:0:8431:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689559808 00000100:00000040:1.0:1784047629.975581:0:8431:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047629.975588:0:8431:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:1.0:1784047629.975667:0:8431:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:1.0:1784047629.975729:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc9c3fb80 x1870705689559808/t0(0) o400->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:5/0 lens 224/224 e 0 to 0 dl 1784047640 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047629.975740:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c846d7a-6357-4e9c-a620-e35737ede709+7:2400:x1870705689559808:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 226us (3255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047629.975748:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2709 00000100:00000040:1.0:1784047629.975751:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd8435000 : new rpc_count 0 00000020:00000040:1.0:1784047629.975764:0:8431:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd8435000 : new refcount 6 00000100:00080000:1.0:1784047629.975801:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784047629.975809:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00100000:3.0:1784047629.975815:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559424 00000020:00000040:3.0:1784047629.975822:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a45 00000020:00000040:3.0:1784047629.975828:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd001a800 refcount=10 00000100:00000040:3.0:1784047629.975862:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784047629.975918:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00000040:3.0:1784047629.975923:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd001a800 : new rpc_count 1 00000100:00000040:3.0:1784047629.975931:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc7543850 x1870705689559424/t0(0) o400->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:5/0 lens 224/0 e 0 to 0 dl 1784047640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047629.983466:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689559424:12345-192.168.204.40@tcp:400:kworker.0 00010000:00000040:3.0:1784047629.983508:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705689559424 00000100:00000040:3.0:1784047629.983525:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc7f9ee80 refcount 11 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047629.983533:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.40@tcp 00000100:00000040:3.0:1784047629.983633:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc7f9ee80 refcount 10 to 192.168.204.40@tcp 00000100:00000040:3.0:1784047629.983644:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc7543850 x1870705689559424/t0(0) o400->4f88e784-1ed8-4645-9d2f-1081095d1f30@192.168.204.40@tcp:5/0 lens 224/224 e 0 to 0 dl 1784047640 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047629.983657:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc7543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2400:x1870705689559424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 7714us (11113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047629.983670:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00000040:3.0:1784047629.983676:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd001a800 : new rpc_count 0 00000020:00000040:3.0:1784047629.983695:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd001a800 : new refcount 9 00010000:00010000:3.0:1784047630.613599:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1784047630.618124:0:75673:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1784047630.618252:0:75673:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000df750629] to pc [ptlrpcd_00_03+3] req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047630.618654:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047630.618673:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709436032:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1784047630.618719:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047646 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047630.618729:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047630.618786:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99ccf2c16d80 x1870705709436032 msgsize 224 00000100:00100000:2.0:1784047630.618792:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047630.618831:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047646 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047630.618849:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5660 usecs (6 jiffies) 00000100:00100000:1.0:1784047630.619470:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436032 00000100:00100000:1.0:1784047630.619483:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436032 00000020:00000040:1.0:1784047630.619487:0:12054:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:1.0:1784047630.619493:0:12054:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000020:00000040:1.0:1784047630.619518:0:12054:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:1.0:1784047630.619557:0:12054:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1784047630.619628:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00000040:1.0:1784047630.619634:0:12054:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:1.0:1784047630.619642:0:12054:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99ccf2c16d80 x1870705709436032/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:6/0 lens 224/0 e 0 to 0 dl 1784047641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047630.619659:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709436032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784047630.619721:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1784047630.619735:0:12054:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709436032 00000100:00000040:1.0:1784047630.619749:0:12054:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047630.619756:0:12054:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047630.619793:0:12054:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047646 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047630.619817:0:12054:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047630.619822:0:12054:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c16d80 x1870705709436032/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:6/0 lens 224/368 e 0 to 0 dl 1784047641 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047630.619832:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf2c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870705709436032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047630.619839:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00000040:1.0:1784047630.619843:0:12054:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000020:00000040:1.0:1784047630.619856:0:12054:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00000040:1.0:1784047630.619926:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:1.0:1784047630.619933:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1784047630.619944:0:3648:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1784047630.619948:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:1.0:1784047630.619958:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047646 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047630.619966:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709436032:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1784047630.619973:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cd0030dc00 x1870705709436032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784047646 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047630.619983:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:0.0:1784047630.620300:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784047630.620308:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:2.0:1784047631.637591:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6e36843b-2016-43fe-8842-da5818d68597->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.637632:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cce74a5800 refcount=4 obd=MGC192.168.204.140@tcp 00000100:00000040:2.0:1784047631.637684:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 6e36843b-2016-43fe-8842-da5818d68597->MGS req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.637705:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b865b37c] to pc [ptlrpcd_00_00+0] req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784047631.637708:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1784047631.637751:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.637762:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc753d000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1784047631.637774:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784047631.637780:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.637791:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009cc3bae9] to pc [ptlrpcd_00_01+1] req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.637805:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784047631.637806:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709436160:0@lo:400:kworker.0 00000020:00000040:2.0:1784047631.637817:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc753a800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1784047631.637828:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.637838:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009f1d5397] to pc [ptlrpcd_00_02+2] req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047631.637853:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.637860:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.637894:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc6531800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1784047631.637905:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.637914:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000035ab37c6] to pc [ptlrpcd_00_03+3] req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047631.637923:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1784047631.637928:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:2.0:1784047631.637929:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1784047631.637933:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.637939:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbcad8b000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784047631.637956:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.637965:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000376cf81f] to pc [ptlrpcd_00_00+0] req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.637974:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.637981:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbcaee6800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1784047631.637988:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.637997:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000adab64f8] to pc [ptlrpcd_00_01+1] req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638004:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.638026:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc1d86000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1784047631.638036:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.638046:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c608637f] to pc [ptlrpcd_00_02+2] req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784047631.638055:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784047631.638058:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1784047631.638062:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.638067:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbc912c800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1784047631.638074:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.638086:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003bd5af62] to pc [ptlrpcd_00_03+3] req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638106:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.638111:0:52247:0:(genops.c:1231:class_import_get()) import ffff99ccc5e52000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1784047631.638120:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.638133:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a95a272e] to pc [ptlrpcd_00_00+0] req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638142:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.638148:0:52247:0:(genops.c:1231:class_import_get()) import ffff99ccd897f800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1784047631.638156:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.638174:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b9e9adf0] to pc [ptlrpcd_00_01+1] req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638185:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1784047631.638191:0:52247:0:(genops.c:1231:class_import_get()) import ffff99cbcaee1800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1784047631.638199:0:52247:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784047631.638208:0:52247:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000092e6cf9c] to pc [ptlrpcd_00_02+2] req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638220:0:52247:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 2 (3734) 00000100:00000040:2.0:1784047631.638497:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.638507:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709436288:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.638528:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638541:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047631.638579:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99cd00ba1c50 x1870705709436288 msgsize 224 00000100:00100000:2.0:1784047631.638583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047631.638585:0:3646:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784047631.638779:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638797:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8156 usecs (9 jiffies) 00000100:00000040:2.0:1784047631.638809:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.638817:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709436800:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.638832:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638839:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047631.638855:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aeed80 x1870705709436800 msgsize 224 00000100:00100000:2.0:1784047631.638859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047631.638899:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.638910:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436288 00000100:00000040:2.0:1784047631.638912:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 123250 usecs (124 jiffies) 00000100:00000040:2.0:1784047631.638921:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.638923:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436288 00000020:00000040:1.0:1784047631.638929:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c52 00000100:00100000:2.0:1784047631.638935:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709437312:0@lo:400:kworker.0 00000020:00000040:1.0:1784047631.638936:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897d800 refcount=5 00000100:00000040:2.0:1784047631.638953:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.638960:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1784047631.638969:0:67153:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff99cd00100000) now 16 - evictor 00000100:00000040:2.0:1784047631.638975:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aef100 x1870705709437312 msgsize 224 00000100:00100000:2.0:1784047631.638980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047631.638995:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.639002:0:67153:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:2.0:1784047631.639016:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 6012 usecs (7 jiffies) 00000100:00100000:2.0:1784047631.639033:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784047631.639038:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436800 00000100:00000040:2.0:1784047631.639041:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.639042:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436800 00000020:00000040:1.0:1784047631.639046:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c59 00000020:00000040:1.0:1784047631.639050:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd897e000 refcount=5 00000100:00100000:2.0:1784047631.639058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbd060dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709436672:0@lo:400:kworker.0 00000100:00100000:1.0:1784047631.639072:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437312 00000100:00100000:1.0:1784047631.639076:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437312 00000100:00000040:2.0:1784047631.639079:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047631.639079:0:67153:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a7c 00000020:00000040:1.0:1784047631.639083:0:67153:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfdd89800 refcount=5 00000100:00000040:2.0:1784047631.639093:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1784047631.639111:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00000040:2.0:1784047631.639116:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aee300 x1870705709436672 msgsize 224 00000100:00000040:1.0:1784047631.639117:0:67153:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897d800 : new rpc_count 1 00000100:00100000:2.0:1784047631.639123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047631.639127:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd00ba1c50 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.639142:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.639146:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709436288:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.639161:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5650 usecs (6 jiffies) 00000100:00000040:2.0:1784047631.639168:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1784047631.639180:0:67153:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709436288 00000100:00000040:1.0:1784047631.639192:0:67153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047631.639198:0:67153:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047631.639219:0:67153:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.639235:0:67153:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00100000:2.0:1784047631.639243:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709437184:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.639244:0:67153:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd00ba1c50 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.639259:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709436288:12345-0@lo:400:kworker.0 Request processed in 118us (677us total) trans 0 rc 0/0 00000100:00000040:2.0:1784047631.639267:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.639268:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00000040:2.0:1784047631.639278:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047631.639281:0:67153:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897d800 : new rpc_count 0 00000020:00000040:1.0:1784047631.639296:0:67153:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897d800 : new refcount 4 00000100:00000040:2.0:1784047631.639304:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aec380 x1870705709437184 msgsize 224 00000100:00100000:2.0:1784047631.639310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047631.640111:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc814a050 x1870705709436160 msgsize 224 00000100:00100000:0.0:1784047631.640121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784047631.640124:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784047631.640152:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784047631.640298:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784047631.640458:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff99cd00100000) now 16 - evictor 00000100:00100000:0.0:1784047631.640482:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00000040:0.0:1784047631.640487:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd897e000 : new rpc_count 1 00000100:00000040:0.0:1784047631.640494:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aeed80 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.640771:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709436800:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047631.640796:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709436800 00000100:00000040:0.0:1784047631.640808:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:0.0:1784047631.640814:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047631.640848:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047631.640865:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:0.0:1784047631.640880:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aeed80 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.640890:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709436800:12345-0@lo:400:kworker.0 Request processed in 129us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047631.640897:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00000040:0.0:1784047631.640900:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd897e000 : new rpc_count 0 00000020:00000040:0.0:1784047631.640913:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd897e000 : new refcount 4 00000100:00100000:0.0:1784047631.642303:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437184 00000100:00000040:2.0:1784047631.642311:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.642318:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437184 00000020:00000040:0.0:1784047631.642325:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775c60 00000100:00000040:2.0:1784047631.642341:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7490 usecs (8 jiffies) 00000020:00000040:0.0:1784047631.642344:0:68026:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc5e57800 refcount=5 00000100:00100000:0.0:1784047631.642414:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00000040:2.0:1784047631.642417:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784047631.642421:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfdd89800 : new rpc_count 1 00000100:00000040:2.0:1784047631.642428:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047631.642433:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aef100 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.642461:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709437312:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.642476:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.642488:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccfdd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709436288:0@lo:400:kworker.0 00010000:00000040:0.0:1784047631.642491:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709437312 00000100:00000040:0.0:1784047631.642505:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:0.0:1784047631.642515:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047631.642529:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1784047631.642537:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.642547:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.642555:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709436800:0@lo:400:kworker.0 00000100:00000040:0.0:1784047631.642558:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047631.642589:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:2.0:1784047631.642592:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784047631.642596:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aef100 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.642601:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.642632:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.642638:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709437312:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.642647:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccfdd30700 x1870705709436288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.642698:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709437312:12345-0@lo:400:kworker.0 Request processed in 241us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047631.642706:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00000040:0.0:1784047631.642709:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfdd89800 : new rpc_count 0 00000020:00000040:0.0:1784047631.642720:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfdd89800 : new refcount 4 00000100:00100000:0.0:1784047631.642729:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00000040:0.0:1784047631.642732:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc5e57800 : new rpc_count 1 00000100:00000040:0.0:1784047631.642737:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aec380 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.642748:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709437184:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784047631.642759:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709437184 00000100:00000040:0.0:1784047631.642764:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:0.0:1784047631.642776:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784047631.642794:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784047631.642807:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:0.0:1784047631.642811:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aec380 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047631.642819:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709437184:12345-0@lo:400:kworker.0 Request processed in 73us (3514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047631.642825:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00000040:0.0:1784047631.642827:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc5e57800 : new rpc_count 0 00000020:00000040:0.0:1784047631.642835:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc5e57800 : new refcount 4 00000020:00000040:2.0:1784047631.644787:0:3646:0:(genops.c:1244:class_import_put()) import ffff99cbc753d000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1784047631.644831:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce7ed7800 x1870705709436800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047631.644847:0:3646:0:(genops.c:1244:class_import_put()) import ffff99cbcaee6800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1784047631.644862:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5aec700 x1870705709437312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047631.644900:0:3646:0:(genops.c:1244:class_import_put()) import ffff99ccd897f800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1784047631.644976:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1784047631.644985:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.644998:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.645006:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709437184:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.645018:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5aed180 x1870705709437184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047631.645029:0:3646:0:(genops.c:1244:class_import_put()) import ffff99ccc5e52000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1784047631.645077:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.645096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709436416:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.645137:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.645150:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000001:00080000:3.0:1784047631.645218:0:96945:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968818 is committed 00000100:00000040:2.0:1784047631.645238:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aed180 x1870705709436416 msgsize 224 00000001:00000040:3.0:1784047631.645249:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 39 00000100:00100000:2.0:1784047631.645264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047631.645265:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436672 00000100:00100000:1.0:1784047631.645279:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436672 00000020:00000040:1.0:1784047631.645283:0:26184:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76f98e 00000020:00000040:1.0:1784047631.645289:0:26184:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccfe789800 refcount=5 00000100:00000040:2.0:1784047631.645314:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.645330:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7753 usecs (8 jiffies) 00000100:00000040:2.0:1784047631.645344:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.645358:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:2.0:1784047631.645364:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709436928:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.645366:0:26184:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccfe789800 : new rpc_count 1 00000100:00000040:1.0:1784047631.645383:0:26184:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aee300 x1870705709436672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.645402:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709436672:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.645405:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.645419:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:1.0:1784047631.645433:0:26184:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968742, transno 0, xid 1870705709436672 00000100:00000040:2.0:1784047631.645445:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aec700 x1870705709436928 msgsize 224 00000100:00000040:1.0:1784047631.645452:0:26184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047631.645464:0:26184:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1784047631.645471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784047631.645500:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047631.645518:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 43 00000001:00000040:3.0:1784047631.645527:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 38 00000020:00000040:3.0:1784047631.645529:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 42 00000001:00000040:3.0:1784047631.645537:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 37 00000020:00000040:3.0:1784047631.645539:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 41 00000001:00000040:3.0:1784047631.645545:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 36 00000020:00000040:3.0:1784047631.645546:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 40 00000001:00000040:3.0:1784047631.645840:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 35 00000020:00000040:3.0:1784047631.645843:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 39 00000001:00000040:3.0:1784047631.645849:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 34 00000020:00000040:3.0:1784047631.645850:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 38 00000001:00000040:3.0:1784047631.645855:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 33 00000020:00000040:3.0:1784047631.645857:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 37 00000001:00000040:3.0:1784047631.645862:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 32 00000020:00000040:3.0:1784047631.645864:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 36 00000001:00000040:3.0:1784047631.645879:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 31 00000020:00000040:3.0:1784047631.645881:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 35 00000001:00000040:3.0:1784047631.645885:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 30 00000020:00000040:3.0:1784047631.645887:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 34 00000001:00000040:3.0:1784047631.645891:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 29 00000020:00000040:3.0:1784047631.645894:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 33 00000001:00000040:3.0:1784047631.645899:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 28 00000020:00000040:3.0:1784047631.645901:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 32 00000001:00000040:3.0:1784047631.645905:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 27 00000020:00000040:3.0:1784047631.645907:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 31 00000001:00000040:3.0:1784047631.645911:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 26 00000020:00000040:3.0:1784047631.645913:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 30 00000001:00000040:3.0:1784047631.645917:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 25 00000020:00000040:3.0:1784047631.645919:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 29 00000001:00000040:3.0:1784047631.645931:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 24 00000020:00000040:3.0:1784047631.645933:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 28 00000001:00000040:3.0:1784047631.645937:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 23 00000020:00000040:3.0:1784047631.645939:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 27 00000001:00000040:3.0:1784047631.645943:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 22 00000020:00000040:3.0:1784047631.645945:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 26 00000001:00000040:3.0:1784047631.645949:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 21 00000020:00000040:3.0:1784047631.645950:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 25 00000001:00000040:3.0:1784047631.645954:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 20 00000020:00000040:3.0:1784047631.645956:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 24 00000001:00000040:3.0:1784047631.645960:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 19 00000020:00000040:3.0:1784047631.645962:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 23 00000001:00000040:3.0:1784047631.645965:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 18 00000020:00000040:3.0:1784047631.645967:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 22 00000001:00000040:3.0:1784047631.645972:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 17 00000020:00000040:3.0:1784047631.645974:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 21 00000001:00000040:3.0:1784047631.646336:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 16 00000020:00000040:3.0:1784047631.646340:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 20 00000001:00000040:3.0:1784047631.646344:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 15 00000020:00000040:3.0:1784047631.646346:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 19 00000001:00000040:3.0:1784047631.646351:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 14 00000020:00000040:3.0:1784047631.646354:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 18 00000001:00000040:3.0:1784047631.646357:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 13 00000020:00000040:3.0:1784047631.646359:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 17 00000001:00000040:3.0:1784047631.646362:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 12 00000020:00000040:3.0:1784047631.646364:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 16 00000001:00000040:3.0:1784047631.646366:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 11 00000020:00000040:3.0:1784047631.646368:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 15 00000001:00000040:3.0:1784047631.646372:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 10 00000020:00000040:3.0:1784047631.646373:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 14 00000001:00000040:3.0:1784047631.646386:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 9 00000020:00000040:3.0:1784047631.646387:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 13 00000001:00000040:3.0:1784047631.646391:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 8 00000020:00000040:3.0:1784047631.646393:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 12 00000001:00000040:3.0:1784047631.646397:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 7 00000020:00000040:3.0:1784047631.646399:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 11 00000001:00000040:3.0:1784047631.646402:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 6 00000020:00000040:3.0:1784047631.646404:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 10 00000001:00000040:3.0:1784047631.646407:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 5 00000020:00000040:3.0:1784047631.646409:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 9 00000001:00000040:3.0:1784047631.646412:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 4 00000020:00000040:3.0:1784047631.646414:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 8 00000001:00000040:3.0:1784047631.646420:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 3 00000020:00000040:3.0:1784047631.646422:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 7 00000001:00000040:3.0:1784047631.646424:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 2 00000020:00000040:3.0:1784047631.646426:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 6 00000001:00000040:3.0:1784047631.646429:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 1 00000020:00000040:3.0:1784047631.646431:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 5 00000001:00000040:3.0:1784047631.646434:0:96945:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff99ccfe6bc800 : new cb_count 0 00000020:00000040:3.0:1784047631.646436:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe6bc800 : new refcount 4 00000100:00000040:1.0:1784047631.648206:0:26184:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.648259:0:26184:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047631.648268:0:26184:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aee300 x1870705709436672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.648291:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709436672:12345-0@lo:400:kworker.0 Request processed in 2881us (9161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047631.648304:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00000040:1.0:1784047631.648308:0:26184:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccfe789800 : new rpc_count 0 00000100:00000040:2.0:1784047631.648324:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5682 usecs (6 jiffies) 00000020:00000040:1.0:1784047631.648329:0:26184:0:(genops.c:900:class_export_put()) PUTting export ffff99ccfe789800 : new refcount 4 00000100:00000040:2.0:1784047631.648354:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.648375:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709437440:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.648419:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.648429:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1784047631.648435:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436416 00000100:00100000:1.0:1784047631.648446:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436416 00000020:00000040:1.0:1784047631.648450:0:68026:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c76fa05 00000020:00000040:1.0:1784047631.648454:0:68026:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc6ea1800 refcount=5 00000020:00000040:1.0:1784047631.648483:0:68026:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff99cd00c88000) now 12 - evictor 00000100:00000040:1.0:1784047631.648523:0:68026:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784047631.648545:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00000040:1.0:1784047631.648549:0:68026:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbc6ea1800 : new rpc_count 1 00000100:00000040:1.0:1784047631.648555:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aed180 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.648569:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709436416:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047631.648595:0:68026:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709436416 00000100:00000040:1.0:1784047631.648631:0:68026:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047631.648637:0:68026:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047631.654727:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968742 00000100:00000040:3.0:1784047631.654749:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047631.654763:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047631.654772:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbd060dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709436672:0@lo:400:kworker.0 00000100:00000040:3.0:1784047631.654787:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbd060dc00 x1870705709436672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047631.654827:0:3646:0:(genops.c:1244:class_import_put()) import ffff99cbcad8b000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784047631.657959:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff99cbc5aef800 x1870705709437440 msgsize 224 00000100:00100000:2.0:1784047631.657981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047631.658021:0:68026:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.658041:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.658065:0:68026:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:2.0:1784047631.658075:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 6581 usecs (7 jiffies) 00000100:00000040:1.0:1784047631.658077:0:68026:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aed180 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047631.658089:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437440 00000100:00100000:1.0:1784047631.658096:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870705709436416:12345-0@lo:400:kworker.0 Request processed in 9526us (12854us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047631.658102:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437440 00000020:00000040:3.0:1784047631.658108:0:66221:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c776a91 00000100:00100000:1.0:1784047631.658110:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000020:00000040:3.0:1784047631.658116:0:66221:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbc753c800 refcount=5 00000100:00000040:1.0:1784047631.658117:0:68026:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbc6ea1800 : new rpc_count 0 00000020:00000040:1.0:1784047631.658143:0:68026:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc6ea1800 : new refcount 4 00000100:00000040:3.0:1784047631.658160:0:66221:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00080000:1.0:1784047631.658173:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784047631.658180:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff99cd00c88000) now 12 - evictor 00000100:00100000:1.0:1784047631.658200:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00000040:1.0:1784047631.658205:0:66220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbc753c800 : new rpc_count 1 00000100:00000040:1.0:1784047631.658211:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aef800 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.658226:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709437440:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047631.658253:0:66220:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709437440 00000100:00000040:1.0:1784047631.658279:0:66220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047631.658285:0:66220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047631.658310:0:66220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.658327:0:66220:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047631.658333:0:66220:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aef800 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.658342:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870705709437440:12345-0@lo:400:kworker.0 Request processed in 120us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047631.658349:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00000040:1.0:1784047631.658352:0:66220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbc753c800 : new rpc_count 0 00000020:00000040:1.0:1784047631.658361:0:66220:0:(genops.c:900:class_export_put()) PUTting export ffff99cbc753c800 : new refcount 4 00000100:00000040:1.0:1784047631.658417:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.658432:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709436544:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.658459:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.658468:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047631.658484:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0030ed80 x1870705709436544 msgsize 224 00000100:00100000:1.0:1784047631.658488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047631.659352:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.659367:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1594796 usecs (1595 jiffies) 00000100:00000040:1.0:1784047631.659378:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.659389:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709437056:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.659410:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.659428:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047631.659450:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff99cd0030c000 x1870705709437056 msgsize 224 00000100:00100000:1.0:1784047631.659454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784047631.659470:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.659481:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8538 usecs (9 jiffies) 00000100:00100000:1.0:1784047631.659510:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437056 00000100:00100000:1.0:1784047631.659516:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437056 00000020:00000040:1.0:1784047631.659519:0:26187:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b3a 00000020:00000040:1.0:1784047631.659523:0:26187:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99cbcaee1000 refcount=5 00000020:00000040:1.0:1784047631.659533:0:26187:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00100000:1.0:1784047631.659567:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00000040:1.0:1784047631.659570:0:26187:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99cbcaee1000 : new rpc_count 1 00000100:00000040:1.0:1784047631.659576:0:26187:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0030c000 x1870705709437056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.659589:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709437056:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047631.659624:0:26187:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968757, transno 0, xid 1870705709437056 00000100:00000040:1.0:1784047631.659635:0:26187:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:1.0:1784047631.660417:0:26187:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784047631.660445:0:26187:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.660469:0:26187:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047631.660474:0:26187:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0030c000 x1870705709437056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.660483:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709437056:12345-0@lo:400:kworker.0 Request processed in 897us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047631.660490:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00000040:1.0:1784047631.660502:0:26187:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99cbcaee1000 : new rpc_count 0 00000020:00000040:1.0:1784047631.660512:0:26187:0:(genops.c:900:class_export_put()) PUTting export ffff99cbcaee1000 : new refcount 4 00000100:00080000:1.0:1784047631.660537:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1784047631.660542:0:6514:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff99cbc6e90000) now 10 - evictor 00000100:00000040:1.0:1784047631.660582:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968757 00000100:00000040:1.0:1784047631.660588:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.660597:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.660625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709437056:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.660633:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5aece00 x1870705709437056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.661653:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1784047631.661690:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.661705:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.661713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870705709436416:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.661769:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000020:00000040:1.0:1784047631.661771:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc912c800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1784047631.661797:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.661808:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.661817:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870705709437440:0@lo:400:kworker.0 00000100:00000040:2.0:1784047631.661825:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce3d22300 x1870705709436416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047631.661840:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc753a800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1784047631.661851:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5aee680 x1870705709437440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784047631.661858:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbcaee1800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1784047631.661916:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436160 00000100:00100000:2.0:1784047631.661926:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436160 00000100:00100000:3.0:1784047631.661930:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436928 00000020:00000040:2.0:1784047631.661930:0:94372:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775a68 00000020:00000040:2.0:1784047631.661938:0:94372:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccc832d800 refcount=24 00000100:00100000:3.0:1784047631.661942:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436928 00000020:00000040:3.0:1784047631.661947:0:23872:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775b02 00000020:00000040:3.0:1784047631.661952:0:23872:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccff383000 refcount=5 00000100:00000040:2.0:1784047631.661974:0:94372:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:3.0:1784047631.661987:0:23872:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1784047631.662015:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1784047631.662022:0:94372:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccc832d800 : new rpc_count 1 00000100:00100000:3.0:1784047631.662023:0:23872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709436544 00000100:00100000:3.0:1784047631.662029:0:23872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709436544 00000100:00000040:2.0:1784047631.662031:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc814a050 x1870705709436160/t0(0) o400->6e36843b-2016-43fe-8842-da5818d68597@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047631.662035:0:23872:0:(genops.c:825:class_conn2export()) looking for export cookie 0x4426598c0c775aca 00000020:00000040:3.0:1784047631.662042:0:23872:0:(lustre_handles.c:147:class_handle2object()) GET export ffff99ccd0019800 refcount=7 00000100:00100000:2.0:1784047631.662064:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709436160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047631.662083:0:23872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00000040:3.0:1784047631.662089:0:23872:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccff383000 : new rpc_count 1 00010000:00000040:2.0:1784047631.662093:0:94372:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709436160 00000100:00000040:3.0:1784047631.662100:0:23872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cbc5aec700 x1870705709436928/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784047631.662109:0:94372:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:2.0:1784047631.662124:0:94372:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1784047631.662131:0:23872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709436928:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1784047631.662161:0:23872:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870705709436928 00000100:00000040:3.0:1784047631.662172:0:23872:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 67 to 0@lo 00000100:00000040:3.0:1784047631.662181:0:23872:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784047631.662192:0:94372:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.662333:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.662345:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.662353:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccf2c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e36843b-2016-43fe-8842-da5818d68597:3645:1870705709436160:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.662360:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99ccf2c17480 x1870705709436160/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047631.662369:0:3645:0:(genops.c:1244:class_import_put()) import ffff99cce74a5800 refcount=3 obd=MGC192.168.204.140@tcp 00000100:00100000:1.0:1784047631.662391:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00000040:1.0:1784047631.662395:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff99ccd0019800 : new rpc_count 1 00000100:00000040:1.0:1784047631.662399:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff99cd0030ed80 x1870705709436544/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:7/0 lens 224/0 e 0 to 0 dl 1784047642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.662411:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709436544:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1784047631.662436:0:8441:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051586, transno 0, xid 1870705709436544 00000100:00000040:1.0:1784047631.662441:0:8441:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff99ccc8ec6fc0 refcount 68 to 0@lo 00000100:00000040:1.0:1784047631.662444:0:8441:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784047631.663673:0:23872:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047631.663715:0:23872:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 67 to 0@lo 00000100:00000040:3.0:1784047631.663723:0:23872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aec700 x1870705709436928/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047631.663734:0:23872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709436928:12345-0@lo:400:kworker.0 Request processed in 1612us (18287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047631.663756:0:23872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00000040:3.0:1784047631.663760:0:23872:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccff383000 : new rpc_count 0 00000020:00000040:3.0:1784047631.663775:0:23872:0:(genops.c:900:class_export_put()) PUTting export ffff99ccff383000 : new refcount 4 00000100:00000040:3.0:1784047631.665377:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1784047631.665391:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784047631.665403:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047631.665412:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709436928:0@lo:400:kworker.0 00000100:00000040:3.0:1784047631.665419:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cbc5aedf80 x1870705709436928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784047631.665431:0:3647:0:(genops.c:1244:class_import_put()) import ffff99cbc1d86000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1784047631.674210:0:94372:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 66 to 0@lo 00000100:00000040:2.0:1784047631.674252:0:94372:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cbc814a050 x1870705709436160/t0(0) o400->6e36843b-2016-43fe-8842-da5818d68597@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784047631.674265:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc814a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3645:x1870705709436160:12345-0@lo:400:kworker.0 Request processed in 12207us (34154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047631.674278:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1784047631.674283:0:94372:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccc832d800 : new rpc_count 0 00000020:00000040:2.0:1784047631.674831:0:94372:0:(genops.c:900:class_export_put()) PUTting export ffff99ccc832d800 : new refcount 23 00000100:00000040:1.0:1784047631.677197:0:8441:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.677242:0:8441:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff99ccc8ec6fc0 refcount 65 to 0@lo 00000100:00000040:1.0:1784047631.677251:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cd0030ed80 x1870705709436544/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:7/0 lens 224/224 e 0 to 0 dl 1784047642 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.677260:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870705709436544:12345-0@lo:400:kworker.0 Request processed in 14852us (18775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047631.677272:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00000040:1.0:1784047631.677276:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff99ccd0019800 : new rpc_count 0 00000020:00000040:1.0:1784047631.677293:0:8441:0:(genops.c:900:class_export_put()) PUTting export ffff99ccd0019800 : new refcount 6 00000100:00000040:1.0:1784047631.677349:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 124554051586 00000100:00000040:1.0:1784047631.677355:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784047631.677371:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784047631.677379:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cce3d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870705709436544:0@lo:400:kworker.0 00000100:00000040:1.0:1784047631.677396:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff99cce3d20380 x1870705709436544/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784047647 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784047631.677408:0:3648:0:(genops.c:1244:class_import_put()) import ffff99cbc6531800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00010000:00010000:0.0:1784047632.660893:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784047632.917005:0:97301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1784047633.683126:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047633.683133:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1784047633.683150:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784047633.683153:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1784047633.683304:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709437952:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683412:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709438464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683469:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784047633.683475:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709437568:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683540:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709438080:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683578:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709438592:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683660:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709437824:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683698:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709438336:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683729:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709438848:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683766:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784047633.683771:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709437696:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.683792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.683806:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709438208:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.683825:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438464 00000100:00100000:3.0:1784047633.683840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047633.683845:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438464 00000100:00100000:3.0:1784047633.683858:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709438720:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.683912:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438080 00000100:00100000:0.0:1784047633.683916:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438080 00000100:00100000:0.0:1784047633.683941:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1784047633.683951:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709438464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047633.684073:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438592 00000100:00100000:1.0:1784047633.684078:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438592 00000100:00100000:1.0:1784047633.684112:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437824 00000100:00100000:1.0:1784047633.684115:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437824 00000100:00100000:1.0:1784047633.684128:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438848 00000100:00100000:1.0:1784047633.684131:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438848 00000100:00100000:1.0:1784047633.684143:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437696 00000100:00100000:1.0:1784047633.684145:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437696 00000100:00100000:1.0:1784047633.684186:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438208 00000100:00100000:1.0:1784047633.684190:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438208 00000100:00100000:2.0:1784047633.684236:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437568 00000100:00100000:2.0:1784047633.684240:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437568 00000100:00100000:2.0:1784047633.684270:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784047633.684278:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709437568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784047633.684330:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1784047633.684336:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709438592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.684409:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709438464:12345-0@lo:400:kworker.0 Request processed in 458us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047633.684417:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1784047633.684438:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:0.0:1784047633.684445:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709438080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.684476:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709438080:12345-0@lo:400:kworker.0 Request processed in 32us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047633.684482:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00010000:00010000:0.0:1784047633.684951:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047633.685134:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709438080:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.685164:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709438464:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.688683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047633.688763:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438720 00000100:00100000:3.0:1784047633.688774:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438720 00000100:00100000:3.0:1784047633.688827:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1784047633.688847:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709437824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689004:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870705709437824:12345-0@lo:400:kworker.0 Request processed in 159us (5319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689012:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1784047633.689032:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:3.0:1784047633.689053:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709438848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689091:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870705709438848:12345-0@lo:400:kworker.0 Request processed in 40us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689098:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:3.0:1784047633.689112:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1784047633.689120:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709437696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689148:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870705709437696:12345-0@lo:400:kworker.0 Request processed in 30us (5355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689154:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1784047633.689168:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1784047633.689175:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709438208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689204:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870705709438208:12345-0@lo:400:kworker.0 Request processed in 30us (5374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689211:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1784047633.689223:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1784047633.689230:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709438720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689260:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870705709438720:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689266:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1784047633.689291:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709437952 00000100:00100000:3.0:1784047633.689295:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709437952 00000100:00100000:3.0:1784047633.689323:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438336 00000100:00100000:3.0:1784047633.689327:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438336 00000100:00100000:3.0:1784047633.689349:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1784047633.689356:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709437952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689396:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709437952:12345-0@lo:400:kworker.0 Request processed in 40us (6019us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689408:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1784047633.689421:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1784047633.689428:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709438336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.689459:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709438336:12345-0@lo:400:kworker.0 Request processed in 32us (5741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047633.689466:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1784047633.689518:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709437952:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.689707:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870705709437696:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.689720:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870705709438208:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.689733:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870705709438720:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.689744:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870705709437824:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.689755:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709438336:0@lo:400:kworker.0 00000100:00100000:0.0:1784047633.689765:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870705709438848:0@lo:400:kworker.0 00000100:00100000:2.0:1784047633.690049:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709437568:12345-0@lo:400:kworker.0 Request processed in 5769us (6544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047633.690058:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784047633.690211:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709437568:0@lo:400:kworker.0 00000100:00080000:1.0:1784047633.696987:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784047633.696998:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784047633.697002:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784047633.697089:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709438592:12345-0@lo:400:kworker.0 Request processed in 12745us (13478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047633.697104:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1784047633.697170:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709438592:0@lo:400:kworker.0 00000100:00100000:3.0:1784047633.991692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047633.992134:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689559936 00000100:00100000:2.0:1784047633.992144:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689559936 00000100:00100000:2.0:1784047633.992205:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:2.0:1784047633.992216:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689559936:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047633.992290:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2399:x1870705689559936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047633.992298:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:0.0:1784047633.992336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047634.001084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047634.002084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047634.002248:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560192 00000100:00100000:0.0:1784047634.002257:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560192 00000100:00100000:0.0:1784047634.002327:0:66221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560064 00000100:00100000:0.0:1784047634.002331:0:66221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560064 00000100:00100000:0.0:1784047634.002357:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1500 00000100:00100000:0.0:1784047634.002366:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689560192:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047634.002435:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+11:2399:x1870705689560192:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 70us (10098us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047634.002443:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1500 00000100:00100000:0.0:1784047634.002461:0:66221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1501 00000100:00100000:0.0:1784047634.002467:0:66221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+51:2399:x1870705689560064:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047634.002494:0:66221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c846d7a-6357-4e9c-a620-e35737ede709+51:2399:x1870705689560064:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047634.003315:0:66221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1501 00000100:00100000:0.0:1784047634.003347:0:26181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560320 00000100:00100000:0.0:1784047634.003352:0:26181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560320 00000100:00100000:0.0:1784047634.003388:0:26181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2714 00000100:00100000:0.0:1784047634.003395:0:26181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689560320:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047634.003441:0:26181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0c846d7a-6357-4e9c-a620-e35737ede709+7:2399:x1870705689560320:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 46us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047634.003448:0:26181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2714 00000100:00080000:0.0:1784047634.003465:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047634.003470:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047634.003473:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:3.0:1784047634.096531:0:97353:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784047634.096889:0:97353:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784047634.194802:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709438976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047634.194903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047634.196663:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784047634.196752:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709439104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047634.196833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047634.198104:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709438976 00000100:00100000:0.0:1784047634.198116:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709438976 00000100:00100000:0.0:1784047634.198178:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439104 00000100:00100000:0.0:1784047634.198181:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439104 00000100:00100000:0.0:1784047634.198207:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1784047634.198217:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709438976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047634.198256:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1784047634.198321:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870705709438976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (3418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047634.198328:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1784047634.198346:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1784047634.198353:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709439104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784047634.198369:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:0.0:1784047634.198397:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709439104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047634.198419:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:2.0:1784047634.202044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709439104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784047634.202064:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870705709438976:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784047634.706974:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047634.707264:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784047634.707283:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709439232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047634.707392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047634.707858:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439232 00000100:00100000:0.0:1784047634.707872:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439232 00000100:00100000:0.0:1784047634.707961:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:0.0:1784047634.707975:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709439232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047634.708163:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047634.708253:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709439232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047634.708263:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:2.0:1784047634.711125:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709439232:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1784047635.303292:0:97404:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784047635.304433:0:97404:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784047635.730929:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709439360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784047635.731029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784047635.731082:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047635.731132:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439360 00000100:00100000:0.0:1784047635.731141:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439360 00000100:00100000:0.0:1784047635.731228:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:0.0:1784047635.731240:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709439360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047635.731263:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047635.731311:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709439360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047635.731319:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:2.0:1784047635.731494:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709439360:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784047635.733816:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784047636.758158:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784047637.781114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784047638.802716:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047638.802826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709439488:0@lo:400:kworker.0 00000100:00080000:0.0:1784047638.802835:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047638.802839:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1784047638.802860:0:52247:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047638.802863:0:52247:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1784047638.802899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047638.802926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709439616:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.802943:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709440000:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.802965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.802967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.802988:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709440512:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.802988:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709440128:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803055:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439488 00000100:00100000:2.0:1784047638.803063:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439488 00000100:00100000:2.0:1784047638.803111:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1784047638.803121:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709439488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.803150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803168:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e36843b-2016-43fe-8842-da5818d68597+24:3647:x1870705709439488:12345-0@lo:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.803169:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709440640:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803177:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784047638.803210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803218:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439616 00000100:00100000:2.0:1784047638.803222:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439616 00000100:00100000:0.0:1784047638.803243:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709439744:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803259:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440512 00000100:00100000:2.0:1784047638.803262:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440512 00000100:00100000:0.0:1784047638.803273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803277:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440128 00000100:00100000:2.0:1784047638.803279:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440128 00000100:00100000:0.0:1784047638.803285:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709440256:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803293:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440640 00000100:00100000:2.0:1784047638.803295:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440640 00000100:00100000:0.0:1784047638.803310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803314:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439744 00000100:00100000:2.0:1784047638.803316:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439744 00000100:00100000:0.0:1784047638.803327:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709440768:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803337:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1784047638.803344:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709439616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.803349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047638.803363:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784047638.803368:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709439872:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803387:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870705709439616:12345-0@lo:400:kworker.0 Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.803388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803394:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1784047638.803403:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709440384:0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803404:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440768 00000100:00100000:2.0:1784047638.803407:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440768 00000100:00100000:2.0:1784047638.803422:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1784047638.803423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047638.803428:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709440512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.803451:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1784047638.803453:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870705709440512:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047638.803459:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1784047638.803459:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709440128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047638.803471:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1784047638.803476:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709440640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.803486:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870705709440128:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.803492:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1784047638.803497:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870705709440640:12345-0@lo:400:kworker.0 Request processed in 21us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047638.803588:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:0.0:1784047638.803691:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1784047638.803700:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709439744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.803804:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870705709439744:12345-0@lo:400:kworker.0 Request processed in 106us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.803811:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1784047638.803824:0:66220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1784047638.803831:0:66220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709440768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.803861:0:66220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870705709440768:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.803868:0:66220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1784047638.803968:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440256 00000100:00100000:0.0:1784047638.803972:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440256 00000100:00100000:0.0:1784047638.804155:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709439872 00000100:00100000:0.0:1784047638.804159:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709439872 00000100:00100000:0.0:1784047638.804184:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:0.0:1784047638.804258:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709440256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804293:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709440256:12345-0@lo:400:kworker.0 Request processed in 39us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.804299:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:0.0:1784047638.804367:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1784047638.804374:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709439872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804401:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709439872:12345-0@lo:400:kworker.0 Request processed in 29us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.804407:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1784047638.804430:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440000 00000100:00100000:0.0:1784047638.804434:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440000 00000100:00100000:0.0:1784047638.804462:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440384 00000100:00100000:0.0:1784047638.804465:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440384 00000100:00100000:0.0:1784047638.804485:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:0.0:1784047638.804500:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709440000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804531:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870705709440000:12345-0@lo:400:kworker.0 Request processed in 32us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.804536:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:0.0:1784047638.804548:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:0.0:1784047638.804555:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709440384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804585:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709440384:12345-0@lo:400:kworker.0 Request processed in 31us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047638.804591:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:0.0:1784047638.804672:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709439872:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709440384:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804694:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870705709439744:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804702:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709440256:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.804711:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870705709440768:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.805076:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870705709439616:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.805087:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870705709440128:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.805097:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870705709440640:0@lo:400:kworker.0 00000100:00080000:0.0:1784047638.809077:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784047638.809089:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784047638.809092:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784047638.809163:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709440000:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.809184:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870705709440512:0@lo:400:kworker.0 00000100:00100000:0.0:1784047638.809225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e36843b-2016-43fe-8842-da5818d68597:3647:1870705709439488:0@lo:400:kworker.0 00000100:00100000:3.0:1784047639.178140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047639.178192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047639.178313:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560448 00000100:00100000:2.0:1784047639.178323:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560448 00000100:00100000:2.0:1784047639.178402:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 218 00000100:00100000:2.0:1784047639.178413:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689560448:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1784047639.178492:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689560448:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 81us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047639.178500:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 218 00000100:00100000:2.0:1784047639.179157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047639.187267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047639.187499:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560832 00000100:00100000:3.0:1784047639.187510:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560832 00000100:00080000:2.0:1784047639.187626:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047639.187703:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2717 00000100:00100000:3.0:1784047639.187716:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689560832:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047639.187818:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689560832:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 104us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047639.187826:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2717 00000100:00100000:0.0:1784047639.188910:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560704 00000100:00100000:0.0:1784047639.188921:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560704 00000100:00100000:0.0:1784047639.189018:0:67153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560576 00000100:00100000:0.0:1784047639.189022:0:67153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560576 00000100:00100000:0.0:1784047639.189052:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1508 00000100:00100000:0.0:1784047639.189062:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2402:x1870705689560704:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047639.189122:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+11:2402:x1870705689560704:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 62us (10928us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047639.189130:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1508 00000100:00100000:0.0:1784047639.189147:0:67153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1509 00000100:00100000:0.0:1784047639.189154:0:67153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+51:2402:x1870705689560576:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1784047639.189202:0:67153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c846d7a-6357-4e9c-a620-e35737ede709+51:2402:x1870705689560576:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 49us (10048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047639.189207:0:67153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1509 00000100:00080000:2.0:1784047639.189305:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047639.189321:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047639.314884:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784047639.314910:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709440896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047639.314999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047639.315389:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709440896 00000100:00100000:0.0:1784047639.315397:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709440896 00000100:00100000:0.0:1784047639.315511:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1784047639.315522:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709440896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784047639.315557:0:8442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1784047639.315629:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709440896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047639.315636:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:1.0:1784047639.315761:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709441024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784047639.315796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047639.315865:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709440896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784047639.321307:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441024 00000100:00100000:2.0:1784047639.321327:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441024 00000100:00100000:2.0:1784047639.321401:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1784047639.321413:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd0030e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709441024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784047639.321454:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:2.0:1784047639.322304:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd0030e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1870705709441024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 888us (6503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047639.322314:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1784047639.322396:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870705709441024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784047639.826808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784047639.827036:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc5aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709441152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784047639.827118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047639.827273:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441152 00000100:00100000:0.0:1784047639.827298:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441152 00000100:00100000:0.0:1784047639.827359:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:0.0:1784047639.827369:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709441152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784047639.827399:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047639.827454:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709441152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047639.827461:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:3.0:1784047639.827646:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc5aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709441152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784047640.853808:0:16469:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784047640.854876:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709441280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784047640.854986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047640.855076:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441280 00000100:00100000:0.0:1784047640.855086:0:12054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441280 00000100:00100000:0.0:1784047640.855194:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:0.0:1784047640.855208:0:12054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709441280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784047640.855246:0:12054:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784047640.855299:0:12054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc79f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870705709441280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047640.855308:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00080000:0.0:1784047640.855334:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047640.855389:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709441280:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1784047640.856522:0:97596:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:0.0:1784047641.874950:0:15071:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784047642.320816:0:97644:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:3.0:1784047642.903932:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784047643.753351:0:97693:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00080000:0.0:1784047643.923537:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047643.923544:0:45180:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1784047643.923563:0:45180:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784047643.923566:0:45180:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1784047643.923690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709441792:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924125:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709441408:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047643.924226:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709441920:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047643.924271:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709442432:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047643.924328:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442432 00000100:00100000:2.0:1784047643.924334:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442432 00000100:00100000:2.0:1784047643.924400:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1784047643.924409:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709442432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924469:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870705709442432:12345-0@lo:400:kworker.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047643.924476:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1784047643.924527:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870705709442432:0@lo:400:kworker.0 00010000:00010000:2.0:1784047643.924578:0:16468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784047643.924590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc79f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709441536:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047643.924672:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709442048:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.924696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047643.924713:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709442560:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.926035:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709441664:0@lo:400:kworker.0 00000100:00100000:1.0:1784047643.926120:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441920 00000100:00100000:1.0:1784047643.926127:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441920 00000100:00100000:1.0:1784047643.926189:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1784047643.926199:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709441920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.929119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047643.929181:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709442304:0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.929223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784047643.929283:0:94372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441408 00000100:00100000:0.0:1784047643.929292:0:94372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441408 00000100:00100000:0.0:1784047643.929343:0:94372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784047643.929366:0:94372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709441408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.929423:0:94372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e36843b-2016-43fe-8842-da5818d68597+24:3646:x1870705709441408:12345-0@lo:400:kworker.0 Request processed in 72us (5236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047643.929430:0:94372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784047643.929464:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441536 00000100:00100000:0.0:1784047643.929468:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441536 00000100:00100000:0.0:1784047643.929498:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442048 00000100:00100000:0.0:1784047643.929501:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442048 00000100:00100000:0.0:1784047643.929522:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1784047643.929528:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709441536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.929566:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870705709441536:12345-0@lo:400:kworker.0 Request processed in 38us (4913us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047643.929572:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1784047643.929584:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:0.0:1784047643.929591:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.929649:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870705709442048:12345-0@lo:400:kworker.0 Request processed in 59us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047643.929655:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00080000:0.0:1784047643.929677:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784047643.929693:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047643.929807:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441792 00000100:00100000:0.0:1784047643.929812:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441792 00000100:00100000:0.0:1784047643.930039:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1784047643.930047:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709441792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.930091:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709441792:12345-0@lo:400:kworker.0 Request processed in 46us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047643.930097:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1784047643.930116:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442304 00000100:00100000:0.0:1784047643.930121:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442304 00000100:00100000:0.0:1784047643.930154:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:0.0:1784047643.930160:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709442304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.930189:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1870705709442304:12345-0@lo:400:kworker.0 Request processed in 29us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047643.930194:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00080000:0.0:1784047643.930218:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784047643.930252:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e36843b-2016-43fe-8842-da5818d68597:3646:1870705709441408:0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.930486:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709441792:0@lo:400:kworker.0 00000100:00100000:0.0:1784047643.930500:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870705709442304:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.936520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047643.936583:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709442176:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.936652:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047643.936675:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709442688:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.936699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784047643.936771:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442176 00000100:00100000:3.0:1784047643.936780:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442176 00000100:00100000:3.0:1784047643.937425:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1784047643.937443:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709442176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.937518:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709442176:12345-0@lo:400:kworker.0 Request processed in 79us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047643.937526:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1784047643.937564:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709441664 00000100:00100000:3.0:1784047643.937569:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709441664 00000100:00100000:3.0:1784047643.937626:0:66219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442688 00000100:00100000:3.0:1784047643.937629:0:66219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442688 00000100:00100000:3.0:1784047643.937668:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1784047643.937674:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709441664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.937711:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870705709441664:12345-0@lo:400:kworker.0 Request processed in 36us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047643.937718:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1784047643.937730:0:66219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1784047643.937737:0:66219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709442688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.937766:0:66219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870705709442688:12345-0@lo:400:kworker.0 Request processed in 31us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047643.937773:0:66219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00080000:3.0:1784047643.937794:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047643.937919:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870705709441664:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.937935:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709442176:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.937946:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870705709442688:0@lo:400:kworker.0 00000100:00100000:1.0:1784047643.938499:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870705709441920:12345-0@lo:400:kworker.0 Request processed in 12299us (14241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047643.938517:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:3.0:1784047643.939990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870705709441920:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.943963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047643.944113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc79f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870705709441536:0@lo:400:kworker.0 00000100:00100000:2.0:1784047643.944131:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870705709442048:0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.945760:0:68026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442560 00000100:00100000:3.0:1784047643.945780:0:68026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442560 00000100:00100000:3.0:1784047643.945923:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:3.0:1784047643.945937:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709442560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784047643.946043:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870705709442560:12345-0@lo:400:kworker.0 Request processed in 110us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047643.946061:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1784047643.946225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870705709442560:0@lo:400:kworker.0 00000100:00080000:0.0:1784047643.947210:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784047644.295867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047644.295912:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047644.296008:0:94374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689560960 00000100:00100000:1.0:1784047644.296019:0:94374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689560960 00000100:00100000:1.0:1784047644.296094:0:94374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 220 00000100:00100000:1.0:1784047644.296105:0:94374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689560960:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047644.296185:0:94374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfe6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f88e784-1ed8-4645-9d2f-1081095d1f30+10:2402:x1870705689560960:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 81us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047644.296192:0:94374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 220 00000100:00100000:2.0:1784047644.297268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1784047644.303223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1784047644.303538:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561344 00000100:00100000:1.0:1784047644.303548:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561344 00000100:00100000:1.0:1784047644.303667:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2720 00000100:00100000:1.0:1784047644.303681:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689561344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1784047644.303775:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0c846d7a-6357-4e9c-a620-e35737ede709+7:2402:x1870705689561344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 87us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047644.303783:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2720 00000100:00080000:2.0:1784047644.304028:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784047644.304803:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561216 00000100:00100000:3.0:1784047644.304812:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561216 00000100:00100000:3.0:1784047644.304874:0:66220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561088 00000100:00100000:3.0:1784047644.304878:0:66220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561088 00000100:00100000:3.0:1784047644.304914:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1516 00000100:00100000:3.0:1784047644.304924:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:2402:x1870705689561216:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1784047644.304976:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+11:2402:x1870705689561216:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 53us (9063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047644.304984:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1516 00000100:00100000:3.0:1784047644.305003:0:68026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1517 00000100:00100000:3.0:1784047644.305010:0:68026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc5aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+51:2402:x1870705689561088:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:2.0:1784047644.305860:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784047644.305866:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784047644.306356:0:68026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc5aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0c846d7a-6357-4e9c-a620-e35737ede709+51:2402:x1870705689561088:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1241us (8986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784047644.306367:0:68026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1517 00000100:00100000:0.0:1784047644.440564:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cd0030fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709442816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784047644.440718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784047644.441194:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442816 00000100:00100000:1.0:1784047644.441203:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442816 00000100:00100000:1.0:1784047644.441275:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:1.0:1784047644.441287:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709442816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784047644.441327:0:8441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:1.0:1784047644.441388:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870705709442816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784047644.441399:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:3.0:1784047644.441494:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cd0030fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870705709442816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784047644.441728:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709442944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047644.441778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047644.442002:0:83733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709442944 00000100:00100000:2.0:1784047644.442008:0:83733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709442944 00000100:00100000:2.0:1784047644.442047:0:83733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1784047644.442055:0:83733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709442944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784047644.442076:0:83733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1784047644.442125:0:83733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870705709442944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047644.442131:0:83733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:1.0:1784047644.442220:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870705709442944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784047644.840882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047644.842040:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561472 00000100:00100000:0.0:1784047644.842058:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561472 00000100:00100000:0.0:1784047644.842147:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2721 00000100:00100000:0.0:1784047644.842160:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689561472:12345-192.168.204.40@tcp:8:ptlrpcd_rcv.0 00010000:02000400:0.0:1784047644.842220:0:26189:0:(ldlm_lib.c:976:target_handle_reconnect()) lustre-OST0000: Client 0c846d7a-6357-4e9c-a620-e35737ede709 (at 192.168.204.40@tcp) reconnected, waiting for 3 clients in recovery for 1:24 00010000:00080000:0.0:1784047644.862072:0:26189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp recovering/t4294968779 exp ffff99ccfe6bc800 cur 3743 last 1784047644 00002000:00100000:0.0:1784047644.863032:0:26189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c846d7a-6357-4e9c-a620-e35737ede709/ffff99ccfe6bc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784047644.863063:0:26189:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.204.40@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1784047644.863095:0:26189:0:(import.c:65:import_set_state_nolock()) ffff99ccd8410800 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1784047644.863106:0:26189:0:(import.c:65:import_set_state_nolock()) ffff99ccd8410800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784047644.863206:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cd00d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0c846d7a-6357-4e9c-a620-e35737ede709+5:2398:x1870705689561472:12345-192.168.204.40@tcp:8:ptlrpcd_rcv.0 Request processed in 21047us (22340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784047644.863218:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2721 00000100:00100000:3.0:1784047644.870160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047644.870251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047644.870847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1784047644.871012:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561600 00000100:00100000:0.0:1784047644.871022:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561600 00000100:00100000:0.0:1784047644.871084:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561728 00000100:00100000:0.0:1784047644.871087:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561728 00000100:00100000:0.0:1784047644.871110:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5102 00000100:00100000:0.0:1784047644.871121:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689561600:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.871145:0:8432:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbd0c7ca80 x1870705689561600/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.871168:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689561600:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 49us (1019us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.871174:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5102 00000100:00100000:0.0:1784047644.871184:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5103 00000100:00100000:0.0:1784047644.871190:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689561728:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.871198:0:8432:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbd0c7fb80 x1870705689561728/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.871222:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c846d7a-6357-4e9c-a620-e35737ede709+6:2398:x1870705689561728:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 32us (971us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.871228:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5103 00000100:00100000:3.0:1784047644.871375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047644.871804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00080000:1.0:1784047644.872793:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.872836:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbd0c7ca80 x1870705689561600/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.872851:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00100000:3.0:1784047644.872969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047644.873010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047644.873450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1784047644.873486:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561856 00000100:00100000:3.0:1784047644.873495:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561856 00000100:00100000:3.0:1784047644.873534:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689561984 00000100:00100000:3.0:1784047644.873537:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689561984 00000100:00100000:3.0:1784047644.873549:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689562112 00000100:00100000:3.0:1784047644.873552:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689562112 00000100:00100000:3.0:1784047644.873563:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689562240 00000100:00100000:3.0:1784047644.873565:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689562240 00000100:00100000:3.0:1784047644.873579:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689562368 00000100:00100000:3.0:1784047644.873582:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689562368 00000100:00100000:3.0:1784047644.873598:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705689562496 00000100:00100000:3.0:1784047644.873601:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705689562496 00000100:00100000:0.0:1784047644.873644:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5104 00000100:00100000:0.0:1784047644.873658:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689561856:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.873677:0:26188:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbd0c7dc00 x1870705689561856/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.873690:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689561856:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 37us (2844us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.873696:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5104 00000100:00100000:0.0:1784047644.873707:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5105 00000100:00100000:0.0:1784047644.873714:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689561984:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.873722:0:26188:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbd0c7d500 x1870705689561984/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.873732:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689561984:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 20us (2358us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.873737:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5105 00000100:00100000:0.0:1784047644.873744:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5106 00000100:00100000:0.0:1784047644.873749:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbd0c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562112:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.873756:0:26188:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbd0c7c380 x1870705689562112/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.873778:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbd0c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562112:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 29us (1975us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.873784:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5106 00000100:00100000:0.0:1784047644.873793:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5107 00000100:00100000:0.0:1784047644.873799:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562240:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.873806:0:26188:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbc8ee0e00 x1870705689562240/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.873815:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562240:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 18us (853us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.873830:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5107 00000100:00100000:0.0:1784047644.873839:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5108 00000100:00100000:0.0:1784047644.873846:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562368:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784047644.873853:0:26188:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbc8ee1180 x1870705689562368/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784047644.873860:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562368:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 16us (851us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784047644.873875:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5108 00000100:00100000:3.0:1784047644.874434:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5109 00000100:00100000:3.0:1784047644.874444:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc8ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562496:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1784047644.874454:0:26190:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99cbc8ee3100 x1870705689562496/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784047644.874463:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc8ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0c846d7a-6357-4e9c-a620-e35737ede709+11:2398:x1870705689562496:12345-192.168.204.40@tcp:101:ldlm_lock_repla.0 Request processed in 23us (1016us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784047644.874469:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5109 00010000:00080000:1.0:1784047644.874511:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874520:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874536:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbd0c7fb80 x1870705689561728/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874549:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874568:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874570:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874575:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbd0c7dc00 x1870705689561856/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874582:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874591:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874593:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874597:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbd0c7d500 x1870705689561984/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874652:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874729:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874733:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874741:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbd0c7c380 x1870705689562112/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874748:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874759:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874761:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874766:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbc8ee0e00 x1870705689562240/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874773:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874777:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874793:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874798:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbc8ee1180 x1870705689562368/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874805:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874810:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1784047644.874812:0:96960:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1784047644.874816:0:96960:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.40@tcp: req@ffff99cbc8ee3100 x1870705689562496/t0(0) o101->0c846d7a-6357-4e9c-a620-e35737ede709@192.168.204.40@tcp:20/0 lens 328/0 e 0 to 0 dl 1784047655 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1784047644.874822:0:96960:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1784047644.874826:0:96960:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1784047644.948330:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784047644.948353:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709443072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784047644.948435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784047644.948493:0:39444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705709443072 00000100:00100000:2.0:1784047644.948501:0:39444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705709443072 00000100:00100000:2.0:1784047644.948546:0:39444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:2.0:1784047644.948556:0:39444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cbc9ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709443072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784047644.948586:0:39444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784047644.948897:0:39444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cbc9ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870705709443072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 341us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784047644.948906:0:39444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:2.0:1784047644.948958:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cbc9edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870705709443072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784047644.950147:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 70614 lines, 70614 kept, 0 dropped, 0 bad.